Evaluation Planning – 1.05 Assess Evaluation Capacity
It is generally a good idea to assess t program’s capacity surrounding evaluation prior to developing and implementing an evaluation plan. This process can help to elucidate resources available within the program as well as areas that may need additional attention. In addition, it helps to establish a baseline assessment of evaluation capacity prior to implementing the SEP. By working through the SEP, the Evaluation Champion and the working group will hopefully help to build the evaluation capacity of both the program and the organization.
Assess Organization Evaluation Capacity
Organizational capacity can be assessed formally by completing a capacity survey. It should be completed by individuals who have the information available to accurately assess evaluation capacity. Typically, in order to assess organizational capacity, an organization leader (who has a broad perspective on the organization and its programs) should be asked to reflect on: a) the evaluation resources available within the organization (personnel, budget, and technology), b) any organizational evaluation policies, and c) the current evaluation capacity of the staff. You may decide to ask an organizational leader to complete the Organization Evaluation Capacity Survey in Appendix II. This instrument only needs to be completed once for each organization, even if you are doing several program evaluations. The benefit of using the survey is that it can be revisited after the organization has implemented the evaluation and used to assess whether any changes have occurred after participating in the SEP.Assess Program Evaluation Capacity
Program capacity can be assessed formally by completing another capacity survey focused on the program, such as the Program Evaluation Capacity Survey included in Appendix III. This should be completed by staff who are familiar with how the program currently handles evaluation. The Evaluation Champion and the working group should be involved in assessing program evaluation capacity. The survey should be completed for each of the programs that will be evaluated. The purpose of this step is to establish a baseline and also to get a sense of what is actually involved in running each of the programs. This includes gathering basic program information such as a description of the program, its participants (i.e. numbers, and demographic characteristics) and other key data that will be used for the logic model – the inputs (i.e. staff, curricula), activities, outcomes, context, and assumptions. It also includes gathering information on any evaluations of the program that have occurred to date.