Evaluation Planning – 3.02 Evaluation Purpose
The Evaluation Purpose section of the evaluation plan provides a short description of the reason for conducting the evaluation and what the working group hopes to achieve by it. Writing the Evaluation Purpose section is an important part of any evaluation effort. It helps to define the goals and boundaries of the current evaluation effort, and can serve as a “big picture” reference point for the working group as they work through the details of developing an evaluation methodology.
The Evaluation Purpose section appears at the beginning of the evaluation plan document and should describe what is and what is not being evaluated and the overall goal or purpose of the evaluation. You might even think of it as a kind of “mission statement” for the evaluation (rather than for the program). It sets boundaries by identifying the program elements being considered for the evaluation, which goals or objectives are of most interest, and what the intended uses of the evaluation results are. As the working group completes other steps in the Protocol and makes decisions about aspects of the evaluation strategies, the Purpose section should be revised or updated to include a brief description of the methodology choices that have been made and the reasoning behind these decisions.
Since one of the major functions of the Evaluation Purpose section is to provide the overall rationale to guide the specific detailing of the evaluation, the Purpose Statement will tend to vary systematically with the program lifecycle. For instance, in an early phase evaluation the major purpose might be to provide a thorough description of the process of delivering the program or of its implementation so that the program might be improved in subsequent iterations. A Phase II purpose might emphasize that the evaluation is conducted to assess the degree to which the program appears to be related to key outcomes of interest. In Phase III, the purpose might stress the desire for the evaluation to demonstrate the effectiveness of the program on key outcomes.
It is important to keep in mind that this section should be brief. It is a good idea to begin this stage by drafting an initial Evaluation Purpose section (recognizing that it will be incomplete at this point in the process). As you complete each of the subsequent steps in Stage 3, revisit the evaluation purpose statement and add to and revise the statement.
Q&A
Q: How will the pathway diagram be used for evaluation planning?
The pathway model will help guide your evaluation by revealing key outcomes and pathways that may serve as focal points for this evaluation cycle. This focusing is important because it is (usually) not feasible to evaluate the whole program in one year. The visual nature of the pathway model offers a uniquely powerful way to see the key “nodes” in the overall process of change, for example, outcomes that may have many arrows “going in” or “coming out”, or both. (Ironically, although the pathway model is built from the knowledge held by the model-builders, it is sometimes only when they step back and look at the resulting visual display that these patterns can be recognized fully.) These model components become candidates for consideration, along with other factors such as stakeholder priorities, lifecycle considerations, and feasibility, in finalizing the evaluation questions.
A pathway model can also help with what is often a challenge for program staff, namely, that funders or other stakeholders want “evidence” about the program’s impact on long-term outcomes which is simply not feasible for program staff to evaluate. In this case, the pathway model is useful for demonstrating the conceptual linkage between shorter-term outcomes (which can be evaluated) and more distant outcomes. The burden of evaluation is reduced if you can then find published research to support these longer-term conceptual linkages.
Q: What should be included in an evaluation purpose statement?
The Evaluation Purpose Statement should be brief, but should identify the purpose of the evaluation (what are you trying to find out, and why?), provide a concise description of what will be done in the evaluation (how will you do it?), and what parts of the program will be examined (which assumptions, activities, outcomes, or relationships will be focused on?), and explain how the results will be used. It should also explain how this evaluation fits in relative to past and possible future evaluations. In some cases, it may also be appropriate to explain in your Purpose Statement why your evaluation is not going to cover some issues that might be considered a priority by some stakeholders.