Evaluation Implementation – 2.01 Review Evaluation Implementation and Decisions
As discussed in the implementation phase of this protocol, even the best laid evaluation plans will need flexibility and adjustment when the realities of implementation come into play. Throughout the implementation phase this protocol suggests that the working group reflect on their work as they go, take careful notes, and make changes accordingly. Now, at the end of the implementation phase, and the beginning of the utilization phase, the working group should consolidate these notes and take careful stock of the changes that have been made. It is likely that the group has developed a stronger evaluative culture, and it is possible, for example, that challenges which motivated changes on the fly could, with more time to reflect, be handled more efficiently or with more finesse in the next round.
Furthermore, there may be patterns, results, and challenges that did not become apparent until the end of the implementation phase and therefore could not be addressed “on the fly.” These issues should be addressed through reflection and discussion at this time. Through careful review and discussion of the implementation process the working group will likely generate a list of ideas, motivations, and suggested changes that they will bring to the next iteration of their evaluation plan.
In addition, just as at the beginning of the implementation phase, and in preparation for making revisions to the evaluation plan, now would be an ideal time for the working group to set aside time to conduct a metaevaluation of their work so far. This might include a discussion focused around the Program Evaluation Standards mentioned in step 2.1.01, or may be guided by a less formal reflection on the quality, credibility, accuracy, usefulness and feasibility of the evaluation plan, its implementation and the utilization of its results