Part A. Focus Evaluation Design You are now ready to develop your evaluation design. At this stage, the logic model will be your roadmap to determining the purpose of your evaluation, evaluation questions, evaluation measures, potential data sources and available resources. During the evaluation design, you also will determine the scope of your evaluation. Potential frameworks that may be applicable to your program evaluation include: Process evaluation determines whether the program is being implemented as intended and monitors how the activities are being executed. This type of evaluation should be administered throughout the operation of the program because it can provide early warning signs of any challenges that may occur during the implementation of the program and allow programs to be adapted when needed. The following information will be addressed through this type of evaluation: •
The extent to which the program is being implemented as designed
•
The extent to which the program is achieving the intended outcomes
•
Whether the program is accessible and acceptable to its target population
Example questions of this type of evaluation include: •
What are the barriers to the implementation of the program activity?
•
What are the facilitators of the implementation of the program activity?
•
What activity/activities were conducted and where?
•
What are participant suggestions for implementation improvement?
Outcome evaluation measures the effectiveness of the program in its target population through the assessment of progress toward stated outcomes and achievement of objectives. To adequately design an outcome evaluation, it is essential to review the components of the program (see Section 2). This type of evaluation typically is conducted after completion of a program activity. Outcome evaluation informs the program of how effective it is in meeting its goals and objectives. The following are examples of questions for this type of evaluation: •
How do participants describe their experience with the program/activity?
•
What did the participant learn from attending the program?
•
By how much did the program improve access to services as intended?
•
By how much did the program increase health behaviors among participants as intended?
Developing Evaluation Questions Once you have determined the scope, or parameters, of your evaluation, the next step is to develop evaluation questions. You may wish to evaluate an entire program, like a Community Wellness Hub, or a specific activity within the program, such as physical activity. When developing evaluation questions, use your logic model as a reference and consider the following factors: •
Utility: Develop evaluation questions that will serve the needs of the intended users.
•
Feasibility: Develop evaluation questions that can be realistically addressed with your scope, capacity and resources.
•
Accuracy: Develop evaluation questions that are grounded in evidence-based practices and will convey technically adequate information.
These factors will help ensure that your evaluation is focused on information that you need to know rather than what you would like to know. Because your evaluation also should benefit key partners who are contributing to the program, they 20 | 2022 National Recreation and Park Association
