Purpose
The checklist below is a reference for evaluators with tips and prompts. The checklist can help ensure critical steps have been included throughout the evaluation lifecycle.
Step 3: Focus the Evaluation Questions and Design
In Step 3 of the CDC Program Evaluation Framework, you define the evaluation's purpose and focus, develop evaluation questions, and then select an appropriate evaluation design to support them.
Applying Cross-Cutting Actions and the Evaluation Standards
As with the other evaluation framework steps, it is important to integrate the cross-cutting actions and evaluation standards when focusing the evaluation questions and design in Step 3. See Table 6 in the CDC Program Evaluation Framework, 2024 for key questions for integrating the cross-cutting actions and evaluation standards for Step 3.
Develop the Evaluation Purpose Statement
☐ Think through:
- Why the evaluation is being performed
- How the findings will be used
- Who will learn from or use the findings
☐ Identify the intended users of the evaluation findings:
- Draft a list of individuals or groups who will learn from, act on, and use the findings
- You may have already identified some during Step 1
- Engage with your interest holders to identify how and when the findings are most likely to be used
Determine the Type of Evaluation
☐ Review evaluation types and determine the type of evaluation that will meet the program's needs:
☐ Refer to Table 3.2 in the Action Guide to review the types of evaluation and when to use them
Developing Evaluation Questions
☐ Draft a set of broad, open-ended evaluation questions that establish the specific aspects of the program to be evaluated:
- Ensure the evaluation questions align with the evaluation purpose and provide evaluators with the necessary information to achieve the evaluation goals within the context of the evaluation scope
- Determine if the evaluation questions are:
- Evaluative
- Reasonable
- Specific
- Answerable
- Complete
- Refer to Table 3.5 in the Action Guide to see how the characteristics of an evaluation question are defined to determine if your questions fit the criteria. Consider engaging with interest holders to ask them these questions.
Determine Evaluation Design
☐ Determine whether the evaluation design will be experimental, quasi-experimental or observational:
- To decide which design is best, consider:
- Feasibility of the design (i.e., does the evaluation design uphold the underlying scientific principles within the context?) and complexity of the program
- Whether comparisons will be made, and if so, do control and comparison groups naturally exist in the context, or will you have to create these groups? At what cost?
- When and if to engage with interest holders to decide which design and methods to use