Date

Steps

Completed  between Diagnosis and Design Phases

1)  Planning the Evaluation  – Assessing Evaluability:

·         Set goal.

·         Determine standards of success.

·         Identify indicators of success.

·         Articulate the theory of change, the sequence of components and underlying assumptions that achieve the intended results.

·         Create the logic model, including the inputs/resources, activities/processes, initial outcomes (usually knowledge and skills) of the activities, intermediate outcomes (usually attitudes, aspirations, and behaviors) of the activities, and long-term result(s) intended from the activities.

·         Tools:  Guiding Principles for Iowa Support System; KASAB template; Creating a Theory of Change – Blue and Green Card Activity; Diagnosis Worksheet for Westlake Middle School; Action Plan for Westlake Middle School; Charting the Logic Model; Power Point (Planning for Evaluation)

2)  Planning the Evaluation -  Formulating Evaluation Questions:

·         Formulate evaluation questions that provide structure and focus to the evaluation framework.  Consideration should be given to each question being reasonable, appropriate, answerable, specific in terms of program success, and specific in terms of measure of performance.

·         Tools:  Evaluation Questions – Examples and Commentary; Writing Evaluation Questions

3)  Planning the Evaluation – Constructing Evaluation Framework:

·         Construct evaluation questions based on what we need to know, how we will know, who/what will tell us, and how we will collect the data.

·         Tools:  Evaluation Framework Worksheet; Data Collection Methods

Completed during Implementation

4)  Conducting the Evaluation – Collecting Data:

·         Collect data systematically.

·         Tools: Monitoring Key Activities; Data Collection Plan

5)  Conducting the Evaluation – Organizing and Analyzing Data:

·         Organize, analyze, and display the data.

·         Tools:  Data Analysis Methods, Evaluation Framework Worksheet

6)  Conducting the Evaluation -  Interpreting Data:

·         Make meaning from the data, resulting in changes based on merit and impact.

·         Tools:  Evidence vs. Claim

Annual report

7)  Reporting the Evaluation – Disseminating Results and Findings:

·         Consider the audiences for the information.

·         Send same message to all audiences but use forms of communication appropriate to each audience.

8)  Reporting the Evaluation – Evaluating the Evaluation:

·         Answer the questions, “What have we learned from the evaluation process?” “What would we do again?”  and “What would we change?”

·         Tools: Configuration Map for Phase V