|
Iowa Support for Schools and Districts in Need of Assistance (SINA & DINA)Monitoring and Assessment Phase: Steps for EvaluationAdapted from Source: Training Manual for Assessing Impact: Evaluating
Staff Development by Joellen Killion with Linda Munger, Pat Roy, and Parker McMullen
© 2003 Date | Steps | Completed between Diagnosis and Design Phases | 1) Planning the Evaluation – Assessing Evaluability: ·
Set goal. · Determine standards of success. · Identify indicators of success. · Articulate the theory of change, the sequence of components and underlying assumptions
that achieve the intended results. ·
Create the logic model, including the inputs/resources,
activities/processes, initial outcomes (usually knowledge and skills) of the activities, intermediate outcomes (usually attitudes,
aspirations, and behaviors) of the activities, and long-term result(s) intended from the activities. · Tools: Guiding Principles for Iowa Support System; KASAB template;
Creating a Theory of Change – Blue and Green Card Activity; Diagnosis Worksheet for Westlake Middle School; Action Plan
for Westlake Middle School; Charting the Logic Model; Power Point (Planning for Evaluation) | 2) Planning the Evaluation - Formulating
Evaluation Questions: · Formulate evaluation questions that provide structure and focus to the evaluation framework.
Consideration should be given to each question being reasonable, appropriate, answerable, specific in terms of program
success, and specific in terms of measure of performance. · Tools: Evaluation Questions – Examples and Commentary; Writing
Evaluation Questions | 3) Planning the Evaluation
– Constructing Evaluation Framework: · Construct evaluation questions based on what we need to know, how we will know, who/what
will tell us, and how we will collect the data. · Tools: Evaluation Framework Worksheet; Data Collection Methods | Completed during Implementation | 4) Conducting the Evaluation – Collecting Data: ·
Collect data systematically. ·
Tools: Monitoring Key Activities; Data Collection
Plan | 5) Conducting the Evaluation – Organizing and
Analyzing Data: · Organize, analyze, and display the data. · Tools: Data Analysis Methods, Evaluation Framework Worksheet | 6) Conducting the Evaluation - Interpreting Data: ·
Make meaning from the data, resulting in changes
based on merit and impact. · Tools: Evidence vs. Claim | Annual report | 7) Reporting the Evaluation – Disseminating
Results and Findings: · Consider the audiences for the information. · Send same message to all audiences but use forms of communication appropriate to each audience. | 8) Reporting the Evaluation – Evaluating the
Evaluation: ·
Answer the questions, “What have we
learned from the evaluation process?” “What would we do again?” and “What would
we change?” ·
Tools: Configuration Map for Phase V |
|