Iowa Support Team

Iowa Support System for Schools and Districts 
in Need of Assistance (SINA & DINA)

Monitoring and Assessment Phase

Steps for Evaluation

Adapted from Source:  Training Manual for Assessing Impact:  Evaluating Staff Development by Joellen Killion
with Linda Munger, Pat Roy, and Parker McMullen

© 2003

Date	Steps
	1)  Planning the Evaluation  – Assessing Evaluability: ·        Set goal. ·        Determine standards of success. ·        Identify indicators of success. ·        Articulate the theory of change, the sequence of components and underlying assumptions that achieve the intended results. ·        Create the logic model, including the inputs/resources, activities/processes, initial outcomes (usually knowledge and skills) of the activities, intermediate outcomes (usually attitudes, aspirations, and behaviors) of the activities, and long-term result(s) intended from the activities. ·        Tools:  Guiding Principles for Iowa Support System; Evaluation of Action Plan/Professional Development;  Creating a Theory of Change – Blue and Green Card Activity; Diagnosis Worksheet for Westlake Middle School; Action Plan for Westlake Middle School; The Domains and Critical Elements; KASAB; Charting the Logic Model; PowerPoint – An Introduction to Eight Steps of Evaluation
	2)  Planning the Evaluation -  Formulating Evaluation Questions: ·        Formulate evaluation questions that provide structure and focus to the evaluation framework.  Consideration should be given to each question being reasonable, appropriate, answerable, specific in terms of program success, and specific in terms of measure of performance. ·        Tools:  Guiding Principles for Iowa Support System; Evaluation Questions – Examples and Commentary; Writing Evaluation Questions
	3)  Planning the Evaluation – Constructing Evaluation Framework: ·        Construct evaluation questions based on what we need to know, how we will know, who/what will tell us, and how we will collect the data. ·        Tools:  Evaluation Framework Worksheet; Data Collection Methods
Trainers' Evaluation of Learning Opportunity	4)  Conducting the Evaluation – Collecting Data: ·        Collect data systematically. ·        Tools: Guiding Principles for Iowa Support System; Monitoring Key Activities; Data Collection Plan
Evaluation: PowerPoints	5)  Conducting the Evaluation – Organizing and Analyzing Data: ·        Organize, analyze, and display the data. ·        Tools:  Data Analysis Methods, Westlake Middle School Evaluation Framework Worksheet
	6)  Conducting the Evaluation -  Interpreting Data: ·          Make meaning from the data, resulting in changes based on merit and impact. ·         Tools:  Evidence vs Claim
Trainers' Evaluation of Learning Opportunity	7)  Reporting the Evaluation – Disseminating Results and Findings: ·          Consider the audiences for the information. ·          Send same message to all audiences but use forms of communication appropriate to each audience. ·         Tools:  Guiding Principles for Iowa Support System
	8)  Reporting the Evaluation – Evaluating the Evaluation: ·        Answer the questions, “What have we learned from the evaluation process?” “What would we do again?” and “What would we change?” ·        Tools: Configuration Map for Phase V

PowerPoints:

• Phase V:  Evaluation - Introducing and Planning for the Evaluation PowerPoint and Notes 080909 
• Phase V:  Evaluation - Conducting the Evaluation PowerPoint and Notes 080909
• Phase V:  Evaluation - Reporting the Evaluation PowerPoint and Notes 080909

Tools and Resources:

• Table of Contents for Monitoring and Assessment - The Evaluation Phase
• Steps for Evaluation
• Guiding Principles of Iowa Support System
• Evaluation of Action Plan/Professional Development
• Creating a Theory of Change – Green and Blue Card Activity
• Diagnosis Worksheet for Westlake Middle School
• Westlake Middle School Action Plan
• The Domains and Critical Elements
• KASAB
• Charting the Logic Model    
• Evaluation Questions – Examples and Commentary           
• Writing Evaluation Questions  
• Evaluation Framework Worksheet 
• Monitoring Implementation and Evaluation Framework
• Evaluation Framework for Storm Lake                                              
• Data Collection Methods      
• Monitoring Key Activities                                                             
• Data Collection Plan                                                                       
• Data Analysis Methods                                                                  
• Westlake Middle School Evaluation Framework      
• Configuration Map for Monitoring and Assessment 
• Participants' Evaluation of Learning Opportunity 
• Trainers’ Evaluation of Learning Opportunity

Other Tools and Resources:

• Assessing Young Children's Progress Appropriately - NCREL
• The Handbook for SMART School Teams, Anne Conzemius and Jan O'Neill, ISBN 1-879639-85-8
• Making Schools Smarter - A System for Monitoring School and District Progress; Kenneth Leithwood, Robert Aitken, and Doris Jantzi, ISBN 0-7619-7504-5

This page was updated August 9, 2009.