70 likes | 192 Vues
This document, presented at the Illinois Evaluation Tools SIG/SPDG Regional Meeting, outlines the Illinois Evaluation Framework aimed at assessing the implementation fidelity and sustainability of evidence-based practices in education. Led by Kathryn Cox from the Illinois State Board of Education, the framework evaluates whether training leads to effective practice implementation and its impact on student outcomes. Key tools include the Self-Assessment of Problem Solving Implementation (SAPSI) and Fidelity of Implementation Checklist, facilitating self-reported and external evaluations of educational practices in schools.
E N D
Illinois Evaluation Tools SIG/SPDG Regional Meeting Kansas City, MO October 5 & 6, 2009 Kathryn Cox Illinois State Board of Education kcox@isbe.net 217-782-5589
Illinois Evaluation Framework If people are trained, do they implement? If people implement, do they do so with fidelity? If people implement with fidelity, do they sustain the practice(s) over time? If people sustain the practice(s), what is the impact on student outcomes (school, group, individual)?
IL ASPIRE Evaluation of Implementation, Fidelity & Sustaining Practices Self-Assessment of Problem Solving Implementation (SAPSI) Assesses the degree of implementation of the problem solving process at the building level as self-reported by the schools Increases in and maintaining implementation levels over time can also provide a measure of fidelity and degree to which practices are being sustained Fidelity of Implementation Checklist Allows for external evaluation by ASPIRE regional staff of implementation in the school sites
Illinois SAPSI http://www.luc.edu/cseit/pdfs/Aspire_Documents/ASPIRE_SAPSIv2.4_200.doc Areas of Assessment Comprehensive Commitment and Support Three-Tiered System Establish and Maintain Team Process Self-Assessment Implementing Evidenced-Based Practice Monitoring and Action Planning Rating Scale Maintaining: All components of definition implemented consistently for 2 or more school years Achieved: All components of definition implemented consistently for at least one school year In Progress: At least one of the components of definition implemented consistently for at least 3 months Not Started: No components of definition have been implemented
IL ASPIRE Fidelity of Implementation Checklist http://www.luc.edu/cseit/pdfs/Aspire_Documents/Aspire_FidelityToolv4.6_20090805.pdf Designed to monitor the adherence of implementation of problem solving activities and products at the school level Involves a review of products: School Improvement Plan/Action Plan Instructional Planning Forms Screening data (CBM, SWIS) Evidence of progress monitoring (Tier 2, Tier 3 Graphs; Benchmark Data for Tier 1) Training (Training Logs or Sign in Sheets)