90 likes | 201 Vues
This update outlines significant modifications to the AEPSi online conversion process, particularly regarding OSEP reporting. Recent findings indicate that states utilizing the 7-point online conversion noted an unforeseen proportion of typically developing children rated higher than expected. Expert evaluations revealed discrepancies in scores for children performing below developmental expectations. A collaboration with Brookes has led to the revision and validation of a new process, improving the accuracy of performance assessments. This will affect OSEP reports and may necessitate adjustments to state targets for the upcoming reporting period.
E N D
Update on the Online Conversion Process for AEPSi: Implications for OSEP Reporting
Rationale • States using 7-point online conversions noted a larger than expected proportion of typically developing children. • Expert practitioners (Nebraska) chart review demonstrated that some of the children who were rated a 6 or 7 were performing below what would be considers typical development for their age. Discussions with Brookes to review the analyses for the cut-scores for the 7 point scale.
Conversion Process: Partnership with Brookes and ECO • Reviewed the original conversion process • Developed a set of methods to revise and validate a new process
Details of the Analysis Process • Assessment data from children with and without disabilities were used in the sample (from original research) • Age expected performance was used to benchmark the 7 points along a range of typical development for each age band
Analysis Process: Continued • A sample of children with disabilities performance was compared to the benchmarks • Validation of the new cut scores were based on previous research and federally reported state data
Running OSEP Reports • Current online reports do not yet reflect these revised cut scores but will soon. • Brookes has programming into the online system underway. • Reports based on the revised cut scores may be requested from Brookes and are quickly available Early Childhood Outcomes Center
What changed? • Children need to have higher scores to be rated as performing similar to same age peers
How to explain the changes in APR and to Stakeholders • Stress the importance of having numbers that are a more accurate representation of the status of the children • Changes in the summary statements may not reflect a change in performance but a change in the measurement • This could be a rationale for modifying your state’s targets for 2011-2012.
How does this impact the OSEP Child Outcomes Reports • OSEP reports will have smaller proportions of children in the D and E categories • Size of the effect will depend on the: • % of children that being assessed with AEPSi in your state • Ability level of the children in your population