Participation of and Accommodations for Students with Disabilities and English Language Learners NAEP State Analysis Pro

1. Participation of and Accommodations for Students with Disabilities and English Language Learners NAEP State Analysis Project Jenifer Harr María Pérez CCSSO National Conference on Large-Scale Assessment June 2006

2. Background of the Study • Participation of and accommodations for students with disabilities (SDs) and English learners (ELs) have been a growing challenge over the past decade. • This study explores the relationships between changes in participation and accommodations and assessment results (e.g., state and NAEP assessments). • Data Sources • CCSSO SSAP surveys from 1997-98 and 2001-02 • NAEP SD/LEP Questionnaire from 1998 and 2002 • NAEP test score results

3. Research Questions How are changes in state assessment policies on the participation and accommodation of SDs and ELs related to changes in participation and accommodation rates on state assessments? How are changes in NAEP participation and accommodation rates related to changes in state assessment participation and accommodation rates for SD and ELs? How are differences between NAEP and state achievement trends related to changes in participation and accommodation rates?

4. State Policy State Practice State identification policy State identification rate State participation rate State participation policy State accommodation policy State accommodation rate NAEP Practice NAEP participation rate NAEP accommodation rate NAEP and State Achievement Trends Difference between state and NAEP achievement gain NAEP achievement gain Policies and Practice for Assessing SDs and ELs

5. State Policy State Practice State identification policy State identification rate State participation rate State participation policy State accommodation policy State accommodation rate NAEP Practice NAEP participation rate NAEP accommodation rate NAEP and State Achievement Trends Difference between state and NAEP achievement gain NAEP achievement gain Research Question 1: How are changes in state policies related to changes in participation and accommodation rates on state assessments?

6. Research Question 1 • States grouped by whether their accommodation policies changed between 1997-98 and 2001-02 • Group YY – States that had policy both years • Group NY – States that did not have policy in 1997-98 and did in 2001-02 • Group YN – States that had policy in 1997-98 and did not in 2001-02 • Group NN – States that did not have policy either year

7. Research Question 1 • State Accommodation Policies and Participation Rates • SDs: The introduction of two of 30+ accommodation policies for SDs was related to greater increase in participation rates (extended testing time and use of scribe) (Comparing NY to YY) • ELs: The introduction of two of 17+ accommodation policies for ELs was related to greater increase in participation rates (explanation of directions and translations of directions) (Comparing NY to YY)

8. Research Question 1 • State Accommodation Policies and Accommodation Rates • SDs: The introduction of accommodation policies for reading problems aloud and reading directions aloud appear to be related to higher increases in accommodation rates for students in grade 4 (Comparing NY to YY) • ELs: The introduction of an accommodation policy for extended testingtime appear to be related to higher increases in accommodation rates for students in grade 4 (Comparing NY to NN)

9. State Policy State Practice State identification policy State identification rate State participation rate State participation policy State accommodation policy State accommodation rate NAEP Practice NAEP participation rate NAEP accommodation rate NAEP and State Achievement Trends Difference between state and NAEP achievement gain NAEP achievement gain Research Question 2: How are changes in NAEP participation and accommodation rates related to changes in state assessment participation and accommodation rates?

10. Research Question 2 • State and NAEP Assessment Participation Rates • SDs: The average change in NAEP participation rates in grade 8 is significantly correlated with changes in state participation rates. In grade 4, it is not significant. • ELs: The average change in NAEP participation rates is not significantly correlated with changes in state participation rates in either grade.

11. Research Question 2 • State and NAEP Accommodation Rates for SDs • Changes in overall state assessment accommodation rates are significantly correlated with changes in overall NAEP accommodation rates in grades 4 and 8. • Changes in state accommodation rates for the following state accommodations are significantly correlated to changes in overall NAEP accommodation rates: • Oral reading of directions, testing in small groups, extended testing time for grades 4 and 8 • Oral reading of questions, interpretation of directions, and more breaks for grade 4 only

12. State Policy State Practice State identification policy State identification rate State participation rate State participation policy State accommodation policy State accommodation rate NAEP Practice NAEP participation rate NAEP accommodation rate NAEP and State Achievement Trends Difference between state and NAEP achievement gain NAEP achievement gain Research Question 3: How are differences in achievement trends related to changes in participation and accommodation rates?

13. Research Question 3 • Comparing State and NAEP Assessment Results in Grade 4 to Change in Participation Rates of SDs on State Assessments

14. State Policy State Practice State identification policy State identification rate State participation rate State participation policy State accommodation policy State accommodation rate NAEP Practice NAEP participation rate NAEP accommodation rate NAEP and State Achievement Trends Difference between state and NAEP achievement gain NAEP achievement gain Summary of Findings:Policies and practice for assessing students with disabilities (-) ** ** Grade 8

15. Future Directions? • Lack of additional years or alignment of data limit analyses • State policy data source – the SSAP survey – has been discontinued • Other state policy data sources include the NCEO (SD) and CEEE (EL)