Background

1. The Ins and Outs of Minnesota’s Multiple Measurements Rating (MMR) March 21, 2013Stephanie GraffLeigh Schleicher “Leading for educational excellence and equity. Every day for every one.”

2. Background The Elementary and Secondary Education Act (ESEA) was reauthorized in 2001 and then became known as No Child Left Behind (NCLB). ESEA reauthorization in the near future remains unlikely and the goal of 100% proficiency in 2014 is coming quickly. The U.S. Department of Education (USED) recognized that the state accountability and reform landscape had significantly changed since No Child Left Behind was passed. On September 23, 2011, President Obama announced that the USED would be formally inviting states to apply for "ESEA flexibility" (waivers) in exchange for state leadership in meeting four key principles.

3. ESEA flexibility is not a pass on accountability Schools continue to be required to raise the bar for performance for all students and be held accountable for the academic growth and gains of all students The framework of next-generation accountability builds on and moves beyond NCLB Adequate Yearly Progress requirements

4. What did we get in the waiver? New AYP targets (AMOs) MMR and Focus rating system Eliminate AYP consequences Eliminate AYP financial mandates Enhanced statewide system of support to implement school improvement planning (Centers of Excellence) Renewed focus and support for excellence for all students

5. What stayed the same? Rigorous academic standards Valid and reliable academic achievement assessments Public reporting Calculation of AYP Disaggregated data Federal funding formulas and programs Highly Qualified Teacher requirement

6. Our new accountability system:What is it all about? Focused on closing the achievement gap and promoting high growth for all students Built around multiple measurements Creating incentives for high performance Directly addressing the growth of subgroups for the first time Providing support for locally-developed school improvement plans

7. File of MMR Results for All Schools education.state.mn.us

8. Multiple Measurement Files – Results Page Focus Rating. “How are we doing on the Achievement Gap?” Final Multiple Measurement Rating Was the school given a designation? education.state.mn.us

9. School MMR Results education.state.mn.us

12. Multiple Measurements Rating • ALL schools are given an annual Multiple Measurements Rating (MMR) consisting of four domains: • Proficiency • Student Growth • Achievement Gap Reduction • Graduation Rate

13. Total MMR Each domain is worth 25 points The MMR is generated by dividing the total number of points earned by the total number of points possible For most elementary and middle schools, 75 points possible For most high schools, 100 points possible The MMR is a 0-100 percentage for all schools

14. Proficiency Domain • Proficiency domain uses AYP index model • Look at each subgroup in a school and determine whether they have adequate proficiency rates and are meeting established targets • Schools earn points based on a weighted percentage of subgroups meeting AYP proficiency targets • Weighting is based on the size of subgroups • Subgroups can’t meet AYP proficiency targets through Safe Harbor

15. Proficiency Example • Apple Secondary School Example: • Weighted percentage of subgroups reaching AYP target = 74.8% • Based on all other secondary schools in the state, this puts the school in the 23rd percentile • .23 x 25 points possible = 5.75 points • 5.75 points earned in Proficiency domain

16. Growth Domain • Growth measures ability of schools to get students to exceed predicted growth • Student growth scores are based on: • The students’ last assessment result • Being above or below prediction • School growth score is average of student growth scores • Positive growth score indicates success

17. Growth Example • Apple Secondary School Example: • Average growth score = .3302 • Based on all other secondary schools in the state, this puts the school in the 80th percentile • .80 x 25 points possible = 20 points • 20 points earned in Growth domain

18. Achievement Gap Reduction Domain • Measures the ability of schools to get higher levels of growth from lower-performing subgroups than statewide average growth for higher-performing subgroups • School Am. Indian growth compared to statewide White growth • School Asian growth compared to statewide White growth • School Hispanic growth compared to statewide White growth • School Black growth compared to statewide White growth • School LEP growth compared to statewide non-LEP growth • School Special Ed growth compared to statewide non-Special Ed growth • School FRP growth compared to statewide non-FRP growth • Negative score indicates success

19. Achievement Gap Reduction Example • Apple Secondary School Example: • Achievement Gap Reduction Score = -0.1181 • Based on all other secondary schools in the state, this puts the school in the 91st percentile • .91 x 25 points possible = 22.75 points • 22.75 points earned in Achievement Gap Reduction domain

20. Graduation Rate Domain • Graduation Rate domain uses AYP index model • Look at each subgroup in a school and determine whether they have adequate graduation rates or are showing adequate improvement from year to year • Schools earns points based on the weighted percentage of subgroups that meet AYP graduation rate target or demonstrate improvement from the prior year • Weighting is based on the size of subgroups • AYP grad rate target is 90% for each subgroup

21. Graduation Rate Example • Apple Secondary School Example: • Weighted percentage of subgroups reaching AYP target = 88% • Based on all other secondary schools in the state, this puts the school in the 21st percentile • .21 x 25 points possible = 5.25 points • 5.25 points earned in Graduation domain

22. Total MMR Example • The MMR is generated by dividing the total number of points earned by the total number of points possible. • Proficiency: 5.75 points • Growth: 20 points • Achievement Gap Reduction: 22.75 points • Graduation: 5.25 points • Total points earned divided by points possible: 53.75/100 • Apple Secondary School MMR = 53.75%

23. Recognition, Accountability and Support • A school must be served with Title I funds to receive one of the five following designations: • Reward School: Top 15% on MMR • Annual designation • Celebration Eligible School: Next 25% below Reward on MMR • Annual designation • Continuous Improvement School: Lowest 25% on MMR (not already Priority or Focus) • Annual designation • Focus School: Bottom 10% on FR • Designated every three years • Priority School: Bottom 5% on MMR • Designated every three years

24. 2012 School Designations • MMR used to assign Title schools to four categories: • 128 Reward Schools • 211 Celebration Eligible Schools • 86 Continuous Improvement Schools • 42 Priority Schools • Focus Rating (FR) used to assign Title I schools to one category: • 85 Focus Schools

25. ExitCriteria for Priority and Focus Schools • Priority Schools: • Two consecutive years out of the bottom 25 percent on the MMR starting in 2012 • Immediate exit if a Reward school any year starting in 2012 • Focus Schools: Two consecutive years out of the bottom 25 percent on the FR starting in 2012 • SIG Schools: Opportunity to exit at end of grant (2013) if out of the bottom 25 percent on the MMR that year

26. 2012 MMR Cut Scores

27. What’s Next? • Fall 2013: • 2013 MMR and FR released for all Minnesota schools • New Continuous Improvement, Celebration Eligible and Reward schools announced • Some Priority and Focus schools may exit status • 2013-2014 School Year: • Centers of Excellence continue to support Priority and Focus schools • Celebration school application process • MDE audits 10% of Continuous Improvement schools to ensure implementation of improvement plans • Ongoing recognition of Reward and Celebration schools

28. Questions? education.state.mn.us

29. Contact Stephanie Graff MDE, Division of School Support (651) 582-8242 stephanie.graff@state.mn.us Leigh Schleicher MDE, Division of Student Support (651) 582 – 8326 leigh.schleicher@state.mn.us