School Report Cards: Considerations and State Examples

1. School Report Cards: Considerations and State Examples Va Board of Education Committee on School and Division Accountability Feb. 25 2015 Laurie McCullough Executive Director, VaASCD Chair, Accountability Subcommittee of the SOL Innovation Committee

2. Sources: • Rating States, Grading Schools, Aug. 2014 Report of the Education Commission of the States • Key Elements for Accountability, 2010 Report from CCSSO • ASCD Policy Positions • Innovation Committee discussions • And MANY THANKS to Melany Stowe! • Report card considerations: • Purpose • Content • Design • 2. Features and examples of report cards

3. Purpose Student measures: To assess progress toward important learning goals. Educator measures: To target professional development needs. School measures: To support improvement and inform the public.

4. Content: HB 1672 / SB 727 No later than July 1, 2016, the Board of Education, in consultation with the Standards of Learning Innovation Committee, shall redesign the School Performance Report Card so that it is more effective in communicating to parents and the public the status and achievements of the public schools and local school divisions in the Commonwealth. The Board, in redesigning the School Performance Report Card, may consider (i) the standards of accreditation, (ii) state and federal accountability requirements, (iii) state-mandated assessments, (iv) any alternative assessments developed or approved for use by the relevant local school board, (v) student growth indicators, (vi) student mobility, (vii) the experience and qualifications of school staff, (viii) total cost and funding per pupil, (ix) school safety, and (x) any other factors that the Board deems necessary to produce a full and accurate statement of performance for each public elementary and secondary school and local school division in the Commonwealth.

5. Content: Two questions • What should we measure and how? • Ex: College and Career Readiness • state test scores? • nationally-normed test scores? • % of students who are test takers? • 9th graders on track for graduation? • graduation rate? • Ex: School Climate • student surveys? • staff surveys? • discipline incidents? Choose valid measures and ensure reliable results

6. Content: Two questions2. What gets measured vs. what gets reported? Report Card Data Collection “Counts” for accreditation: Test data Grad Rates Etc. Teacher Licensure Pupil-Teacher Ratio Salary Information Test data in “off”years Strengths and OFIs Family Engagement

7. 9 Growth of highest achievers 9th Graders on track to graduate School climate Class size What Could Be Reported? Parent & community involvement Student survey results % taking higher level coursework Socioeconomic & demographic data Counseling, support services Health and wellness programs Expenditures Attendance rate Revenues

8. Design: Interpreting and Communicating Things like • A rating or estimate of school quality. • Comparisons to……..state averages or composites?...... peer groups? • Format for ease of use. • Annual static snapshot or dynamic interface?

9. Design: Interpreting and Communicating

10. Design: Interpreting and Communicating Online Accessibility Tabs (Dashboard) Ability to Print Ability to Drill Down Emphasis of Ranking (if any) Explanations Peer Rankings within State Graphics

11. Currently 30 Different Rating Systems ECS Database & Online Research A-F Stars (3) Colors (1) Letters (13) ? # Number Variations (9) Descriptors (18) None (5)

12. Sample Descriptors • Excelling, Progressing, Transitioning, Review, Focus, and Turnaround (Connecticut) • Recognition, Continuous Improvement, Focus, Priority, Superintendent’s Zone (Hawaii) • Exemplary, Exceeds Standard, Meets Standard, Approaches Standard, Academic Warning (Kansas) • Distinguished, Proficient, Needs Improvement, Progressing School (Kentucky) • Reward, Celebration Eligible, Continuous Improvement, Focus, Priority (Minnesota) • Accredited with Distinction, Accredited Provisionally, Accredited, Unaccredited (Missouri)

13. Sample Descriptors • Fully Accredited, Provisionally Accredited-Graduation Rate, Accredited with Warning, Accreditation Denied, Conditionally Accredited (Virginia) • • Exemplary, Very Good, Good, Fair, Struggling (Washington) • • Exceeding Expectations, Meeting Expectations, Partially Meeting Expectations, Not Meeting Expectations (Wyoming) • •Accredited with Distinction, Accredited Provisionally, Accredited, Unaccredited (Missouri) • Exceeds Standards, Meets Standards, Below Standards (Nebraska) • Reward School, Good Standing, Local Assistance Plan, Focus, Priority • (New York)

14. Innovation Committee, Interim Recommendation Recommend that the Board of Education and the General Assembly revise the Standards of Accreditation to add accreditation ratings which 1) recognize the progress of schools that do not meet the accreditation benchmarks but have significantly improved their pass rates, and 2) recognize schools that did not meet accreditation benchmarks but have demonstrated significant growth for the majority of students.

15. Education Commission of the States (ECS) RESEARCHERS Are the report cards easy to find? PARENTS Are they easy to understand? EXPERTS What indicators are essential for measuring performance? August 2014 Report: Rating States, Grading Schools

16. Top Three According to Researchers According to ECS researchers, based upon the following criteria: findable, readable, understandable, and graphics. Arizona Illinois Ohio • Easy to understand • Did not like printable (pdf) version • Good use of graphics • Links to data drill down • Inclusion of survey results • Good use of graphics • Data points are explained well • Use of tabs • Noted “data coming” 8 Report Cards Ranked Above Average in all 4 Categories: Arizona, Delaware, Illinois, Kentucky, Louisiana, Massachusetts, Maine, and Ohio

17. Top Two According to Parents According to ECS selected parents, based upon the following criteria: easy to read, useful, provides sufficient data. Parents also ranked the following report cards above average: Delaware, Arkansas, Ohio, and Wisconsin. District of Columbia Illinois • Ability to explore data • Fast facts • Clear graphics Note: There were inconsistencies: one parent ranked a report card excellent (5) and another ranked the same report card unacceptable (1).

18. 5 Essential Indicators from Experts 2 According to ECS Report 1. Student Achievement 2. Student Academic Growth 23 states currently include these 5 indicators, including Virginia. 3. Achievement Gap Closure 4. Graduation Rates 5. Postsecondary and Career Readiness

19. Louisiana: Interesting Features • A snapshot, but shows improvement • One static page, with access to backup data • Jena High School in LaSalle Parish https://www.louisianabelieves.com/data/reportcards/2014/

20. Ohio: Interesting Features • A-F system (2015) • Achievement vs. Progress • Early Literacy • Madison South Elementary Madison South Elementary

21. Illinois: Interesting Features • No rating system, yet highly ranked by parents in ECS study. • User survey • 1 ½ minute video • Mather High School ILLINOIS REPORT CARD

22. http://www.ecs.org/html/educationissues/accountability/stacc_intro.asphttp://www.ecs.org/html/educationissues/accountability/stacc_intro.asp