Accountability in P-16 Systems & Database Issues: Florida Perspective August 13, 2004

1. PK20 Accountability in P-16 Systems & Database Issues: Florida Perspective August 13, 2004 Jay Pfeiffer, Director K20 Education Information and Accountability Division of Accountability Research and Measurement Florida Department of Education www.fldoe.org www.k20accountability.org

2. K-20 Education Accountability: Lessons Learned in the Florida Experience • Establish guiding principles and stick to them • “Trapezoid” of Accountability • Simple/actionable • Focus on outputs • Incorporate existing requirements & capabilities where possible • Grapple with data issues • Timing • Definitions • Compatibility • Numerators and denominators • Set standards, performance expectations based on data • Inform local entities regarding measures and expectations • Deal with consequences last, phase in as appropriate • Legislative authority with key time frames. • Establish a K-20 education performance accountability task force broadly representatives of the affected education entities. • Do not impose an agenda, work through sector-level consensus. • Inform the process: present data that defines the K-20 delivery system and student flows. • Establish a few high level system goals. .

3. K-20 Governance Organization: Alignment of Data Systems Office of K-20 Education Information & Accountability Additional role: Department-wide conduit for LMS, LED, Census, BEBR publications Source Information Systems Integrating Systems Community College & Technical Center K-20 Education Data Warehouse Public Schools University FETPIP K-12 Adult Education Career/Technical Associate Degree Baccalaureate Masters Ph.D./Professional Source Systems Employment Assessment Financial Aid Teacher Certification Facilities Employment Earnings Postsecondary Ed. Welfare Incarceration Licensure Annual Administration & Accountability Continuous/Longitudinal

4. Performance Accountability System Overview – State Law • The State Board of Education must: • Maintain an accountability system that measures student progress toward the state’s education goals: • Highest Student Achievement • Seamless Articulation and Maximum Access • Skilled Workforce and Economic Development • Quality Efficient Services • Adopt guiding principles for establishing state and sector specific standards and measures • Recommend to the Legislature system-wide performance standards

5. K-20 Education Performance Accountability Levels K-20 Goals Highest Student Achievement Maximum Access Seamless Articulation Skilled Workforce Quality, Efficient Services System Measures Core Sector-Specific Institutional Measures

6. K-20 Education Performance Accountability Levels K-20 Goals Highest Student Achievement Maximum Access Seamless Articulation Skilled Workforce Quality, Efficient Services Strategic/Unique Mission Sector Measures System Measures Sector “Core” Measures Core Sector-Specific Institutional Measures Local leading indicators, process indicators, unique local goals

7. Simplicity and Focus • Actionable • Good data • Comparisons against one’s own past performance • Balance Quantity with Quality Cardinal Rules

8. Common Measures -SBE Approved Measures Student Achievement • Student Learning Gains at key educational milestones Access • Number and percent of students from underservedpopulations who enroll in and complete education credentials Progression and Readiness • K20 Graduation rates Employment & Earnings • Meet targeted workforce needs. Quality/Efficient Services • Return on Investment

9. Setting Performance Improvement Targets Calculation Years of Good Data X X • Principles: • Throw out high, low, anomalies (if there are sufficient years of data) • Consider volatility, vulnerability • Look for “noise”

10. Performance Improvement Goal Setting MidPoint 2 3 4 1 Lower performers Higher performers Example: Distribution of Performances Divided into quartiles

11. K-20 Education Performance Accountability: Performance Based Funding: State Law By December 1, 2004, the Department of Education must make recommendations to the Legislature regarding performance-based funding that applies accountability standards for public education at every level, kindergarten through graduate school. The State Board of Education’s proposal to the Legislature must provide that at least 10 percent of the state funds appropriated for the k-20 education system are conditional upon meeting or exceeding established performance standards.

12. Three Ways to Approach Performance Funding • Total Appropriation = workload calculation + performance calculation • Two Appropriations: a workload appropriation and a separate performance appropriation • High Stakes Appropriation: Total appropriated amount + or – performance earnings

13. Performance Calculation - Basics Performance Calculation = Evidence of Evidence of Evidence of Evidence of Evidence of + + + + Student Access Progression Employment Return on Learning /Readiness & Earnings Investment Evidence of + Performance for Unique Sector Measures

14. Performance Calculation – Consider Weights? Performance Calculation = Evidence of Evidence of Evidence of Evidence of Evidence of + + + + Student Access 2X Progression Employment Return on Learning 2X /Readiness 1X & Earnings 1X Investment 0X Evidence of + Performance for Unique Sector Measures 1X

15. Meets Performance Expectations? Phase 1 2 3 YES YES YES Evaluate Expectations Evaluate Expectations Evaluate Expectations NO NO NO Develop SBE Plan for Improvement Assistance Provided Technical Assistance By Sectors Consequences Begin

16. Exemplary Performance % of Students Making Adequate Progress Improvement Targets Standards Completion Points Freshman Sophomore CC Sophomore Junior CC Freshman Sophomore SUS Sophomore Junior SUS BA/BS SUS 3 5 8 12 Milestones Exceeds Performance Standards Marginal Performance Below Performance Standards

17. Integrated Education Performance Management System – The IEPMS • DOE issued “ITN” at the end of February, 2004 • ITN outlined five components • Web-based Student Performance Information system • Interface with district tools and data resources • Web-based training for teachers and managers • State-level performance information integration tools • Training for effective deployment and management