National Accountability Initiatives and Their Impact on NCCCS

1. National Accountability Initiatives and Their Impact on NCCCS J. Keith Brown CCPRO Fall Conference October 18, 2010

2. Purpose • Historical perspective • Background on NCCCS accountability efforts • Use of “intermediate benchmarks” in accountability • Major national initiatives • Next steps for NCCCS

3. Historical Context: National • Initially colleges judged on inputs • 1980’s: a shift to emphasizing outputs • 1990’s: performance funding • 2000’s: longitudinal data and focus on subgroups

4. Historical Context: NCCCS • 1989: Critical Success Factors mandated • 1991: College level data included in CSF • 1993: GPAC report mandating performance standards; Annual Program Audits initiated • 1998: New performance measures/standards and performance funding mandated • 2007: Performance measures/standards and performance funding revised

5. Drivers of Change • Consensus that some college was necessary for access to good jobs • Loss of faith in the superiority of US higher education and concern about the economy • Rising costs of college and focus on productivity • Longitudinal data that showed low completion rates and persistent inequality

6. Conceptual Shifts • Emphasis on longitudinal data • Use of intermediate outcome measures • Use of outcome measurements for diagnosis rather than accountability

7. Intermediate Success Indicators • Focus on indicators that contribute to student success • Achieving the Dream Cross State Data Team led much of the early work in this area • Washington State performance funding first to incorporate momentum points • Drives policy development • Creates more robust accountability system

8. Examples • Transition from basic skills to curriculum • Developmental Ed success rates • Passing gatekeeper courses • Retention • Credit hour accumulation • Resource: Taking the Next Step: The Promise of Intermediate Measures for Meeting Postsecondary Completion Goals(see Jobs for the Future website)

9. National Initiatives • Committee on Measures of Student Success • Voluntary Framework of Accountability (VFA) • Complete College America/Complete to Compete • Achieving the Dream Cross State Data Work Group • Gates Foundation Common Outcome Measures

10. Committee on Measures of Student Success (CMSS) • Authorized by Higher Education Opportunity Act • Response to criticisms of Student Right to Know graduation rate • Recommend alternative success measures for community colleges • First meeting on October 19, 2010; work to be completed in 18 months. • Potential changes to IPEDS collection

11. Voluntary Framework of Accountability • Being developed by AACC • Purpose is the development of a set of measures that are appropriaed for community colleges • 3 major working groups: • Student Persistence and Outcomes • Workforce, Economic and Community Development • Student Learning Outcomes

12. Voluntary Framework of Accountability • Draft of technical manual defining measures under review • RFP for college participation released

13. Complete College America/Complete to Compete • 23 states joined Complete College America initiative • National Governors’ Association (NGA) has endorsed CCA • Applies to both 4-year and 2-year institutions • Focuses on increasing the number of individuals with postsecondary credentials

14. Achieving the Dream • Emphasis on improving the success rates of low-income, minority students in 2-year colleges • Focus on developmental education • Established a Cross State Data Work Group that has been testing success measures

15. Gates Foundation Common Outcomes Measures • Initiative being led by Peter Ewell at the National Center for Higher Education Management Systems (NCHEMS) • Measures have not yet been released • Once adopted reporting on the measures will be required of any institution receiving Gates funding

16. Analysis of Initiatives: Commonalities • Consistency of measures across initiatives • Longitudinal data • Incorporates both intermediate benchmarks and outcome measures • Focus is on student success and increased graduation rates

17. Analysis of Initiatives: Differences • Cohort definitions • Length of time for success

18. Overview of Measures • College completion metrics: • Graduation rates • Transfer rates • Number and percent of degrees and certificates awarded • Time to degree • Credits to degree

19. Overview of Measures • Intermediate metrics • Enrollment in developmental education (enrollment vs referred) • Successful completion of developmental education • Enrollment in gate-keeper English and math • Success completion of gate-keeper courses • Credit accumulation • Fall-to-fall retention • Course completion as a percent of courses attempted (Ohio funding on course completions)

20. Overview of Measures • Workforce metrics: • Licensure/certification exam passing rates • Employment • Wage gains • Retention in employment • Noncredit program completion • Number of industry-recognized credentials

21. Overview of Measures • Other metrics: • Success rates of basic skills students • Transition rates from basic skills to curriculum or non-credit workforce programs • Measures of economic and community impact being developed

22. Overview of Measures • Student Learning Outcomes (VFA): • Content/career specific skills and knowledge • Global understanding and citizenship • Analytical reasoning and critical thinking • Teamwork and collaborative skills • Communication • Quantitative literacy • Information literacy • Innovative and creative thinking

23. NCCCS Initiatives • Major role in Achieving the Dream and Developmental Education Initiative • Two committees looking at performance measures and performance standards • Representation from CCPRO • Work to be completed and adopted in time for 2013 legislative session

24. Questions/Comments?