OKCRC Users' Conference

1. OKCRC Users' Conference "Insider" Information about WorkKeys October 17, 2012

2. Research Committee Membership Kelly Arrington – Department of Career & Technology Education Stephanie Curtis – State Department of Education Susan Kuzmic – Department of Career & Technology Education Mary Bruton – ACT Belinda McCharen – Oklahoma State University Chad Mullen – Oklahoma Employment Security Commission Julie Noble - ACT Rosemary Roelf - ACT Debra Stuart –State Regents for Higher Education Levi Valdois – Department of Career & Technology Education Jeff Wallace – Office of Accountability

3. Research Results • Section I: Comparing Oklahoma’s Examinees to U.S. Examinees • Section II: Certificate Level Achievement and Skill Deficiencies • Section III: KeyTrain for Remediation • Section IV: Combining Career Ready Certificate and OESC Records • Section V: Case Study of Career Development Programs in Oklahoma • Section VI: End-of-Instruction Alternative • Section VII: Employer Return on Value

4. Section I: Comparing Oklahoma’s Examinees to U.S. Examinees Overview • Over 80,000 Oklahomans have taken the three WorkKeys tests (Reading for Information, Applied Math, and Locating Information) at various sites across the state. • Since the program was initiated in 2006, over 66,000 Oklahomans have been issued the Oklahoma Career Ready Certificate based on their scores on the WorkKeys tests. • The following data was developed with the assistance of ACT, CareerTech, the Oklahoma Employment Security Commission, and other partners as identified.

5. Comparing Oklahoma’s Examinees to U.S. Examinees The data indicate that the Oklahoma WorkKeys tested population has achieved scores comparable to the national WorkKeys tested population.

6. Section II: Certificate Level Achievement and Skill Deficiencies Overview • While the fact that Oklahoma has issued over 66,000 CRCs is significant, of even greater significance is an analysis of what is keeping some participants in the testing program from the receipt of a CRC. • The following charts, provided by an ACT analysis of OK WorkKeys scores, identify skill deficiencies that need instructional intervention to assure that all Oklahomans are WorkReady.

7. The Locating Information test is the primary obstacle preventing and examinee from receiving a CRC.

8. Again, the Locating Information test is most likely to be responsible for preventing a CRC holder from obtaining a higher certificate level.

9. Section III: KeyTrain for Remediation • Mary Beth Lykin, Counselor • Claremore High School • Compared WorkKeys scores to students not taking courses

10. Class Outline 9-week Block 85 minute instructional period Elective credit: .5 OCAS Code: 2410 (Business Education; Careers/Exploration) Monday: Reading for Information Tuesday: OKCIS / Graduate to the Perfect Job Wednesday: Applied Math Thursday: Guest Speakers / Field Visits Friday: Locating Information

11. Results

12. KeyTrain for Remediation • Canadian Valley Technology Center 2008 • Faculty and advisory committees developed cut scores for entry into specific programs from WorkKeys level definitions; • An hour a week working with tutors on KeyTrain in the Key Center is mandated for those needing remediation • 96% success rate in achieving appropriate WorkKeys scores after remediation

13. KeyTrain for Remediation • Canadian Valley Technology Center 2008 • Administer WorkKeys to all new students upon enrollment. • Students capable of scoring at or above their programs WorkKeys Goals to “test-out” of time on KeyTrain. • Each Program has its own set of Goals based on Industry Standards. • Student Scores and Program Goals are compared.

14. KeyTrain for Remediation • Canadian Valley Technology Center 2008 • Students scoring AT or ABOVE their programs’ WorkKeys Goal Levels are finished and will receive a CRC. • Students whose pre-test scores do not meet or exceed the program goals are enrolled spend time in the KeyTrain. • Student re-takes WorkKeysin skills that originally tested below level.

15. Section IV: Combining Career Ready Certificate and OESC Records Overview • OK counties containing the most, and least number of CRC recipients were able to be determined by merging OESC records with CRC recipient records. In addition, a variety of other information, as evidenced in the following, was obtained in this fashion. • The use of the term “labor force” includes all employed and all those seeking employment.

16. Oklahoma, Tulsa, Grady, Muskogee, and Mayes counties have the most CRC credentialed individuals. Harper, Harmon, Tillman, Beaver, and Cimarron counties have the fewest. CRC Credentialed Individuals by County January 2006 through September 2011

17. Percent of Labor Force Comprised of CRC Credentialed Individuals as of September 2011 Mayes, Seminole, Atoka, Adair, and Grady counties have the largest percent of CRC credentialed individuals in the labor force. Texas, Kingfisher, Beaver, and Cimarron counties have the smallest percent.

18. Oklahoma’s Work Ready Communities

19. Age Distribution – CRC Credentialed Individuals v. All Workers CRC Credentialed individuals tend to be younger than the general workforce.

20. Top Five Industries of Employment of CRC Credentialed Individuals The largest concentration of CRC credentialed individuals is found in the Accommodation and Food Services sector.

21. Employment Projections and Industry Concentration of CRC Credentialed Individuals

22. Employment Projections and Industry Concentration of CRC Credentialed Individuals

23. Section V: Case Study of Career Development Programs in Oklahoma Conducted by Belinda McCharen, Ed.D. 2010

24. The Study • The study’s purpose was to determine the components of a quality career development program and effective support systems. • The study was also designed to investigate how two sites utilize the CRC as part of a career development program. • The two organizations studied were the Choctaw Nation and the Tri County Technology Center.

25. The Findings • The need for a specialized workforce has increased exponentially over the decades. • Employers need a mechanism to sort out who is capable of work and who is not. • The majority of jobs in the U.S. are middle-skills jobs (more than a high school diploma, less than a four-year degree). • A recent study by BLS indicates that in just three years an estimated 45% of all jobs will be middle-skills jobs while only 25% of the workforce will be qualified to perform them.

26. The Findings • The CRC was perceived as real-world assessment by the career development programs. • Career and technical educators found value in using the CRC systems to improve student achievement and link learning to future study and careers.But, • The attainment of a CRC appears to be of minimal value to the holder in Oklahoma at this time since very few employers are requiring or recognizing the credential. • Is this true, though?

27. Section VI: End-of Instruction (EOI) • Survey administered by State Department of Education to all high schools. • Total of 92 responses representing 20% of the high schools.  • The largest graduating class represented was 540 and the smallest was 6.  • 3.3% of the graduates from these high schools used WorkKeys as an alternate EOI. 

28. Section VII: Employer Return on Value • A national survey of ACT Work Readiness System users was conducted for businesses that use one or more of the components of the system which include: the National Career Readiness Certificate, WorkKeys® Cognitive and Soft Skills Assessments, Job Profiling, and KeyTrain® curriculum. • Reported results are from a 2011 stratified sample of business users (n = 946) with a response rate of 21%.

29. Section VII: Employer Return on Value • Nationally, the majority of businesses who are using the Work Readiness System (82%) are doing so as part of an organizational selection process for hiring. • Most businesses using the Work Readiness System (88%) agree that it improves hiring outcomes. • The vast majority of businesses using the Work Readiness System (86%) confirm that its benefits justify its cost. • Specific benefits reported most frequently include a reduction in turnover in their organization (67%) and improvement in their employees’ on-the‐job productivity (63%).

30. Section VII: Employer Return on Value • Most businesses using the Work Readiness System (78%) agree that it provides individuals with a useful credential after training and provides evidence of achievement beyond a diploma or degree (76%). • Many businesses believe the system’s benefits extend beyond their specific organizations. Most of them (76%) agree that the Work Readiness System provides evidence of a ready‐to‐work or skilled workforce for regions and states. • Most businesses (72%) agree or strongly agree that the Work Readiness System helps differentiate their organization from others. • Specifically, a majority (82%) of businesses using the NCRC report that it is important for meeting their organizational goals.

31. QuestionsCommentsSuggestions for Future Research

32. For more information • Debra L. Stuart, Ph.D. • Vice Chancellor for Educational Partnerships • Oklahoma State Regents for Higher Education • dstuart@osrhe.edu • 405-225-9168 • Visit: • ACT’s CRC web site: http://www.act.org/certificate/ • Oklahoma CareerTech’s CRC web site:http://www.okworkkeys.org