Program Quality Assessments

1. Program Quality Assessments A New Adventure Begins for Program Quality! Presented by: Anne Reeder, Program Quality Assessment Coordinator DESE Grantee Workshop September 19, 2013

2. Today we will cover… • What are the PQAs? • Why are we doing the PQAs? • How will this actually work? (Who, when, where…)

3. What are the PQAs? • Weikart Center for Youth Program Quality • School Age Program Quality Assessment (SAPQA) • Youth Program Quality Assessment (YPQA) • STEM Add-On to YPQA

4. What are the PQAs? • A validated instrument designed to assess the quality of youth programs and identify staff training needs, • A set of items that measures youth access to key development experiences, • A tool which produces scores that can be used for comparison and assessment of progress over time.

5. Selection of the PQA • State-of-the-art instrument • Good evidence for reliability and validity • Measures what we know is our unique contribution to youth success • Many other states are also using the PQAs • Ability to compare to other programs • Ready-made package of support

6. Why are we adding the PQAs? • 21st CCLC funding is a hot topic of discussion in DC • DESE needs consistent data to support Missouri’s use of funds • Current program evaluations do not provide a comprehensive, across-the-board picture • Several other states have adopted the PQAs for consistent measures

7. l YPQI Quality Improvement Systems PQA Downloads: 533 Youth PQA 457 School-Age PQA National Organizations: Individual Box Sets= 20 sites

8. Weikart Center Reach in 2012-2013 Policy Setting 85 Networks/Systems Organization Setting >3250Sites >21,125 Staff Estimate based on mean of 6.5 staff per site in YPQI Study Sample Point of Service Setting >276,250 Child & Youth Estimate based on mean daily attendance of 85 youth per day in YPQI Study Sample

9. l 21st Century Community Learning Centers Aqua– Statewide quality improvement system Blue- City or School District quality improvement system Yellow- Youth PQA used as part of statewide evaluation Purple- Statewide quality improvement system and statewide evaluation

10. PQA Content

11. What will the data be used for? • Another point of data for your program’s External Evaluation • A point of data for you and your coach (ARE) to include in your Action Plans • By using a consistentvalid tool, DESE will have better data to submit to the USDE. • Better Data = More Money for programs

12. PQA

13. Process • Who are the assessors? • 4-H Youth Development Specialists or MU HDFS Specialists • Intense multi-day inter-rater reliability training • Scheduling • Anne Reeder will handle all aspects of scheduling • You will need to provide in advance a copy of the site’s schedule for the day of the observation • Observation • No surprises • No more than 3 hours • Scores Reporter

14. Sample PQA Report

15. PQA Summary Report

16. PAQ Summary Report

17. PQA Summary Report The online Reporter has determined the following suggestions for professional development based on the three lowest scoring items in this report. The Scores Reporter makes suggestions automatically and based solely on scores. These suggestions are not meant to replace the thoughtful conversations of staff members during an improvement planning process, but are provided for consideration and to enhance discussion. Building Community Creating a safe space in which you feel a sense of belonging is beneficial for their growth and learning (National Research Council and the Institute of Medicine, 2002). When youth get to know each other, don’t leave other youth out, think of the program as theirs, and get recognized for their accomplishments, they build relationships with peers and adults. (National Research council and the Institute of Medicine (2002). Community Programs to Promote Youth Development Washington, DC; National Academy Press. 96-99) Reframing Conflict An approach in which adults support youth in addressing their conflicts and problems helps build a healthy, cohesive group and can produce growth and learning for young people. The HighScope youth-centered approach involves a nonthreatening matter-of-fact attitude and helps youth have a voice in determining both the cause and the solution to the conflict. It is a problem-solving approach that seeks to turn conflicts into learning opportunities.

18. PQA Sample Report Structure and Clear Limits Structure and clear limits can provide a strong foundation to a youth program. An appropriate structure with routines, activities, and rituals sets the stage. Clear limits establish what’s okay and not okay and can ensure a safe program climate. When done well, structure and clear limits can provide the space kids need to explore and express themselves, a feeling of fairness, and the predictability that young people learn to count on to meet their needs (National Research Council and Institute of Medicine, 2002). (National Research Council and the Institute of Medicine. (2002). Community Programs to Promote Youth Development. Washington, DC: National Academy Press. 91-94) Youth Voice Providing young people with chances to make decisions about their activities and how they carry them out can improve motivation and buy-in, and more importantly, offering choices in the solace of a youth program space gives youth a chance to practice for the bigger choices they’ll make outside of the program.

19. Coaching - Methods Trainings Questions Thank you and enjoy the rest of your conference!