Benchmarks of Quality (BOQ) Illinois PBIS

1. Benchmarks of Quality (BOQ)Illinois PBIS Illinois PBIS Network

2. Objectives for Online Training • Introduce the Benchmarks of Quality (BoQ) • Understand how to complete the BoQ • Understand how to submit the BoQ • Understand how to use results of the BoQ

3. NeedsTo Be Able To… • Assess annually a team’s universal implementation • Provide feedback to team • Clarify outcomes as related to implementation and action plan around these outcomes • Distinguish model schools

4. Big Ideas Around the BoQ • As an internal and/or external coach, ask yourself: • Am I an active member of the team and feel confident in my ability to lead the team through the BoQ process? (Usually referring to the internal coach, but could be the ext coach in some circumstances) • Remember: • The final score should reflect the whole team’s input

5. Revisions in the BoQ for the 2010-2011SY • Eliminated 7 items, including the entire crisis section (questions 46, 47, 48) and questions 1, 13, 17, 29 • Added 7 classroom items • Reworded several item descriptors and scoring rubric to enhance clarity • Please note: • The total possible point total on the BoQ is now 107 (previous version had a total of 100 points)

6. Benchmarks of Quality • Identified items aligned with SWPBS training process • 53 items (critical elements) addressing areas of: • Faculty commitment • Effective procedures for dealing with discipline • Data entry and analysis plan established • Expectations and rules developed • Reward/recognition program established • Lesson plans for teaching • Implementation plan • Classroom systems • Evaluation

7. BoQ and the Illinois PBIS Evaluation Process • 70% on BoQ = Fidelity at Universal Tier 1 • BoQ needs to be completed one time per year, between November and April, for consideration of recognition

8. Completing the Benchmarks

9. Benchmark of Quality Materials • Benchmarks of Quality SCORING GUIDE* • School-wide Benchmarks of Quality SCORING FORM • Benchmarks of Quality TEAM SUMMARY • School-wide Benchmarks of Quality TEAM MEMBER RATING FORM • TALLY SHEET • Additional Tool:MULTI-TIERED ACTION PLAN

10. BoQ Directions for Internal Coaches

11. Completion of BoQStep 1 – Internal Coach Rating • The internal coach will take the “BENCHMARKS SCORING GUIDE” (rubric) and answer each question by circling where they believe their team is implementing on the guide. • The internal coach’s answers will then be transferred to “Step 1” of the “BENCHMARKS SCORING FORM” by circling the number that corresponds to each answer.

12. Benchmark Practice:SCORING GUIDE

13. Benchmarks Practice:SCORING FORM

14. Two Ways to Complete Team Member Rating Forms • Recommended for efficiency: team members complete the Team Member Rating Form individually prior to a team meeting • Time is allotted for team members to complete the Team Member Rating Form at the beginning of the team meeting • Regardless of how you roll out the BoQ process with your team, it is helpful to quickly look over all 53 questions with your team members and clarify any questions/concerns before they complete the Team Member Rating Form

15. Completion of BoQStep 2 – Team Member Rating • The internal coach will then ask their building’s school-wide team members to complete the Benchmarks of Quality “TEAM MEMBER RATING FORM” independently and return it to the coach upon completion. Each team member needs to answer all 53 items. • ++ = In Place • + = Needs Improvement • - = Not in Place

16. Benchmarks Practice:TEAM MEMBER RATING FORM Check One

17. Completion of BoQ • The internal coach will tally all “TEAM MEMBER RATING FORMS” on the “TALLY SHEET”. Then the internal coach will take the tallies and add to the “BENCHMARKS SCORING FORM”, Step 2” by indicating the team members’ frequency score, denoting a (++) for “in place”, (+) for “needs improvement” or (-) for “not in place”.

18. Team Member #1 Team Member #2 Team Member #3

19. Benchmarks Practice: Team Member TALLY FORM l l I I I l

20. Benchmarks Practice:SCORING FORM

21. Completion of BoQStep 3 – Team Report • The internal coach will then complete “Step 3” on the “BENCHMARKS SCORING FORM”, noting with a check mark any discrepancies between the internal coach’s score and the team frequency score. • The coach will then complete the “BENCHMARKS OF QUALITY TEAM SUMMARY” recording areas of discrepancy, strengths and weaknesses. • The coach will compute the overall BoQ score

22. Two Types of Discrepancies • 1.) When the internal coach’s score differs from the team’s score • 2.) When the team members’ answers on the TALLY FORM are split evenly across the board and there is not one clear answer

23. Benchmarks Practice:SCORING FORM Example of Discrepancy #1

24. Team Member TALLY FORMExample of Discrepancy #2 I I I I I I I I I

25. Benchmarks Practice:TEAM SUMMARY Areas of Discrepancy Areas of Strength Areas in Need of Development

26. Benchmarks Practice:TEAM SUMMARY Areas of Discrepancy Areas of Strength Areas in Need of Development

27. Computing the Overall BoQ Score • Once the internal coach has addressed all discrepancies and adjusted the SCORING FORM, he/she adds all of the points from questions 1 through 53 (in “Step 1”) together. This is the total score. • Take the total score and divide by 107. This is your overall percentage on the BoQ. • Remember that a score of 70% shows fidelity in universal implementation

28. Benchmarks Next Steps • The internal coach will then take the “BENCHMARKS OF QUALITY TEAM SUMMARY” and share the results with their team. Strengths are celebrated and areas of need can be addressed through the Team Implementation Checklist Action Plan and/or MAP. • External coaches should be part of the process at this point, if they have not already been included. • How will you share strengths with the team? The school? • What potential roadblocks do you anticipate when sharing areas of need with your team? The school?

29. Multi-Tiered Action Plan Next Steps

30. Questions/Concerns Regarding BoQ Findings • If your external coach and/or Technical Assistance Coordinator have any questions/concerns regarding the BoQ results, they may contact you for further information and/or supporting documentation

31. External Coach Support • Provide technical assistance to teams when discrepancies cannot be resolved • Review all BoQ results for schools and associated action plans • Assist in training plans for schools, based on action plan results • Forward BoQ to TAC

32. BenchmarksObtaining Graphs/Feedback • The internal coach will send copies to their external coach of: • BENCHMARKS SCORING FORM • BENCHMARKS OF QUALITY TEAM SUMMARY • MULTI-TIERED ACTION PLAN • The external coach will check over all paperwork and then they will submit a copy to their Technical Assistance Coordinator (TAC) • If districts do not have an external coach, they will need to forward the information directly to their TAC • TACs will then input the “BENCHMARKS SCORING FORM” into www.pbssurveys.org and forward exported graphs to the external coach and/or internal coach

33. PBS Surveys - BoQ ReportOverall Scores

34. PBS Surveys - BoQ ReportCritical Elements

35. Frequently Asked Questions • If you have two internal coaches on a team, who fills out the Scoring Form? • How long does the BoQ process take? • How and where can you document resolved inconsistencies? • Can I input the BoQ score in www.pbssurveys?

36. More Questions? • For additional information and support on completing and/or using the data from the BoQ contact: • Howard Atlas (North) • howard.atlas@pbisillinois.org • Susan Ditch (South) • susan.ditch@pbisillinois.org • Jill Johnson (Central) • jill.johnson@pbisillinois.org