Interpreting KEYS Data and Preparing School Presentation School Team Training

1. Interpreting KEYS Data and Preparing School Presentation School Team Training Quabbin Regional School District

2. Agenda • Questions and principles to keep in mind [10 minutes] • Considering the Effective Schools research [10 minutes] • Description of Keys [30 minutes] • Reviewing data presentation [20 minutes] • Preliminary analysis of KEYS data Each group analyzes data from KEYS indicators Captures 2 or three major observations for each Key[2 hours] • Defining the “BIG ISSUES” [45 minutes] • LUNCH [30 minutes] • Creating and practicing school presentation [1 hour]

3. General Questions & Principles to Consider before Looking at Your KEYS 2.0 Data • Recognize the limits of the best survey instruments • Distinguish between symptoms and root causes • Are the data surprising or confirming? • Are you listening to all relevant voices in your school community? • Move from data to understanding to knowledge • Without theory, no organizational learning and improvement can occur.

4. General Questions & Principles to Consider before Looking at Your KEYS 2.0 Data • Apply systems thinking: the whole is greater than the sum of its parts • Look for patterns within and across KEYS • Slow and steady: the road to continuous improvement has no end • Celebrate your victories and learn from your strengths • KEYS 2.0 is a diagnostic tool leading to a deliberative process, not a rigid, mechanistic, quick-fix prescription.

6. Nine Characteristics of High Performing Schools • Clear and Shared Focus • High Standards and Expectations for All Students • Effective School Leadership • High Levels of Collaboration and Communication • Curriculum, Instruction and Assessment Aligned with Standards • Frequent Monitoring of Learning and Teaching • Focused Professional Development • Supportive Learning Environment • High Levels of Family and Community Involvement Source: Shannon, G.S. & Bylsma, P. (2003).

7. School Community Completes KEYS Survey TODAY: School Improvement Team (SIT) trained in the analysis and interpretation of KEYS Results TODAY: SIT conduct preliminary analysis and interpretation of KEYS results and prepare for involvement of whole school community SOON:SIT assist whole school community to examine results and make preliminary recommendations THEN: SIT consider whole school’s recommendations and begins deliberative process THEN: SIT develop/adapt school improvement plan based on KEYS and other data and present to school community for feedback THEN:School improvement plan approved and ready for implementation Flow Chart of Processes for Analyzing and Interpreting Data LATER: District revises District PD Plan to incorporate/integrate school plans

10. Key 1: Indicator 1.3 – Student-Centered (Big Ideas) • How do your students measure up on basic cognitive and social/emotional skills? Critical thinking and social skills? • What is your current instructional emphasis? Is it working?

13. Interpreting KEYS Data

14. Vertical Axis Indicators (groups of questions that measure the same concept) Horizontal Axis Measure of quality: 5 point scale Left = disagree (low value) Right = agree (high value)

15. School Average All schools Average Standard Deviation High Performing School Average The bar graph indicates school’s progress toward continuous improvement for each indicator in terms of The school average moving continuously toward the right side (agree – high value of quality for that indicator) At the same time, reduce the standard deviation (narrow the length of the horizontal bar, meaning greater agreement among respondents)

16. KEYS Vocabulary • Rating = the degree to which the respondents believe that the indicator accurately describes the school: average of all respondents on each indicator • 1 = complete disagreement – indicator does not describe the school • 2 = some disagreement • 3 = neither agreement nor disagreement – in the middle • 4 = some agreement • 5 = complete agreement – indicator accurately describes the school • Consensus = degree of similarity among respondents on the rating for each indicator • Low consensus = wide band • High consensus = narrow band

17. Interpreting KEYS Data • Complete a worksheet for each Key • Identify areas of strength and weakness by completing the analysis indicated on the worksheet. • Determine which indicators have the highest score. • Compare the school’s score to that of all schools in the sample and that of high performing schools • Determine which indicators show a high degree of consensus among respondents. • Determine if responses differ by type of respondent • Identify and summarize significant findings that will be presented to the rest of the staff. Make sure this includes an explanation of what the Key includes.

18. KEY 1: Shared Understanding & Commitment to High Goals • Effective leadership • Clear Focus, Purpose, and Directions • Shared Commitments and Collective Responsibility The adults in this school and in the larger community are continuously engaged and invested in the achievement of high standards by all students.

19. School Analysis of Key 1: Shared Understanding and Commitment to High Goals

20. Key 1

21. Interpreting KEYS Data • Now – complete your analysis of the rest of the KEYS. • Be prepared to share your analysis with the group. • As you prepare your analysis – identify areas of concern that might fall into the category of BIG ISSUES.

22. Identifying the BIG ISSUES • In your group, identify the THREE issues – based on your analysis of KEYS and your knowledge of the your school – that you believe the school should focus on in order to begin the improvement process. • Provide data to support your choices.

23. What are the BIG ISSUES • Are you satisfied that these are the issues that should be shared with the whole school staff?

24. The School Presentation • Which indicators in each Key do you wish to emphasize? (We can highlight those with lined ovals.) • Emphasize both positives and negatives. • Which of your analyses do you wish to include in the presentation? You may need to edit this down.

25. The School Presentation • Besides the KEYS data, you want to make some recommendations for future action – that are based on the data. • What would these be? • What are the “next steps” for the school staff as a whole?

26. The School Presentation • The final decision is WHO IS GOING TO PRESENT THE DATA – a shared burden is a light one! • Who will present the data for • Key 1 • Key 2 • Key 3 • Key 4 • Key 5 • Key 6 • Recommendations

27. The School Presentation Norms • While normally you should never read a PowerPoint presentation, in this case, we want to ensure that everyone sees and hears the same thing. So the rule will be broken. • The first person will set the stage for the presentation. • Each presenter should introduce the next person. • Each presenter should explain what is on the slides s/he is covering. • Each presenter should “stick with the script” and not editorialize. • Ask for questions at the end of the presentation. MTA staff will assist you with answers.