Evaluations in KEEP and Accreditation Update

1. Evaluations in KEEP and Accreditation Update August 12, 2013 Easton KSDE Scott Myers, Bill Bagshaw, Vicki Seeger, Kayeri Akweks

2. WAIVER - Principle 3 Supporting Effective Instruction and Leadership Implement teacher and principal evaluation and support systems that: • Are used for continual improvement of instruction • Use at least 3 performance levels • Use multiple measures including student growth as significant factor • Are used to evaluate on a regular basis • Provide clear, timely, and useful feedback • Are used to inform personnel decisions

3. Assurances Districts Have Chosen Their Evaluation Systems for 2013-2014 As of August 1, 2013 – 281districts have submitted their Assurances Form 278 districts have had their Assurances Form approved 93 districts will be using the KEEP Evaluation System 153 districts will be using vendor systems 45districts will be using locally created evaluation systems

4. Evaluation Systems per Districts as of 6-26-2013

5. Co-Construct Building Leaders and Teachers Co-Construct the Educator Evaluation Multiple Measures Locally Determined Selections – from default list or KSDE other approved measures Validation – REL, KSDE content area specialists, or LEA able to meet valid and reliable criteria Significant Student Growth Determining significance – Matrix, Other Examples Establishing timeline for growth – Student Growth Percentile

6. Multiple Measures Recent Developments • Focus Groups provided a list of possible measures • KSDE is collaborating with REL and the Center for Great Teachers and Leaders to modify the list of measures collected across Kansas • KSDE will identify a “Default List” of Multiple Measures

7. Multiple Measures Measures to Use • State assessments must be used • Include assessment measures currently in use in your district • Shared credit/responsibility for student growth subject to local decision making • Time for student growth 1-4 years

8. Sample Measures by KSDE from the Field

9. Multiple Measures Types of Assessments We are looking at assessments that measure more than academic preparedness, such as: 21st Century Skills Critical Thinking Employability Technical Skills SBoE has previously approved the College and Career Ready definition.

10. Define Significance Significance Definition • The change in student achievement for an individual student between two points in time, determined using multiple measures • To include gains and progress toward post-secondary and workforce readiness • To include progress in academic and functional goals in an individualized education program or meeting academic student growth objectives

11. Multiple Measures, Effectiveness, Significance EXAMPLE

12. Define Significance Multiple Measures and Significance Summary • Teachers and Leaders evaluations include multiple measures as evidence • Kansas is defining “significance” as demonstrating student growth using MORE than one measure • Must consider state assessments • May include assessment measures currently in use in your district • Validity of the Measure must be pre-determined for any appropriate measure • Locally determine credit/responsibility for student growth • Time for student growth 1-4 years

13. The New KEEP Evaluation System and Resources on the KEEP Webpage http://goanimate.com/videos/0PtomrSal6Qs

14. The Evaluation Process TEACHER The constructs to be measured in the evaluation instrument: Construct 1: Learner and Learning Construct 2: Content Knowledge Construct 3: Instructional Practice Construct 4: Professional Responsibility

15. Evaluation Rubrics Teacher Evaluation Rubrics Construct 1: Learner and Learning To ensure that each student learns new knowledge and skills, teachers must understand that learning and developmental patterns vary individually, that students bring unique individual differences to the learning process, and that students need supportive and safe learning environments to thrive. Demonstration of the teacher’s proficiency in Learner and Learning is evidenced by: 1.1 Learner Development The teacher planned instruction based on the learning and developmental levels of all students.Key indicators include: planning instruction, aligning instruction with student learning needs, using a variety of approaches and resources, providing adaptation of instruction. 1.2 Learner Differences The teacher recognized and fostered individual differences to establish a positive classroom culture.Key indicators include: getting to know all students, using that knowledge of students to create a culture of respect, meeting needs of all students. 1.3 Learning Environment The teacher established a classroom environment conducive to learning. Key indicators include: collaborating with students, establishing a safe, respectful and academically challenging environment.

16. Highly Effective Ineffective Developing Effective Evaluation Rubrics Goal 1.1 Learner Development: The teacher planned instruction based on the learning and developmental levels of all students. Sources of Evidence for Planning Instruction Based on the Learning and Developmental Levels of All Students • Differentiated lesson plans • Student work sample • Assessment data • Teacher reflection

17. Evaluation Process Evaluation Goal Selection • District Goals • Building Goals • Individual Goals KSDE recommends that each Educator selects no more than two goals per evaluation cycle: • A district or building level goal, • A personal goal mutually agreed upon by the Evaluator and the Evaluatee.

18. Evaluation Process Inter-Rater Reliability Reliability refers to the consistency of the entire evaluation process. Validitymeans that the process is measuring what it was intended to measure. KSDE Expectation All school district evaluators attend professional learning activities that address the issue of reliability relative to using the KEEP Rubrics. The same expectations apply to districts using an evaluation system other than KEEP.

19. Evaluation Process Evaluating the Teacher • Thinking through and discussing the Process • Goals Selected • Multiple Measures selected • Timeline for Evaluation • 1 Cycle • 2 Cycles

20. Teacher Process • Required Steps • Implementation Ideas

22. KEEP Repository Assessment Rubric Teacher Assessment Rubric

23. KEEP Repository Goals – Select Goals, Write Text for Expected Outcome, Add

24. KEEP Repository Goals – After Adding, then Complete and Save, can Print

25. KEEP Repository Artifacts – Select Component and Source of Evidence Add File to Upload

26. KEEP Repository Artifacts – Uploaded

27. KEEP Repository Informal Observations – per Construct and Component with Date

28. KEEP Repository Conferences – Discussion Summary and Comments

29. KEEP Repository Conferences – Discussion Summary and Comments, Signatures and Print

31. KEEP Guided Practice NEW !! KEEP Guided Practice • New Online Training – open 24/7 • Individualized and Repeatable • Includes multiple forms of Learning • Available from links on the KEEP Webpage • Need to have JAVA enabled

32. KEEP Webpage http://www.ksde.org/Default.aspx?tabid=4400 • News and Announcements • KEEP Repository Registration • KEEP Training Materials and Schedule • Archives with Materials of Previous Trainings and Meetings • Assurances Information • Kansas Flexibility Waiver Materials

33. Rabbit, Cat and KEEP Rabbit and Cat and KEEP KEEP on Truckin’ http://goanimate.com/videos/0gn6PmIbz0YU

34. Accreditation We need to keep in mind the definition of Kansas College and Career Ready: College and Career Ready means an individual has the academic preparation, cognitive preparation, technical skills, and employability skills to be successful in postsecondary education, in the attainment of an industry recognized certification or in the workforce, without the need for remediation.

35. Accreditation Current Objectives • Updates have been made to: • In Depth Rubric Revisions • Definitions of Relationships, Relevance, Responsive Culture, Rigor, Results • Definitions of the sub-R’s • QPA Protocol Handbook • Evidence and Artifacts • Web Page • QPA Regulations

36. Accreditation Accreditation Professional Learning Modules http://goanimate.com/quickvideo/edit/03qV64mSn9HE

37. Annual Measurable Objectives What are the 6 AMOs? • Each building will have an AMO for achievement, growth, reduction of non-proficient, gap and participation • High school buildings will have an AMO for graduation • All targets are based on 2011-2012 data

38. Annual Measurable Objectives #1 Achievement AMOs • The AMOs for achievement are determined by a building's Assessment Performance Index (API) score and its percentage of students below standard. • Both conditions must be met in order to make a building category.

40. Annual Measurable Objectives #2 Growth AMO • To achieve the growth AMO a school must have a median student growth score that meets or exceeds those of half the schools in Kansas. • Your building's 2013 Median score for reading and math will be compared to the 2013 range of median scores for all buildings to determine AMO status.

42. Annual Measurable Objectives #3 Reduction of Non-Proficient AMOs • Reduce the percentage of non-proficient students (RNP) in half by the 2017-2018 school year. • The RNP calculation is applied at the district, building, and subgroup level to create a unique RNP AMO for each.

44. Annual Measurable Objectives #4 Gap Reduction AMOs • The goal of the Gap Reduction AMO is to reduce the gap between the state benchmark and the lowest performing 30% (LP30) of students by half by the 2017-2018 school year. • A building may also achieve its Gap Reduction AMO by demonstrating an API score of 500 or greater for its LP30. • Each building has a specified rate of Gap reduction.

46. Annual Measurable Objectives #5 Graduation AMOs for High School • The overall AMO for graduation is 80%. • The AMO can be met by either the 4 year or 5 year rate calculation.

47. Graduation AMOs

48. Annual Measurable Objectives #6 Participation AMOs • The AMO for participation rate is 95%. • The AMO of 95% applies to both reading and math. • The AMO can be achieved by meeting the participation rate in the current year. • The AMO can also be achieved by a 2 year or 3 year participation rate average that is equal to or greater than 95%.

49. Participation AMOs

50. Annual Measurable Objectives Resources • Video clips and fact sheets for Achievement, Growth, Reduction of Non-Proficient and Gap AMOs can be found on the ESEA flexibility waiver webpage:http://www.ksde.org/Default.aspx?tabid=5075 • This page can also be accessed by clicking this logo on the KSDE home page