AchieveNJ : Improved Evaluation and Support for Teachers and Principals

1. May 2013 AchieveNJ: Improved Evaluation and Support for Teachers and Principals Updated May 3, 2013

2. Today’s Presentation • Welcome to our Regional Presentation on AchieveNJ • We are here to inform, to learn, and to provide an opportunity for feedback. • While this presentation is primarily an informational session, the will be more formalized opportunities for public testimony in June, and July. • Opportunities for questions: • Index cards with questions will be collected after each segment • E-mail us at educatorevaluation@doe.state.nj.us Updated May 3, 2013

3. Agenda Updated May 3, 2013 3

4. What is AchieveNJ? AchieveNJ is a comprehensive educator evaluation and support system • Teach: Help educators better understand their impact and ultimately improve student outcomes. • Lead: Align leadership responsibilities with practices that we know have the greatest influence on learning. • Grow: Foster an environment of continual growth for all students and educators in New Jersey. Introduction toAchieveNJ

5. AchieveNJ is Part of Broader Reforms • Instruction • AchieveNJ, together with the initiatives to implement Common Core Standards and PARCC assessment, form the key elements to improve student achievement. Student Achievement • Student Achievement Introduction toAchieveNJ

6. Our Goal: Improved Student Achievement • Parents are a child’s first teachers, but teachers and principals have the biggest in-school impacton student learning. • Research shows effective teaching can be measured. • Better educator evaluations will improve teaching and learningso that all teachers — and students — perform at high levels. Introduction toAchieveNJ 6

7. Effective Teachers Make a Significant Difference The difference between an effective and ineffective teacher can approach 11 months of learning for a student in one year. Source: Bill & Melinda Gates Foundation, MET Project Introduction toAchieveNJ 7

8. Goals of New Evaluation and Supports Introduction toAchieveNJ

9. Key Provisions of TEACHNJ Introduction toAchieveNJ 9

10. State Evaluation Framework *This is reflective of current minimum requirements by state, and may not reflect practice in all districts. Introduction toAchieveNJ 10

11. Careful, Deliberate Path Towards New System • EPAC, Pilot 1 launched • All districts launch improved evaluations • TEACHNJ Act passed • $38 million Race to the Top award for NJ • EPAC and external Rutgers reports issued Educator Effectiveness Task Force formed 2010 2011 2012 2013 • Task Force releases recommendations • Pilot 2 selected • 2nd round of evaluation regulations proposed • 1st round of evaluation regulations proposed Introduction toAchieveNJ 11

12. AchieveNJ is Driven by Educator Input Introduction toAchieveNJ

13. Thanks to Our Pilotsfor Leading the Way 1 2 1 1 2 1 Teacher Evaluation Pilot: • 2 separate 1-year pilot programs • 22 pilot districts • Rutgers study outlining challenges and successes 1 1 • Number of participating districts in each county 1 2 1 3 1 2 3 1 1 Principal Evaluation Pilot: • 14 pilot districts • Forthcoming study by REL Mid- Atlantic 1 • Number of participating districts in each county 3 2 1 2 1 *Does not include Newark and SIG schools 1 Introduction toAchieveNJ

14. Lessons Learned from Pilots Introduction toAchieveNJ

15. Agenda Updated May 3, 2013 15

16. Evaluations Use Multiple Measures • The TEACHNJ Act requires evaluations to include multiple measures of student progress and multiple data sources. Practice Student Achievement TeacherPractice Based on classroom observations • Student Growth Objective(SGO) • Set by teacher and principal • Student Growth Percentile (SGP) • Based onNJ ASK performance • Summative Rating • Overall evaluation score Less than 20 percent of teachers All teachers and principals Teachers

17. Districts Choose Their Own Observation Measure Other: Instruments that have been approved but are being used in fewer than 5 districts; this includes approved “homegrown” models. Practice SGO SGP Summative Teachers: Practice

18. Teacher Observations Vary • Long:40 minutes, with post-conference • Short:20 minutes, with post-conference • Notes: • Corrective Action Plans: After the first year, teachers who receive an Ineffective or Partially Effective rating are required to have one additional observation, and multiple observers are required. • Within the minimum requirements, all teachers must have at least one unannounced and one announced observation. Practice SGO SGP Summative Teachers: Practice

19. Observers Will Be Well-Trained Practice SGO SGP Summative Teachers: Practice

20. Student Growth Percentile Overview Practice Student Achievement TeacherPractice Based on classroom observations Student Growth Objective(SGO) Set by teacher and principal Student Growth Percentile (SGP) Based onNJ ASK performance Summative Rating Overall evaluation score Less than 20 percent of teachers All teachers and principals Teachers

21. Calculating Student Growth Percentiles • Student Growth Percentiles (SGPs) measure how much a student has learned from one year to the next compared to peers with similar academic history from across the state. • Growth baseline information is established by a student’s prior learning as measured by all of student’s NJ ASK results.         All students can show growth. Practice SGO SGP Summative Teachers: SGP

22. Why Student Growth? 250 Advanced Proficient 220 230 205 Maria NJ ASK Scale 200 Proficient 165 160 Albert 150 100 Partially Proficient Gr. 3 Gr. 4 Gr. 5 NJ Ask Scale Score by Grade Proficiency does not tell the whole story. Under our current system, a school or teacher might only notice that Maria is “Proficient” and that Albert is “Partially Proficient.” Practice SGO SGP Summative Teachers: SGP

23. Example: Calculating an SGP  Albert is a 5th Grade student in Ms. Jones’ Math Class. He has scored “Partially Proficient” in 3rd, 4th, and 5th grade, but each year his scale score has improved. 250 Advanced Proficient Ms. Jones notices that he scored a 165 scale score this year, but doesn’t quite know what that means about Albert’s growth. NJ ASK Scale 200 Proficient 165 160 150 100 Partially Proficient Albert’s NJ Ask Scale Score by Grade Gr. 3 Gr. 4 Gr. 5 Practice SGO SGP Summative Teachers: SGP

24. Example: Identifying Academic Peers   • In order to figure out what that growth means, we first identify Albert’s “Academic Peers”; these are students who performed similarly to Albert in the past.                     Academic Peers’ Prior Scores       Albert’s Prior Scores                     • These “Academic Peers” are represented by students from across the state in many different school districts.            Practice SGO SGP Summative   Teachers: SGP

25. Example: Assigning an SGP Academic Peers’ Current Scores       Albert’s Current Score  • This comparison helps us put Albert’s growth into context, and assign him a Student Growth Percentile on a scale from 1 to 99. 250 Advanced Proficient                      Proficient 200 160 29% 150 70% Partially Proficient 100 • Albert’s SGP score is 70, which conveys that his 5th grade score is higher than 70% of his academic peer group. Gr. 3 Gr. 4 Gr. 5 • Albert’s academic peers scored between 130 and 185 on the 5th grade NJ ASK, with the majority of them scoring below Albert’s score of 165. 1% 70th% 99% Practice SGO SGP Summative Teachers: SGP

26. Teachers Receive Median SGP Score on Roster Median SGP Score • Albert’s SGP score is then placed on Ms. Jones’ course roster so that we can see how she did with all of her students.                    • Ms. Jones would then receive an effectiveness rating by taking the median SGP score on her roster. • In this scenario, Ms. Jones would receive a rating of 51. Practice SGO SGP Summative 26 Teachers: SGP

27. SGP Technical Rules • Ms. Jones can only receive a median SGP score if the following is true: • She has at least 20 student scores on her roster; • If she does not have 20 students in year 1, she may receive an SGP score if she accrues 20 student scores over a period of up to 3 years. • Students are enrolled in class at least 70 percent of the time before the test; and • She has worked for at least 60 percent of the time before the test. Practice SGO SGP Summative Teachers: SGP

28. SGP Technical Rules Median this Year = 51 Median over 2 years = 56 • In future years, Ms. Jones should know that: • If two or three years of data are available, the Department will use the best available score — either the teacher’s median score of their current roster or the median of all student scores over the years available. Her SGP score will then be placed on a 1-4 scale.* *Guidance is forthcoming on how SGP will be converted from a score on 1-99 scale to 1-4 scale. Practice SGO SGP Summative Teachers: SGP

29. Understanding Student Growth Objectives Practice Student Achievement TeacherPractice Based on classroom observations Student Growth Objective(SGO) Set by teacher and principal Student Growth Percentile (SGP) Based onNJ ASK performance Summative Rating Overall evaluation score Less than 20 percent of teachers All teachers and principals All teachers will set academic goals for their students at the beginning of each school year – called Student Growth Objectives (SGOs). Teachers

30. All Teachers Set Student Growth Objectives (SGOs) • SGOs: Annual, specific, and measureable academic goals for groups of students that are locally developed and assessed • Creating an SGO: • Collaborative process between teacher and immediate supervisor • Principal has final decision • SGOs can be based on: • Appropriate national, state or LEA-developed assessments • Rubric-measured portfolios or performance assessments Practice SGO SGP Summative Teachers: SG0

31. Basic Steps for Creating an SGO In setting SGOs, teachers should take the following steps: • Choose or develop a quality measurement tool (examples follow) that is aligned to applicable standards. • Determine students’ starting points based in available data. • With supervisor input and approval, set ambitious yet achievable student learning goals. • Track progress and refine instruction accordingly. • Review results and discuss score with supervisor. Practice SGO SGP Summative Teachers: SG0

32. The SGO Process Teachers Recommended steps for setting a good SGO KEY Official SGO process in regulations • Teachers, supervisors meet to discuss and set SGO w/ principal’s approval • Teachers, supervisors meet to discuss SGOs and other measures Step 1: Choose or develop a quality assessment aligned to state standards Step 4: Track progress, refine instruction September By Nov. 15* By Feb. 15 By end of school year Step 2: Determine students’ starting points Step 3: Set ambitious and feasible student growth objectives • Adjustments to SGOs can be made with approval Step 5: Review results and score Practice SGO SGP Summative *For 2013–14 only. In subsequent years, SGOs must be set by Oct. 15. Teachers: SG0

33. SGOs: Some Possible Assessment Types • *Note: The use of the New Jersey Assessment of Skills and Knowledge (NJ ASK) for SGOs is prohibited for teachers who will also receive SGP scores based on those tests.  Practice SGO SGP Summative Teachers: SG0

34. Types and Examples of SGOs Practice SGO SGP Summative Teachers: SG0

35. General SGO: Elementary Literacy *These numbers will be determined by teacher and principal based on knowledge of students to create a rigorous and attainable goal. Practice SGO SGP Summative Teachers: SG0

36. General SGO: 6th-Grade Music Practice SGO SGP Summative Teachers: SG0

37. Tiered General SGO: Physics 1 Practice SGO SGP Summative Teachers: SG0

38. Specific Goal: Targeted Biology Standard Practice SGO SGP Summative Teachers: SG0

39. Specific Goal: Targeted Students (8th-Grade LAL) Practice SGO SGP Summative Teachers: SG0

40. Component Weighting: Tested Grades • Tested Grades and Subjects • (Currently grades 4-8, LAL and math): • 55% teacher practice • 45% student achievement • The Department will look to • incorporate other measures • where possible and percentages • may change as system evolves. 45% Student Achievement 55% Teacher Practice Practice SGO SGP Summative Teachers

41. Component Weighting: Non-Tested Grades Teacher in Non-Tested Grades and Subjects:Student Achievement will be 15% in SY13-14, Teacher Practice will be 85%. 50% Student Achievement 15% Student Achievement 85% Teacher Practice 50% Teacher Practice *The Department will look to incorporate other measures where possible and percentages will change as system evolves. Practice SGO SGP Summative Teachers

42. Teachers’ Summative Ratings 2.76 This is a sample scale. The NJDOE will determine the actual scale prior to September 2013. Practice SGO SGP Summative Teachers

43. Summative Rating Timeline Rationale Teachers in tested grades and subjects in New Jersey will not receive their SGP scores in time for their summative conference. There are several reasons for this delay: • Full Year Snapshot of Growth: New Jersey does not give the NJASK until May. • Emphasis on Writing: The NJASK has more constructed response and long answer questions than many other states, so the test takes longer to score. • Careful Process: Once scores are finalized, there is a careful process for calculating student and teacher level SGP scores. Practice SGO SGP Summative Teachers

44. Summative Rating Timeline Details • At the summative conference, all available component scores (teacher practice, SGO results) will be discussed. • SGP data will be available on the following timeline. • NJASK scores released. • Department calculates SGP data and sends to districts the SGP and summative rating of each teacher with an SGP score. • Annual summary conference includes: • available component measures. June October November/ December January • Department collects all other component measures for teachers with SGP. • Summative rating added to personnel file. Practice SGO SGP Summative Teachers

45. Implications of Ratings • Teachers rated Ineffectiveor Partially Ineffectivereceive support through Corrective Action Plans • Once the system is fully implemented, districts will be able to identify Highly Effectiveteachers for recognition such as: • Differentiated observation protocols • Expanded career pathways and leadership opportunities • Awards and recognition initiatives Practice SGO SGP Summative Teachers

46. Teachers on Corrective Action Plans • June – December: If SGP isn’t available, teachers use Practice measure until data is ready • By February 15: Extra observation done if CAP was created at beginning of school year Plan content: • Clear improvement needs • Specific goals and timeline Progresstoward goals in plan: • One extra observation and conference required mid-year • Tenured teachers must have multiple observers • May – September: Non-SGP Teachers, CAP is developed by September 15 Practice SGO SGP Summative Teachers

47. Agenda Updated May 3, 2013 47 47

48. Multiple Measures for Principals Practice Student Achievement Principal Practice Observation instrument Evaluation Leadership Implementation and training on evaluation SGO Average Average of teacher SGOs Admin. Goals Set towards measure of student achievement School SGP Average of school-wide ELA and Math SGP scores Summative Rating Overall Evaluation Score Only schools with SGP grades receive this score All principals principals

49. Principal Practice Requirements • 2 observations for tenured principals, 3 for non-tenured. • Observations may be completed using a variety of information sources. • Observations conducted with lens of principal practice instrument, which is locally-adopted, and may include: • School walk-through • Case studies • Observation of staff meeting, school assembly • Parent conference observation • Teacher conference observation Admin. Goals School SGP Practice Leadership SGO Average Summative Principals: Practice

50. School SGP for Principals • Principals will be broken into 3 categories: • Multi-Grade SGP Schools: 2 or more SGP grades in school • Single-Grade SGP Schools: 1 SGP grade in school • Non-SGP Schools: No SGP grades in school Admin. Goals School SGP Practice Leadership SGO Average Summative Principals: SGP