2013 PSSA Assessment Coordinator Training

1. 2013 PSSA Assessment Coordinator Training Pennsylvania Department of Education Data Recognition Corporation

2. Agenda • Introductions – PDE • General Overview – PDE • PSSA Overview – PDE • Test Security – PDE • PDE Security Training – PDE • Planning for the Assessment – PDE • Participation and Exceptions to Participation – PDE • Administering the Assessment – PDE • AYP – PDE • Review Key Dates – DRC • Roles and Responsibilities – DRC • Paper/Pencil Administration – DRC • Online Administration – DRC

3. General Overview • All policy decisions come from PDE • All PSSA logistics are the responsibility of DRC and include: • Delivery of Paper Materials • eDIRECT System • Insight System (Online test engine)

4. Available to students either online or paper/pencil • Multiple-Choice (MC) and Constructed-Response (CR) items PSSA Overview

5. PSSA Overview • Students in grades 3-8 will be required to take the PSSA. • PSSA results will be used for Adequate Yearly Progress (AYP). • The 2013 PSSA will be based on the current AA/EC • Grades 3-5 will have Field Test items based on the PACC • The entire PSSA will be based on the PACC in 2015

6. PSSA Overview • PSSA and Keystone Exams • Students in 8th grade or below who complete a course for which there is a Keystone Exam will take both the Keystone Exam and the PSSA.

7. PDE Policy – Test Security • The assessments rely on the measurement of individual achievement. Any deviation from assessment procedures is strictly prohibited and will be considered a violation of test security. • School administrators, teachers, and any other education personnel who are involved in the assessment program must maintain the security of all assessment materials at all times. • Because the assessment must remain secure, teachers/Test Administrators should not have assessment materials in their possession at any time other than during the actual assessment administration.

8. PDE Policy – Test Security Test Security Certifications • The Test Security Certifications must be signed after the assessments are administered • Principal, District Assessment Coordinator, School Assessment Coordinator, Test Administrator and Proctor (if applicable) • Provided in Appendix D of Handbook for Assessment Coordinators • All other individuals handling secure materials MUST have a signed School Assessment Coordinator Test Security Certification on file • The Chief School Administrator must retain all Certifications for three years • DO NOT return these forms to DRC

9. PDE Policy – Test Security Test Security Certifications • If an individual does not sign the appropriate Test Security Certification, the Chief School Administrator must provide the Department of Education’s Bureau of Assessment and Accountability with a written explanation of the reason or reasons why the Certification was not executed.  The explanation must provide a description of the action taken by the Chief School Administrator in response to the failure to execute the Test Security Certification.

10. PDE Policy – Test Security PAsecureID List Distribution • School assessment coordinators must generate a list(s) of students by PAsecureID to show all students taking the PSSA. • The list should include for each student the test administrator, school name, year, and subject being administered. • All lists must be retained at the district/school for three years; and be available when requested by PDE.

11. PDE Policy – Test Security • Maintain test security: Refer to PDE security guidelines located at www.education.state.pa.us Search for “Accommodations and Security”

12. Roles and Responsibilities • District Assessment Coordinator (DAC) • Attend required PDE training • Train school assessment coordinators • Receive tests • Inventory tests • Distribute tests to school assessment coordinator(s) • Collect tests from school assessment coordinator(s) • Inventory, package, and return tests

13. Roles and Responsibilities • School Assessment Coordinator (SAC) • Attend training offered by DAC • Train Test Administrators (TAs) and Proctors • Receive tests from DAC (ship to district sites) or DRC (ship to school sites) • Inventory tests for school • Put labels on test booklets (Do not open test booklets while doing this!) • Create testing schedule

14. Roles and Responsibilities • School Assessment Coordinator (cont.) • Distribute tests to TAs on the day and time scheduled for test administration. • Monitor testing sessions • Collect tests from TAs • Make sure no prohibited materials are on the classroom or hallway walls • Make sure tests are in a locked area with controlled and limited access • Return all tests to DAC (ship to district sites) or DRC (ship to school sites)

15. Roles and Responsibilities You are responsible for the security and proper administration of these tests.

16. Roles and Responsibilities • Test Administrators • Be familiar with all testing protocols, including the “Ethical Standards of Test Administration (formerly the “DO’s and DON’Ts”) • Follow all testing protocols • Sign the Test Security Certification Statement • Make students familiar with testing procedures • Make students feel comfortable

17. Roles and Responsibilities • Test Administrators • Answer any questions students may have about test directions • Walk around the room during testing • Maintain a calm, quiet environment during testing • Collect and return test books to the SAC when testing is complete • Report any suspected testing violations to the SAC and to PDE

18. Chain of Custody • Tests should be secure at all times! • DACs should inventory the tests as soon as they arrive in the District and keep them in a locked storage area that has limited access. • SACs should inventory the tests as soon as they arrive in the School and keep them in a locked storage area that has limited access.

19. Chain of Custody • When distributing tests to TAs, the tests should be counted by the SAC in the presence of the TA • When the tests are collected, they should be counted by the SAC in the presence of the TA • Tests should be collected as soon as a testing session is completed unless another section is to be administered immediately

20. Chain of Custody • Tests should be stored in a locked storage area. Only people who require access to the tests should have a key to the storage area. • Samples of the test booklets are NOT to be furnished to the TAs as part of the training. TAs should NOT receive any test booklets until the test is to be administered.

21. Common Violations The following are examples of testing violations. This is NOT an exhaustive list. • Misuse of accommodations (e.g., reading the Math test to the entire class; reading aloud the Reading test) • “Under” proctoring (e.g., inadequately monitoring the testing session) • “Over” proctoring (e.g., reminding a student without the appropriate accommodation to answer a specific question)

22. Common Violations • Changing answers or encouraging students to change their answers. • Discussing the test or test questions with individual students. • Reading aloud a math question or answer choice when doing so cues the correct answer.

23. Common Violations • Not removing or covering instructional materials in the testing room or the hallways. • Giving reminders to individual students or to the entire class (e.g., “Remember, we covered this last week.”) • Allowing students to possess cell phones during testing. • Allowing devices in the testing room that take pictures.

24. Common Violations • Copying or recording any part of the secure test materials • Viewing secure test material by teachers, proctors, administrators, etc. • Returning test materials to students to complete or enhance answers

25. Potential Consequences of Testing Violations For Educators: • Verbal reprimand • Written reprimand • Suspension with or without pay • Termination • Revocation of certification • Criminal charges

26. Potential Consequences of Testing Violations For Students: • Consequences for students violating test security (e.g., cheating, taking pictures of test questions) are up to the individual LEA. • Students should be made aware of these consequences prior to testing.

27. Potential Consequences of Testing Violations For Students (cont.) • If a student violates test security, it is the responsibility of the LEA to determine the consequences for the student. These consequences may include disciplinary action and/or the student retaking the test. • ALL test security violations by students must be reported to PDE immediately.

28. Data Available to PDE- examples • Student erasures • How long it takes a student to answer an item when taking the test on a computer • When answers are changed and how often they are changed on a computer • Statistical analyses of student scores and performance

29. Cautions! • Do actively proctor the test but don’t give any individual student help. • Do encourage the class to check their answers but don’t encourage specific students to check their answers. • Do report all prohibited actions.

30. Cautions! • Do not review student test or answer booklets (except as stated in the Administration Manual and the Accommodations Guidelines). • Do not assist, direct, or counsel students during the administration of the test in any way that would influence student answers. • Do not provide answers to students. • Do not alter, influence, or interfere with a test response in any way, fill in any unanswered item, or instruct the student to do so. • Do not discuss or provide feedback regarding test items. • Do not use the answer sheet as scratch paper or as a method to eliminate incorrect answer options.

31. To Report Suspected Violations, Contact The Pennsylvania Department of Education at 717-787-4234

32. Additional Contact Information • Jay Gift, Assessment Security Advisor • 717-783-1144 • rgift@pa.gov • Kerry Helm, Assessment Specialist • 717-783-6538 • khelm@pa.gov

33. Planning for the Assessment Testing Preparation DOs: • Plan for testing rooms and times • Post PA General Description of Scoring Guidelines • Math Formula Sheet(s) Provide test administrators with: • Manuals • Test Security Certifications (located in back of PSSA Handbook) • A schedule and plan for secure distribution and collection of materials after each session • Training to include correct labeling and coding

34. Planning for the Assessment Accommodations The Accommodations Guidelines for students with IEPs, ELL students, and all students are available on department’s web site – www.education.state.pa.us

35. Planning for the Assessment • Be prepared for parental requests to view the test. Parental review must be done with a paper assessment booklet. • Schedule small group setting(s). • Schedule extended time setting(s). • Assign test administrators for breaks and movement to other setting(s).

36. PASA • Eligible grade 3-8 students can participate in the PASA for Math, Reading, and Science • If a student meets the criteria to participate in the PASA, he/she must also participate in a school or district provided alternate assessment for Writing

37. ELL students • ELL students are treated the same as every other student with the following exceptions: • Participation in the Math PSSA is mandatory but if the student is in their first year of enrollment in a U.S. school their scores do not count for AYP purposes • Participation in the Reading PSSA is optional for students in their first year of enrollment in a U.S. school

38. ELL students • ELL students are treated the same as every other student with the following exceptions: • Participation in the Science PSSA is mandatory for students in their first year of enrollment in a U.S. school but scores do not count for AYP purposes

39. DO: • maintain calm & quiet • remove or cover all instructional materials • provide: • blank scratch paper • sharpened pencils • highlighters • encourage students • return all test materials to secure location DO NOT: • allow unsupervised breaks • display visual cues (e.g., picture icons) • provide pre-printed graphic organizers • allow pens/colored pencils; stray marks • prompt students • keep any test materials • use the answer sheet as scratch paper Administering the Assessment

40. Make-ups • Make-up missed sessions as soon as possible • Make-ups for all subjects can be administered up to the end of the testing window

41. The AYP Performance and Participation Attribution Map is located on the PDE website: Programs > Programs S-Z > State Assessment System>Pennsylvania Accountability System (PAS) > 2013 AYP Score and Participation Attribution Map A district that has placed a student into an alternate educational setting inside or outside the district is responsible for ensuring the student’s participation in the assessment. Important Information

42. The entity delivering the student’s education is responsible for ordering and receiving materials and administering the test. Know your district’s procedures for Home Schooled students. Testing Cyber Charter School students. Important Information

43. Bubbling booklets may include: Filling in all information (for students who do not have a Precode Label) Demographic information provided on an answer booklet will not override information on a precode label. Please complete certain demographic information after the test has been completed (e.g., economically disadvantaged) And/or Filling in fields that are applicable to the testing situation (i.e., Accommodations) Bubbling booklets

44. Demographic data Assessment Coordinator? Race/ethnicity Economic status Test administrator? Other? Testing situation data Assessment Coordinator? Non-assessed codes Test administrator? Absent without make up Accommodations Other? Assessment Coordinators:Ensure all information is bubbled correctly!

45. Assessment Coordinators: • Training for those who will administer the assessment is required. • Administrators must be a member of the school/district staff. No volunteers. • This PowerPoint is available on PDE website. • Utilize test administrator’s handbook.

46. Students who withdraw/transfer Student withdraws or transfers prior to the start of the testing window • Paper pencil testers – Discard student label • Online testers – Remove student from test session Student begins a test but is completely removed from the school’s enrollments before completing the entire assessment • Paper pencil testers – If the un-enrollment occurs before the end of the testing window, Place a “Do Not Score” label on top of the student label on the booklet • Online testers – Send an email with student information (PAsecureID and School Code) and an explanation to pacustomerservice@datarecognitioncorp.com

47. Encouraging students to meet only the minimum attempt logic may result in meeting the participation rate, but student’s score will be based on only those questions that were answered. Encourage all students to do their best! Encourage students to complete the test

48. Does not negatively affect participation rate: Medical emergency A recentphysical or mental diagnosis that renders a student incapable of participating in the assessment The emergency is occurring at the time of the testing window. Mark the booklet at the time of the testing window! If you’re unsure, CALL!!! ELL student in his/her first year of enrollment in a US school (Reading only) Student participated in the PASA Participation

49. Negatively affects participation rate Extended absence during entire testing window Parental request Other – such as refusal to participate Absent without make-up Failure to meet attempt logic Participation

50. Performance Only students enrolled for a full academic year (on or before October 1, 2012) count towards performance. ALL students must participate in the assessment. Participation Every student enrolled as of the last day of the testing window must take the assessment. Performance vs. Participation