OAKS School Test Coordinator Training

1. OAKS School Test Coordinator Training 2008-2009 Oregon’s Assessment of Knowledge and Skills Oregon Department of Education Office of Assessment and Information Services

2. Goals for Training • Standardize test administration statewide • Ensure test validity & fair testing • Continue to reduce the number of test improprieties • Improve accuracy of student test data • Increase test security and student confidentiality • Make administration of Oregon assessments more efficient for you and your students • Become a qualified Test Administrator

3. Test AdministratorRequirements • Test Administrators are required to read and understand Parts I – VIII of the 2008-09 Test Administration Manual and Appendices A, D, E,Q, R, & T of the manual, as well as all appendices pertaining to those specific assessments which the Test Administrator will be administering. www.ode.state.or.us/go/tam • Test Administrators are required to sign the Test Administrator Assurance of Test Security Form and return to your District Test Coordinator. www.ode.state.or.us/go/testsecurity

4. Your Roles and Responsibilities • Preparations for Testing • Test Security & Student Confidentiality • Test Administration • Completing the Testing Cycle

5. Test Administration Readiness Tests MUST only be administered by personnel who have received proper training, reviewed the appropriate portions of the Test Administration Manual (TAM) AND have signed an Assurance of Test Security Form. Determine which tests students need to take (Part V of the TAM). Remember to check IEPs and 504 Plans – check for necessary test accommodations. Ensure a secure testing environment. Examine the environment for posters, charts or other items not included in the Allowable Resources Table. Remember sample tests are available for OAKS Online and OAKS Paper/Pencil. This gives students an opportunity to become familiar with the test and it gives TAs an opportunity to practice test administration.

6. Student Readiness • Familiarize students with test format by allowing them to take Sample/Practice Tests. • Explain to students that the purpose of the assessment is to “measure your current progress on state content standards” and remind them that “I can’t help you with reading passages, test questions, test answers or formulas”. • Encourage students to “do their best”. • Be prepared that students may have an emotional reaction after being presented with their test score.

7. Test Administration Procedures Student Directions • Review the student directions before testing. • Read the appropriate script to all students verbatim prior to beginning each test. • These are the ONLY instructions you may give to students. Troubleshooting OAKS Online: Contact Stephanie Edens via email with all concerns. She will track issues and coordinate support from district tech, ODE, MESD, etc. in a timely manner.

8. Test Administration Readiness For OAKS Online: Make sure new Browser (released 07/08) is installed: • Available at www.oaks.k12.or.us/browsers Read OAKS Online User Guides: • Available at http://www.ode.state.or.us/search/page/?=391

9. Test Administration Readiness For OAKS Online: • Make sure all your TA’s have accounts in the UMS https://www.oaks.k12.or.us/ums/ • Locate the following information for each student you are testing SSID (Ensure that your SSID information is accurate) Student Legal Name Student’s Enrolled Grade (TAs should verify)

10. OAKS Online Test Administration New for 2008-09 • Default display size and test language can be set by TA before students log in • OAKS Portal – new design, one login • Participation Report • Students can change display size while testing • Highlight and strikethrough features • Keyboard navigation • Reading Passages can be printed • Students may mark a single item in a group of Reading items

11. Printed Passages & Test Security • Do not photocopy, digitize, or enlarge passages. • Each passage must be securely disposed after EACH SESSION. • Test Administrator will be approving printing requests. • Test Administrators must not remind or prompt students to print passages during a test session (unless required by IEP or 504 plan).

12. OAKS Online Demonstration User Guides are at www.ode.state.or.us/search/page/?=391 • Show how to change password in UMS • https://www.oaks.k12.or.us/ums/ • Show how to set up a test session at the training site. www.oaks.k12.or.us/training.html for the OAKS Online Training Site.

13. Test Administration Procedures If a student believes there is a problem with an OAKS Online test item, ask the student to report it using the ‘Comment’ feature. Appropriate response to student questions during testing Use caution: check your verbal and nonverbal cues so that you don’t provide inappropriate coaching that would impact a student’s response to a test item Scoring tests or providing students with any feedback as to how well you believe they are performing is a security breach.

14. Accommodations & Modifications Tables are found in Appendix Q & R of the Test Administration Manual Modifications • A modification is a substantial change in the standard administration of a test. • Scores obtained under modified conditions count as non-participants in calculations of participations. • Modifications should be specified in student’s IEP. Accommodations • An accommodation is a change in how a test is presented to or responded by a student to provide equal opportunity to demonstrate proficiency. • Is considered “standard administration” and students have the opportunity to “meet” or “exceed” standard. • An accommodation offered to a student should be consistent with support provided during instruction.

15. Student Confidentiality • Individual student results must not be made public. • Student test materials/reports MUST NOT be unnecessarily exposed so that student’s names can be identified with student results. • Any misuse of a student’s SSID number is a breach of student confidentiality. • SSID numbers are intended to be secure and MUST NOT be associated with a student’s names or left in an unsecured place. • SSID numbers associated with student names and others identifiers MUST NOT be sent in an email.

16. Test Security • Security procedures are designed to protect the integrity &confidentiality of assessment questions, prompts and problems that are not released for public use; the security of these assessment materials is necessary so they can be used in later years to measure trends in performance. • Test Administration procedures are to assure consistent statewide test administration. • All test items, test materials, and student-level information, both for online and paper tests, are secure documents and must be appropriately handled. Secure handling must protect the integrity, validity, and confidentiality of assessment questions, prompts, and student results. • Test irregularities do not always improve student scores. • Breaches of security, whether through carelessness or intentional mishandling of test materials, could jeopardize licensure for certified and administrative staff.

17. Test Security OAKS Paper/Pencil • All materials must be securely handled and stored in accordance with Part IV of the TAM. • All individuals who have access to testing materials must sign an Assurance of Test Security Form. • Test Administrators should be given test materials on the day of the test administration. • Test Administrators should return test materials to the School Test Coordinator the same day as the test administration.

18. More Test Security OAKS Online • Only students may log in to their OAKS Online or ELPA testing session. Test administrators or other staff or volunteers may not log in using a student’s SSID except when helping a student who is having problems logging in. • All printed passages or scratch paper must be shredded immediately after the test session. • Student information (SSID, name, test scores) must remain secure at all times. • Examples of Testing Improprieties from 2007-08 can be found at www.state.or.us/go/testsecurity

19. More Test Security Testing Environment (OAKS Online or Paper/Pencil) • See 2008-09 Test Administration Manual for allowable resources, posters, charts. • Ensure students are using only allowable resources and all other materials are inaccessible to students or confiscated by Test Administrator. • Visual barriers and/or adequate spacing between students. • Test administrator MUST actively monitor the testing session. • No electronic devices that allow communication among students or the photographing of test content.

20. Even More Test Security Reporting a security breach: • All potential test improprieties or irregularities must be immediately reported to the DTCs (Tim Drilling), even if you are unsure of the exact situation. • DTCs must then submit an initial report for all potential test improprieties or irregularities to ODE within one day of learning of the potential test security breach. • Based on the initial report, ODE may request further investigation by the DTC, in which case the DTC must provide results to ODE within 30 days. • In regard to any potential teacher or administrator violation, DTCs will work within district policy & rules established by TSPC.

21. Policies • Modified and partial assessments will count as nonparticipants in calculations of participation. • For OAKS Online, test resets will not be allowed. Any assessment administered will count as one of the three test opportunities available to students even if it wasmodified in error. • Targeting down is not allowed. • Targeting up is allowed. However, 8th graders must take the 8th grade test. They can take the 10th grade as well. • To count as a partial test, students must submit <5 responses on OAKS Online and <10 on OAKS paper/pencil. • OAKS Paper/Pencil tests are available to individual students on IEPs or 504 plans and individual students documented by the District.

22. Completing the Testing Cycle • Be sure students successfully log off their computers. • As soon as a student completes a test, the student may view their test results. • Test scores will be made available to via the OAKS Online reports. • https://www.oaks.k12.or.us/reports/

23. Test scores will be made available to via the OAKS Online reports. • https://www.oaks.k12.or.us/reports/ • We will plan another workshop on how to access test scores through eSIS, data warehouse, and other district data sources.

24. Completing the Testing Cycle • Watch deadlines for returning paper/pencil testing materials. • Paper/pencil materials not shipped on time will count as non-participants in calculations of AYP participation.

25. Questions? • Contact your District Test Coordinator Tim Drilling’s Office: 503-618-2810 • Contact your Regional Assessment Support Partner http://www.ode.state.or.us/teachlearn/testing/oaks/esdpartners0809.pdf Thank you!