Welcome to CRT Materials and Administration OPI Assessment and Test Administration Conference Helena, MT January 28-29

1. Welcome to CRT Materials and Administration OPI Assessment and Test Administration Conference Helena, MT January 28-29, 2010

2. Introduction Dan Verdick Project Manager for the Montana CRT Measured Progress Contact at: 800-431-8901 ext. 2220 dverdick@measuredprogress.org

3. Administration Dates* CRT - Alternate February 9 � March 24, 2010 CRT March 1 � 24, 2010 (*See page 3 of the 2010 Test Coordinators Manual)

4. Overview of Presentation Updates Important Resources Measured Progress Packing/Shipping System/School Receiving Administration Returning material to MP Reporting

5. FYI� Two Shipments: Shipment 1 �delivered to system offices February 5-10. Material will consist of CRT training CD and administration manuals and all CRT- Alternate testing material. Shipment 2 � delivered to system offices February 18-25. Boxes will be addressed to schools and contain all CRT testing material. There will be no system boxes in this shipment Test Administration Manuals One manual for all grades. Specific instructions for certain grades are indented and italicized. Reminder: Monday, March 15 is the first day of Day Light Savings time. Some schools choose not to test on this day. Shipment 1 2010 CRT Test Administration Manual 1 per system, 1 per school 2010 CRT Test Coordinator�s Manual 1 per system, 1 per school Shipment 1 2010 CRT Test Administration Manual 1 per system, 1 per school 2010 CRT Test Coordinator�s Manual 1 per system, 1 per school

6. What�s New Enhanced accommodations documentation produced by OPI Answer Booklets � no more bubbles on page 2 for LEP, NSA, NDAY and Alt Test now consists of 4 forms rather than 8 No automatic pick up of test materials. All test material must be shipped on or before March 30 PDF files of the Student Report will be included on Mars

7. Most Frequently asked Questions and topics from 2009 �I received a shipment but I did not receive anything for grade____.� Measured Progress packs and ships by grade, thus sometimes you may not receive all of your testing materials on the same day. We received a lot of calls like this last year. Additional Materials Due to timing, Measured Progress cannot estimate your actual needs at the time of testing. Additional materials can be ordered online or by calling the Montana Service Center directly. Read aloud accommodations Measured Progress received many calls concerning this topic. Test administrators are encouraged to consult OPI�s 2010 Accommodation Manual or contact OPI directly. �May I return the Alt with the regular CRT?� Yes, you may but it is preferred that you return it separately to expedite scoring. �May I return all my grade�s answer documents in the same box?� We encourage systems and schools to return materials separately by school and grade. This practice not only expedites scoring when the material is received but also enhances our ability to track shipments and monitor the return of the testing materials. �May I return multiple school�s materials in the same box?� We discourage this practice. It takes away our ability to track shipments by school. Measured Progress�s receiving system is designed to receive a box for each school and grade that was shipped. When materials are mixed, it requires a large degree of manual intervention which increases costs and delays scoring.

8. Important Resources Montana Office of Public Instruction (OPI) Judy Snow � (406) 444-3656 Measured Progress Montana Service Center CRT Danielle Hornsby - (888) 792-2741 Nancy Hall � (888) 792-2741 CRT-Alternate Tim Greenlaw � (800) 431-8901 ext. 2309 Other important phone numbers are listed on page1 of the 2010 Test Coordinators Manual (TCM)

9. OPI Assessment Website http://www.opi.mt.gov Access the JUMP newsletter http://www.opi.mt.gov/curriculum/MontCAS/#p7GPc1_6 Download manuals and forms http://www.opi.mt.gov/curriculum/MontCAS/#p7GPc1_8 Accommodation Guidance Memo for the Spring 2010 CRT 2010 Accommodation Manual 2010 OPI List of Approved Accommodations 2010 Accommodations PowerPoint 2010 Guidelines and Procedures for Test Security 2010 Test Security Guidelines PowerPoint 2010 Test Security Information for Teachers 2010 Test Coordinators Manual 2010 Test Administrators Manual Voided and Unused Barcode Label Form

10. Measured Progress iServices To access iServices go to http://iServices/, select �Montana� or �Montana Alternate� from the drop down menu and then select a service. From the Montana iServices homepage you may: Register for upcoming CRT and CRT-Alternate development meetings Download additional forms and manuals Access the online reporting system (MARS) Order additional testing material Request a UPS pickup for the return of your testing material Order Large Print Test Booklets iServices is online tool supported by Measured Progress to assist Montana Systems and schools administer the CRT and CRT � Alternate. iServices is online tool supported by Measured Progress to assist Montana Systems and schools administer the CRT and CRT � Alternate.

11. Montana iServices Home Page http://iservices/

12. Measured Progress Packing Shipping information received from OPI in the fall. AIM enrollment data received from OPI on Feb 2, 2010 (label file) Test materials quantities determined by enrollment plus overage Materials are packed by grade and by school. All material is shipped to system offices Test booklets assigned a unique barcode for tracking purposes

13. Shipping/Receiving Materials will be shipped to systems on Feb 12, 2010 via UPS UPS is a third party carrier If you have not received test materials by February 24 call Measured Progress (888) 792-2741 System Inventory* Verify that you have boxes for all schools/grades in your system? Systems distribute boxes to schools School Inventory* Open boxes and inventory contents immediately Verify that the quantities you received match the quantities listed on materials summary sheet *Inventory process may vary between systems

14. Additional Materials Additional Materials may be ordered only if you have already received a shipment. To order materials you will need the schools MP Ship Code. This code may be found on the Materials Summary Form. Additional CRT test booklets, Student Response Booklets, and CRT- Alternate Testing material may be ordered via iServices from February 19 � March 23 Additional large print test booklets are ordered as an additional material on the iServices page, orders received after March 10 will not be processed. Additional shipping materials may be ordered Feb 19 � March 30. Additional manuals and forms can be downloaded from OPI�s website or iServices

16. CRT Test Administration  March 1 � March 24, 2010 Prior to Testing Identify students to be tested be sure students are enrolled at your school and that your student information system is current (AIM) Identify students who will be taking the CRT-Alternate (see page12-15 in the 2010 Test Coordinators Manual) Identify students with accommodations Have a testing plan in place If a student tests with any accommodation it is important that that information is coded properly on the student response booklet. If a student tests with any accommodation it is important that that information is coded properly on the student response booklet.

17. What�s Inside the CRT School Boxes? Memo Materials Summary Student labels � sorted by grade, teacher, student Form for voided and unused barcode labels Test Administrators Manuals (TAM) Special Handling Envelope UPS ground label for returning test booklets �For Return of Used Answer Documents� envelope Flat box with pre-affixed UPS 2Day RS label for returning used student response booklets Test booklets (large print & Braille) Answer Documents Data for the Student Labels was collected in January, if you do not have label for student you will need to bubble the appropriate information on the Student Response Booklet. Data for the Student Labels was collected in January, if you do not have label for student you will need to bubble the appropriate information on the Student Response Booklet.

18. Student LabelsExample of Students Barcode Label

19. Student Labels and Label usage Label Data was extracted from AIM. All students enrolled at your school in AIM on March 29, 2010 will be included If the Student ID is correct, use the label even if you find other student information on the label that is incorrect, (i.e. misspelled name or wrong grade.) All errors should be reported to the AIM staff at OPI If you did not receive a label for a student you must bubble Boxes A, B, D & E on page1 of the Answer Booklet (see p.18-20 of the 2010 Test Administrators Manual) Teacher information was also included in the January extract. If a teacher name was included in the AIM �sortby� field this will be printed on the label Updates, additions and deletions to student information can be made in AIM until March 26 to ensure the accurate reporting of participation and assessment results* * Reporting errors that are identified as the result of improper coding in AIM or on the Student Answer Booklet will not be rectified in MARS. Any errors identified as the result of improper handling by Measured Progress will be fixed and results will be re-posted on MARS

20. Voided and Unused Barcode Label form One form will be included in each school/grade shipment (this form may be copied or downloaded) All unused student labels should be affixed to this form - check the appropriate box or write a brief explanation as why it was not used The form is school specific but not grade specific, thus multiple grades can be included on one form (in some cases only one form may be needed per school) Return the form (loose) in any grades �Used Answer Document� box. (see page 29 of TCM)

21. Example of Voided and Unused Barcode Label Form The Voided and Unused Barcode Label Form is a 2 page form to used to identify those students who you received a barcode label for but did not test at your school for whatever reason. Students from multiple grades may be listed on this form. This form needs to be returned with any grades Used Answer Documents in the �For Return of Used Answer Documents� Box. The Voided and Unused Barcode Label Form is a 2 page form to used to identify those students who you received a barcode label for but did not test at your school for whatever reason. Students from multiple grades may be listed on this form. This form needs to be returned with any grades Used Answer Documents in the �For Return of Used Answer Documents� Box.

22. Student Answer Booklets Page 1 bubbling Label vs. no label Grade 3 Combined Test Booklet/Answer Booklet Grade 4-8 &10 Test Booklet Form Number Use of markers and highlighters Encouraged as long as the area to be bubbled is left unmarked

24. Student Answer Booklets Page 2 bubbling Section 1 Student not enrolled (i.e. homeschooled) Student enrolled less that 180 hours and taking a reading or mathematics course Section 2 Accommodations (for more information see page 13-17 of the TCM and OPI�s 2010 Accommodations Manual ) Section 3 Must be completed by the test coordinator for participating private and non-accredited schools

26. Post Administration  March 1 � March 24, 2010 After Testing Collect materials and verify that you have an answer booklet for each student tested Inventory Test Booklets OPI requires that all test booklets be returned to Measured Progress Make sure that the answers for students who used a large print test booklet have been bubbled into the Answer Booklet that was included with it Verify that each Student Answer Booklet has a barcode label or has the appropriate name and Student ID bubbled on page 1 Check page 2 for appropriate coding It is suggested that you collect test booklets and Student Response Booklets separately and to count them prior to dismissing the students from the testing area. All Test Booklets received from Measured Progress must be returned to Measured Progress after testingIt is suggested that you collect test booklets and Student Response Booklets separately and to count them prior to dismissing the students from the testing area. All Test Booklets received from Measured Progress must be returned to Measured Progress after testing

27. Returning Test Materials to Measured Progress It is never too early to return materials! Two shipping methods for materials UPS 2nd Day Air - Student Response Booklets/Answer Documents Label is pre-affixed to the grade specific �For Return of Used Answer Document� boxes UPS Ground � All other �secure� testing materials Secure testing materials are all the test booklets and unused Student Response Booklets/Answer Documents Ground labels were included with testing material. Please remove the original shipping label and place the UPS Return Service label on the original shipping containers . In each grades shipment you received school and grade specific return materials. Please remember to keep materials separated by grade. Answer documents not received by MP by April 3 will delay the release of state wide results on June 2. In each grades shipment you received school and grade specific return materials. Please remember to keep materials separated by grade. Answer documents not received by MP by April 3 will delay the release of state wide results on June 2.

28. Returning Test Materials to Measured Progress(see page 28-30 of TCM for more detailed instructions) Student Response Booklets and other documentation Place your used Student Response Booklets into the grade specific �For Return of Used Student Answer Documents� envelope Booklets that have been soiled or are unscannable should be placed in the �Special Handling� envelope Complete the Voided or Unused Barcode Label Form (if necessary) Sign OPI security documentation Put all the above into the �Return of Used Answer Documents� Box and ship to Measured Progress no later than March 30. Return to Measured Progress via UPS Option 1 � use iServices to arrange next day pick-up Option 2 � Call UPS directly to arrange a pick-up Option 3 � (not listed in TCM) give pre-labeled boxes to any UPS driver

29. Returning Test Materials to Measured Progress(see page 28-30 of TCM for more detailed instructions) Test Booklets Put all test booklets into the boxes, seal and apply the UPS ground labels that you received in the initial shipment Return to Measured Progress via UPS Option 1 � use iServices to arrange next day pick-up Option 2 � Call UPS directly to arrange a pick-up Option 3 � (not listed in TCM) give pre-labeled boxes to any UPS driver All test materials must be shipped on March 30, 2010. Answer Booklets not received by Measured Progress by April 1, 2010 will delay the release of state wide results on May 28 UPS pick-up may be arranged up to 48 hours in advance. Please have your materials ready for when the driver arrives. If Ups does not arrive as scheduled contact Measured Progress immediately. Answer documents not received by MP by April 3 will delay the release of state wide results on June 2. On Monday, March 31 MP will track all MT RS labels those systems showing no active labels will have pick-ups arranged for Tuesday, April 1. UPS pick-up may be arranged up to 48 hours in advance. Please have your materials ready for when the driver arrives. If Ups does not arrive as scheduled contact Measured Progress immediately. Answer documents not received by MP by April 3 will delay the release of state wide results on June 2. On Monday, March 31 MP will track all MT RS labels those systems showing no active labels will have pick-ups arranged for Tuesday, April 1.

30. Reporting Montana Analysis and Reporting System (MARS) Assessment results will be reported on May 28 Access MARS via the iServices website http://iServices/ Passwords will remain the same Password information may only be obtained from OPI New password requests are to be through OPI Parent letters and labels will be shipped the first week of September PDF files of the parent letters will be posted on the reporting side of MARS

31. Questions?