CRCT- M Pre-Administration Workshop February 2013

1. CRCT-M Pre-Administration WorkshopFebruary 2013 Webinar Etiquette Please use the Audio Setup Wizard in the Tools Menu to configure and test your audio settings before the presentation begins. To eliminate interference from background noise in your area, please leave the Talk Button on mute. Due to the number of participants, we request that questions be submitted via Chat.

2. Agenda • CRCT-M Overview • Pre-Administration • Testing • Post Test Activities • Reporting • Contact Information • Questions

3. Key Points • Test is only available for students receiving special education services who meet specific CRCT-M eligibility guidelines and whose IEPs reflect this assessment. • Districts were to order CRCT-M test materials during December –January via TestTime. • Remember an eligible student may take the CRCT-M in the subject(s) determined through the eligibility process, but will also participate in the CRCT in science and social studies and for those subjects (Reading, ELA, and Math) for which they were not eligible for CRCT-M.

4. NEW Key Points • Students who achieved Basic Proficiency for 2 consecutive years in the same content area are ineligible for the CRCT-M in that content area for 2013.

5. Key Points • Test materials differ from CRCT • Vendor • CRCT-M : Georgia Center for Assessment (GCA) in Athens, GA • CRCT: CTB/McGraw Hill in Indianapolis, Indiana • Test booklets • Differenttest booklet for each subject • Answer document • Single answer document • Test Examiner’s Manual • Similar to CRCT, but there are differences in text and script • System/School Coordinator Manuals • Arranged like CRCT, but has specifics about GCA material distribution

6. NEW Key Points • System Test Coordinators (STC) can return scorable and non-scorable documents separately and at different times. • Ship scorables to the Georgia Center for Assessment (GCA) as soon as possible after the conclusion of testing. • Once schools have returned all scorable answer documents, the STC may ship to GCA (and we encourage you to do so). • You are not required to wait 5 days to ship for scoring. • The timely return of scorables is critical to the attainment of the necessary representational sample for reporting.

7. Manuals The School and System Test Coordinator’s Manual and the Test Examiner’s Manuals http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/CRCTM-Resources.aspx

8. CRCT-M Overview Will cover the following: • Main Administration • Retest Administration • Exception Testing • Test Construction

9. Main Administration • Main Administration: April 1- May 3 • Eligible students with IEP’s Grades 3-8 • Reading • Mathematics • English/Language Arts

10. Retest Administration • Retest Administration: May 13 – July 26 • Includes students who perform at Level 1 in Reading (grades 3, 5, & 8) or Math (grades 5 & 8) during the Main administration. • Exception Testing • Qualified students who miss the system’s scheduled Retest window may receive an exception to test within the state Retest Administration window. • All requests for exception testing must be approved through the GaDOE.

11. Test Construction • Content Areas • Grades 3-8: Reading, ELA, &Math • A student may take between 1 – 3 CRCT-M tests • Will take CRCT in any content area that is not assessed by CRCT-M • All students will take the CRCT in Science and Social Studies • All items are multiple-choice • There are 10 fewer items than on the CRCT.

12. Test Construction

13. Test Construction • Field Test Items • Help to create a pool of items for future administrations. • Are included with Operational items in all content areas at all grade levels. • Are not reported as part of the student’s score.

14. Pre-Administration Will cover the following: • System Test Coordinator Responsibilities • School Test Coordinator Responsibilities • Receiving Your Materials Shipment • Distribution to Schools • Security • Pre-ID Labels • Coding for GNETS

15. System Test Coordinator Responsibilities • Reviews the Test Coordinator’s Manual (TCM) and Test Examiner’s Manuals (TEM). • Organizes the training sessions for School Test Coordinators. • Receives CRCT-M materials and verifies that all boxes have been received. • Distributes CRCT-M materials to School Test Coordinators. • Please order additional materials as soon as possible.

16. School Test Coordinator Responsibilities • Reviews the Test Coordinator’s Manual (TCM) and Test Examiner’s Manual (TEM). • Organizes training sessions for Test Examiners. • Receives CRCT-M materials from the System Test Coordinator and verifies that all boxes have been received. • Notifies the System Test Coordinator if additional materials are needed.

17. Receiving Your CRCT-M Materials Shipment • System Shipment includes: • System and School Packing List • Shipment Verification Form • System and School Security Checklists • Return Shipping Labels • System Overage materials (see next slide)

18. Overage Materials • System Test Coordinators will use the System overage materials to provide additional materials to those schools that exhaust the School materials. • Group Information Sheets (GIS) • Test Coordinator’s & Test Examiner’s Manuals • Test Booklets and Answer Sheets • Paper bands • Empty cartons

19. Overage Materials • For grades 3 – 8, you will receive an overage of 30% (with a minimum of 2 booklets) at the system level. • System Test Coordinators may order additional materials from GCA. • Extra test booklets will also be sent for Read-alouds.

20. Receiving Your Materials Shipment -Systems • Arrival of test materials • Shipping dates are estimated based on the dates provided through TestTime in December/January. • Test materials will be shipped to systems at least two weeks prior to testing. • Shipping schedule will take into account Spring Breaks. • Complete the System Inventory Checklist • Step-by-step instructions to be completed by the Test Coordinators immediately upon receipt of materials. • System Inventory Checklist provided in the TCM on page 15.

21. Distribution to Schools • School Test Coordinators • Complete the School Inventory Checklist provided in the TCM on page 17. • Boxes are labeled for each School and include: • School Packaging List & School Security Checklist • Group Information Sheets (GIS) • Test Coordinator’s Manuals & Test Examiner’s Manuals • Test booklets & answer sheets • Schools receive an overage of materials • If additional materials are needed, School Test Coordinators contact the System Test Coordinator. • Retain boxes for return shipping

22. Security • All systems must adhere to the 5-day test window. The days must be consecutive and do not include weekends. • Materials must be kept in secure storage before, during, and after testing • Test books remain secure until distributed to Test Examiners on the first day of testing

23. Security • School Test Coordinators use the School Security Checklist to check materials out to Test Examiners. All materials are returned immediately to the School Test Coordinator for secure storage at the end of each day’s testing session. • Each classroom must have adequate staff to monitor testing. • Test Irregularities: Contact GaDOE for instructions. You may be asked to complete the Test Irregularities form online on the MyGaDOE Portal.

24. Pre-ID Labels • Test ID • Transmission instructions for Pre-ID Cycle 3 required that systems use 09 to identify students who will take CRCT-M this spring. • Verify with your FTE Coordinator that your district complied with these instructions.

25. Pre-ID Labels • Pre-ID labels will come with CRCT-M School Test Coordinator Kit. • Two barcode labels for each student come with CRCT-M. • Only 1 label will be used for CRCT-M • Visible information includes: • Student name & GTID • School and System names & codes • Grade • Student DOB and gender • Ethnicity, Race, and PSRC • Barcode number

26. Pre-ID Labels Do not use if inaccurate Barcodes override bubbling

27. Pre-ID Labels • Student information is provided to GCA by GaDOE. If the Pre-ID label is incorrect: • Examiners must notify the School Test Coordinator • School Test Coordinator must update the schools student record • Do not use the label if information is incorrect. • Barcode information will override bubbled information. • When unavailable, information must be bubbled on the answer document. • When bubbling demographic information, fill in the text boxes first, then bubble.

28. Pre-ID Labels • Barcode applied incorrectly • If answers have been gridded: • Transcribe student answers & demographics onto areplacement answer sheet. • Write VOID over the original answer sheet and return it with your non-scorables. • If answers have not been gridded: • Write VOID over the original answer sheet and return it with your non-scorables. • Student transfers • Not applied to an answer document: • Destroy the barcode. • Applied to an answer document: • Write VOID over the original answer sheet and return it with your non-scorables

29. Coding GNETS Programs • In order to receive results for GNETS Programs, an identifier code needs to be bubbled on each student’s answer document in the box marked GNETS. • Codes and instructions are included in the TEM and TCM. Alpine Program 01 Burwell Program 02 Cedarwood Program 03 Coastal Academy Program 04 Coastal GA Comprehensive Academy 05 Mainstay 06 Dekalb-Rockdale Program 07 Elam Alexander Academy 08 Flint Area Learning Center 09 Harrell Learning Center 10 H.A.V.E.N. Academy 11 Heartland Academy 12 Horizon Academy 13 Northstar Educational & Therapeutic Services 14 North Metro Program 15 Northwest Georgia Educational Program 16 Oak Tree 17 GNETS of Oconee 18 Pathways Educational Program 19 River Quest Program 20 Rutland Academy 21 Sand Hills Program 22 South Metro Program 23 Woodhall Program 24

30. CRCT-MAnswer Sheet

31. NEW CRCT-M Retest Answer Sheet

32. TESTING Will cover the following: • Preparation • Administration • Accommodations • Testing in Small Groups • Irregularities

33. Testing Preparation • Remove or cover instructional materials that may prompt student responses. • Arrange seating to promote individual work. • Post a sign on the outside of the classroom door: “Testing: Do Not Disturb.” • One proctor is recommended for up to 30 students and required for more than 30 students • Examiner Materials: • Test Examiner’s Manual • Test Books and Answer Sheets • Scratch paper for math • Two No. 2 pencils with erasers per student • No calculators, unless specified in IEP

34. Test Administration • Students take one content area per day • Prescribed order: Reading, ELA, Math • Both sections from a single content area must be administered the same day. • Students can write in the test books. Highlighters are not allowed. • Students take a stretch break. • Teacher monitoring – “Circulate & Check” to prevent cheating, use of calculators, going ahead, or looking back.

35. Accommodations • Be familiar with accommodations listed in the IEPs. • Accommodations must • be required by the student in order to used during the assessment • be provided during routine instruction and assessment in the classroom • Accommodations may not • alter, explain, simplify, paraphrase, or eliminate any test item, reading passage, or choice option • Provide verbal or other clues or suggestions that hint or give away the correct response to the student • For Large Print and Braille, transcribe student answers on to a regular answer document. • Follow best-practice from Student Assessment Handbook

36. Coding Accommodations • State Required Codes (SRC) • Accommodation Type (Setting, Presentation, Response, Schedule) • Conditional Accommodation • Braille/Large Print • Read-Aloud Guidelines – in TEM • Sample test items for Read-Aloud http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/CRCT-Resources.aspx

37. Coding Accommodations Bubble SRC even if it is included on label; however, if the current SRC is not on the label or does not match, discard the label and bubble all demographic information .. If an Accommodation Type is bubbled; ACCOMMODATIONS must be bubbled also.

38. Coding Accommodations • On each content-area test page • EL Deferred will only appear in Reading and ELA

39. Testing in Small Groups • TheCRCT-M is a test designed for small numbers of students. • Therefore, districts are assigned only 1 form. We have taken care of sampling distribution across forms. • Districts will not receive any special packaging of small group materials. • Because districts receive only 1 form, all test materials can be used for those students who need a special administration of the exam in a small group environment.

40. Irregularities (IR) • Events and circumstances, or departures from standardized testing procedures are irregularities. • They may have an impact on student performance that is not possible to define. • They are reported and student scores are flagged simply to say, “There is something different about the conditions under which this score was obtained. Use caution in interpreting the score.”

41. Irregularities (IR) • All test administration irregularities must be reported by Examiners to the School Test Coordinator. • The School Test Coordinator sends irregularities to the System Test Coordinator for verification and to obtain the correct code. • The System Test Coordinator contacts GaDOE immediately for direction.

42. Irregularities (IR) • If instructed to do so by GaDOE, the System Test Coordinator will investigate and complete the Testing Irregularities Documentation Form provided online on the MyGaDOE Portal. • Improperly coded irregularities will default to the holding of test scores.

43. Examples of Irregularities (IR) • Irregularities in Test Administration: • Materials being distributed inappropriately • Directions not being followed • Improper monitoring of test administration • Incorrect/inappropriate accommodations provided for students

44. Invalidations (INV) • Some irregularities are so serious in the way they affect student performance or compromise the integrity of the testing that they result in an invalidation. • Content being disclosed, coached, or distributed • Cheating • Test Administrator altering responses during or after testing.

45. Participation Invalidation (PIV) • In addition to irregularities (IR) and invalidations (IV), systems will have to code for Participation Invalidations (PIV) for students who receive an accommodation that is not on the list of state-approved accommodations or not on the student’s IEP. • A potential PIV occurs when a student receives an unapproved conditional accommodation such as the reading of the test passages or use of a calculator on the Math test. • Federal regulations stipulate that when inappropriate accommodations are used, students may not be considered participants in accountability calculations.

46. NEW Participation Invalidation (PIV) • A potential PIV will also occur when students who are ineligible to take the CRCT-M are given the test. • CRCT-M mistakenly given instead of the CRCT. • CRCT-M given to students who earned scores at or above 330 (Basic Proficiency: PL3) for two consecutive years. • CRCT-M administered to students who Met or Exceeded Standard on the CRCT in 2012.

47. Coding Irregularities and Invalidations • Incorrect coding may result in no reports being sent.

48. Reducing Irregularities • Ensure proper training of all test administrators • Maintain clear and consistent training and support materials. • Make certain all accommodations are clear to test administrators particularly if the Test Examiner is not the students’ regular teacher. • Make certain that Test Examiners are constantly monitoring the testing environment. • Respond to student actions appropriately and immediately. • Implement a program for reporting irregularities during testing.

49. Characteristics of a Quality Investigation • Examiner should notify Principal and School Test Coordinator of incident. • School Test Coordinator should notify System Test Coordinator. • Request detailed written statements from all parties involved if necessary. • Follow up on details (connect the dots). • Follow district procedures regarding misconduct.

50. Characteristics of a Quality Investigation • Provide a written summary of incident and investigation findings (page 171 SAH). • Provide a written summary of incident and investigation findings. • Consult with GaDOE as needed. • System Test Coordinator is responsible for reporting to GaDOE. • Report to GaDOE immediately, before investigation. • Final documentation should be entered into portal.