NECAP Test Administration Workshop Grades 3–8 & 11

1. NECAP Test Administration WorkshopGrades 3–8 & 11 Dates: September 3, 4, 9, & 11, 2008 New Hampshire Department of Education and Measured Progress

2. Part One 3-4 Responses to Frequently Asked Questions During Workshops 5-7 Contact Information 8 Purpose of Workshop 9 NH’s 2008-2009 Testing Schedule Fall NECAP Important Dates New to NECAP This Year New to NH This Year 13 Student Participation in NECAP 14 Which Content Areas Should Be Included in NH-Alt Portfolios State-Approved Special Considerations Accommodations 18-22 Math Test Design 23-26 Reading Test Design 27-29 Writing Test Design 30-33 Preparing Students for NECAP 34-35 Use of Optional Report Fields 36 School Test Coordinator Responsibilities 37-38 Test Security 39 Breaches in Test Security Part Two 42-49 Accommodations and Modifications 50-54 Scheduling Test Sessions 55 Test Materials 56-62 Student Labels 63-65 Preparing Student Test and Answer Booklets 66 Prior to Test Administration 67 Preparing Test Administrators 68 During Testing – Monitoring for Correct Administration 69-71 Students Who Move During Testing 72 After Testing – Preparing Test Material for Return 73-75 Verifying Student Information on Student Answer Booklets Principal’s Certification of Proper Test Administration 77 Principal/Test Coordinator Questionnaire Preparing Test Materials for Return to MP 79 Shipping Test Material Back to MP 80 NECAP Resource Materials Available on the NHDoE Website 81 NECAP, GLE, & GSE Support Table of Contents Please refer to page numbers while within the Power Point application – I could not get page numbers to print over the presentation template.

3. Responses to Frequently Asked Questions during workshops • Students in grade 3 and 4 may write in their test booklet • Students may ask for single words to be read aloud in mathematics and writing • E Other accommodations MUST be approved by Gaye Fedorchak (gfedorchak@ed.state.nh.us). Non-approved E Other accommodations will be treated in the same was as F modifications and will result in minimum scores being assigned. • State-approved special considerations include medical exemptions and a death in the family. A form to request this status is available on the NHDoE website. Contact Tim Kurtz (TKurtz@ed.state.nh.us) should you have questions. • In general, if a student did not complete an alternate assessment last year, then the student must participate in NECAP this October. • Exchange students in grade 11 do not need to participate (enrollment status11). If they do, we will issue a parent report, but scores will not be rolled up into school, district, or state reports. • Grade level is determine solely by the Beginning of Year (BOY) file. • Do not share test materials or labels between schools. • Graph paper may be used in Sessions II and III of the mathematics test.

4. Responses to Frequently Asked Questions during workshops – page 2 Your questions go here…

5. Tim Kurtz Office of Curriculum and Assessment Phone: (603) 271-3846 E-Mail: TKurtz@ed.state.nh.us Gaye Fedorchak Alternate Assessment & Accommodations Supervisor Phone: (603) 271-7383 E-Mail: GFedorchak@ed.state.nh.us Susan Morgan Access for ELLs®Specialist Phone: (603) 271-3719 E-Mail: SMorgan@ed.state.nh.us Jiffi Rainie Contact for NHSWADL NH Statewide Assessment Distribution List Phone: (603) 271-7450 E-mail: Jennifer.Rainie@ed.state.nh.us NH DOE Staff Contacts for NECAP Information Position open at this time. English/Language Arts Supervisor Phone: (603) 271-2035 E-mail: Position open at this time. Mathematics Supervisor Phone: (603) 271-3844 E-Mail: Jan McLaughlin Science Coordinator Phone: (603) 271-3856 E-Mail: JMcLaughlin@ed.state.nh.us Deb Fleurant Bias and Sensitivity and Title I Phone: (603) 271-3838 E-mail: DFleurant@ed.state.nh.us

6. Harold Stephens: NECAP Program Director Phone - 1-603-749-9102 ext. 2235 E-mail – Stephens.Harold@measuredprogress.org Amanda Smith: NECAP Program Manager Phone - 1-603-749-9102 ext. 2259 E-mail – Smith.Amanda@measuredprogress.org Elliot Scharff: NECAP Program Manager Phone - 1-603-749-9102 ext. 2126 E-mail – Scharff.Elliot@measuredprogress.org Measured Progress Service Center 1-877-632-7774

7. Mellicent Friddell: NECAP Program Assistant Phone - 1-603-749-9102 ext. 2355 E-mail – Friddell.Mellicent@measuredprogress.org Tina Haley: NECAP Program Assistant Phone - 1-603-749-9102 ext. 2427 E-mail – Haley.Cristina@measuredprogress.org Kellie Beaulieu: NECAP Program Assistant Phone - 1-603-749-9102 ext. 2156 E-mail – Beaulieu.Kellie@measuredprogress.org Measured Progress Service Center 1-877-632-7774

8. The purpose of this workshop is to ensure that… • Students and staff are prepared for a positive and productive assessment experience. • Standardized testing procedures are consistent across all schools. • Accommodations are provided appropriately for students who need them. • Secure Test Materials remain secure at all times. • Test materials are returned according to specifications to expedite the return of test results. • Test Coordinators and Test Administrators are prepared to carry out all of their responsibilities. Please Note: The workshop will be presented in two parts, the first for everyone and the second for new test coordinators or experienced test coordinators who would like a review.

9. New Hampshire’s 2008-2009 Testing Schedule* September 08-09 NH-Alt Assessment participation decisions made by IEP teams (connected to May 2009 NECAP Science test and October 2009 NECAP test) October 1–23: NECAP Reading, Writing, and Mathematics Testing in grades 3-8 & 11 (NECAP test materials picked up on October 24) November 7: 07-08 NH-Alt portfolios and reports sent to districts (connected to May 2008 NECAP Science test and October 2008 NECAP test) January 12 – Feb. 27: ACCESS Testing for ELL Students K-12 January 21 (tentative) : Release of October 2008 NECAP results for grades 3-8 & 11 April 17: Last day to enter evidence into 08-09 NH-Alt portfolio (NH-Alt portfolios picked up on May 8) May 11–28: NECAP Science testing in grades 4, 8, & 11 (test materials picked up on May 29) * See http://www.ed.state.nh.us/education/doe/organization/accountability/documents/TestCoordinatorMemo08-09v3.0.pdf

10. Fall NECAP Important Dates: September 17–21: Test materials and Student ID Labels shipped to schools October 3: Last day to request Other Accommodations (E) October 3 (noon): Last day to order additional labels Contact: i4seehelp@ed.state.nh.us October 1–23: Test administration window October 23: Last day to request Medical Exemptions (State Special Consideration) October 24: UPS pick-up of test materials at schools for return to Measured Progress (materials need to be ready at 8 AM)

11. New to NECAP This Year • New to NECAP page added to Manual • Online Principal’s Certification of Proper Test Administration (see page 22 of the manual for more details) • Online Principal/Test Coordinator Questionnaire (see page 22 of the manual for more details) • Frequently Asked Questions (see Appendix D in the manual) • Removal of theAlternate Assessment bubble from page 2 of the Student Answer Booklet – Do NOT turn in booklets for student who participated in NH-Alt during 2007-2008. • Line for student’s name added in the upper left-hand corner of the front cover of the Student Answer Booklet • Writing Planning Box – reformatted at Grade 11 to be reminders – will not be scored. • For students with two test booklets, we can now merge across sessions within a content area. Test form numbers should be the same. • If you want a foreign exchange students or a NH-Alt student to try out the test, please contact Tim Kurtz. Parent letters will be issued, but results will not be rolled into school, district, or state reports.

12. New to NH This Year • Updated NH Medical Exemptions form for 2008-2009* • NH Participation Guidelines for 2008-2009* • Most out-of-district students will be included in accountability reporting this year. So, be sure you make sure all OOD students are tested. *See: http://www.ed.state.nh.us/education/doe/organization/curriculum/NECAP/2008NECAPMaterialsandInformationPage.htm

13. Who should be tested*(page 3) Before Testing Student Participation in October NECAP • All students enrolled in the school (grades 3, 4, 5, 6, 7, 8, or 11) as of October 1, 2008. • Exceptions are students who… • Completed a May 2008 NH-Alt portfolio representing learning and progress during the 2007–2008 school year. NECAP answer booklets should not to be returned for these students. • Are English Language Learners new to the U.S. after October 1, 2007 who take the ACCESS test of English language proficiency. They do not have to take the Reading and Writing tests. They must take the Mathematics test (and the spring Science test). • Qualify for state-approved special considerations • * See: http://www.ed.state.nh.us/education/doe/organization/curriculum/NECAP/2008NECAPMaterialsandInformationPage.htm

14. NH-Alternate Assessment:Who Takes What and When? Where can I get more info on NH-Alt? Go online to: www.ed.state.nh.us/assessment. Then choose “NH-Alternate Assessment”.

15. NH State-Approved Special Considerations: • Students can be excused from assessment for certain medical emergency conditions, which may include: • A serious and fully incapacitating medical emergency or condition that extends across the entire test window • Acute illness or recovery from a serious injury that is fully incapacitating and extends across entire test window (Students with broken arms can usually participate with accommodations.) • A recent death in the family Conditions that do not qualify: • Chronic medical fragility, or • Acute illness or injury that does not extend across entire test window. Missed test sessions can be made up. Rule of Thumb:If the student can receive instruction, the student can participate in state assessment. Medical Emergency Forms and Procedural Information are available online. (Go to www.ed.state.nh.us/assessment, then choose “NECAP”, then “Fall 2008-09 Materials and Information”.) For questions contact Tim Kurtz.

16. How should students be tested with October NECAP* Before Testing Accommodations • All students are eligible for accommodations. • Refer to the NECAP document: “Accommodations: Guidelines, and Procedures - NH 2008” • You will need to plan for: • Accommodation Team decision making time • Training staff to administer accommodation • Scheduling students, staffing, and rooms • * See: http://www.ed.state.nh.us/education/doe/organization/curriculum/NECAP/2008NECAPMaterialsandInformationPage.htm

17. NECAP Test Design: Structure of Content Area Tests

18. Illustrating Distribution of Emphasis (PSSM, 2000)

19. Distribution of Emphasis for Mathematics * 2(3) indicates end-of-grade 2 GLEs are tested at the beginning of grade 3

20. 16 multiple choice(one point each) Mathematics Grades 3 & 4 Test Design Three 45-minute sessions (Schedule 90 minutes each)* Session INo Calculator or tools Session IICalculator and tool active Session IIICalculator and tool active 12 multiple choice(one point each) 16 multiple choice(one point each) 5 Short Answer(one point each) 4 Short Answer(one point each) 4 Short Answer(one point each) 6 Short Answer(two points each) 4 Short Answer(two points each) 3 Short Answer(two points each) *All students are allowed an additional 45 minutes without an accommodation. Additionally, extended time accommodations are available for all students and must be made prior to testing.

21. Mathematics Grades 5-8 Test Design Three 45-minute sessions (Schedule 90 minutes each)* Session INo Calculator or tools Session IICalculator and tool active Session IIICalculator and tool active 13 multiple choice(one point each) 14 multiple choice(one point each) 14 multiple choice(one point each) 3 Short Answer(one point each) 3 Short Answer(one point each) 3 Short Answer(one point each) 3 Short Answer(two points each) 3 Short Answer(two points each) 3 Short Answer(two points each) 2 Constructed Response(four points each) 2 Constructed Response(four points each) 2 Constructed Response(four points each) *All students are allowed an additional 45 minutes without an accommodation. Additionally, extended time accommodations are available for all students and must be made prior to testing.

22. Mathematics Test Design Grade 11 Two 60-Minute Sessions (Schedule 90 minutes each)* Session INo Calculator or tools Session IICalculator and tool active 16 multiple choice(one point each) 16 multiple choice(one point each) 8 Short Answer(one point each) 8 Short Answer(one point each) 4 Short Answer and 3 Constructed Response(alternating withtwo points each for SA and four points each for CR) 4 Short Answer and 3 Constructed Response(alternating withtwo points each for SA and four points each for CR) *All students are allowed an additional 30 minutes without an accommodation. Additionally, extended time accommodations are available for all students and must be made prior to testing (true for mathematics, reading, and writing).

23. Distribution of Emphasis for Reading *2 (3) indicates end-of-grade 2 GLEs are tested at the beginning of grade 3

24. Short Reading Passage 2 stand-alone vocabulary multiple choice (1pt) 1 Literary or Informational passage 4 multiple choice questions (1 pt) 1 constructed response question (4 pts) Long Reading Passage 1 Literary or informational passage 8 multiple choice questions (1 pt) 2 constructed response questions (4pts) All Text is Authentic Literary passages include poetry, traditional narratives, and modern narratives. Informational passages include content areas and practical text. Reading Test Design Grades 3-8: Same design for each of the three 45-minute sessions (Schedule 90 minutes each session)* *Students are allowed an additional 45-minutes per session without an accommodation.

25. Short Reading Passage Short Reading Passage Long Reading Passage Reading Test Design Grade 11 Session 1: Literary and Informational 60-Minute Session (Schedule 90 minutes)* 6 stand-alone vocabulary multiple choice (1 pt) 1 Literary or informational passage 8 multiple choice questions (1 pt) 2 constructed response questions (4pts) 1 Literary or Informational passage 4 multiple choice questions (1 pt) 1 constructed response question (4 pts) 1 Literary or Informational passage 4 multiple choice questions (1 pt) 1 constructed response question (4 pts) *Students are allowed an additional 30-minutes per session without an accommodation.

26. Reading Test Design Grade 11 Session 2: Literary and Informational 60-Minute Session (Schedule 90 minutes)* Short Reading Passage Long Reading Passage Long Reading Passage 1 Literary or informational passage 8 multiple choice questions (1 pt) 2 constructed response questions (4pts) 1 Literary or informational passage 8 multiple choice questions (1 pt) 2 constructed response questions (4pts) 1 Literary or Informational passage 4 multiple choice questions (1 pt) 1 constructed response question (4 pts) *Students are allowed an additional 30-minutes per session without an accommodation.

27. Distribution of Emphasis for Writing * 2(3) indicates end-of-grade 2 GLEs are tested at the beginning of grade 3

28. Writing Test Design Grades 5 and 8 Two 45-minute sessions at grades 5 and 8 (Schedule 90 minutes each)* Session I Session II 10 Multiple Choice (1 pt): Conventions & Structures May have response to text stimulus Prompt Scored Planning Box (3 pts) - may be used to plan or to check writing Extended Response (12 pts): 5th Grade response to literary text OR response to informational text OR report OR narrative 8th Grade response to literary text OR response to informational text OR report OR persuasive Constructed Response (4 pts) 1st of 3 not in Session II Constructed Response (4 pts) 2nd of 3 not in Session II Constructed Response (4 pts) 3rd of 3 not in Session II *Students are allowed an additional 45-minutes per session without an accommodation.

29. May have response to text stimulus May have response to text stimulus Prompt Prompt Planning Reminders - may be used to plan or check writing Planning Reminders - may be used to plan or to check writing • Extended Response (12 pts): • response to literary or informational text; OR • expressive writing; OR • Informational writing • Extended Response (12 pts): • response to literary or informational text; OR • expressive writing; OR • Informational writing Writing Test Design Grade 11 Two 60-minute sessions (Schedule 90 minutes each)* Session I Session II *Students are allowed an additional 30-minutes per session without an accommodation.

30. Discussion and Recommendations: Preparing Students and Staff for a Successful NECAP Experience Discussion Topics: • Preparing students for testing • Introducing the test to students • Encouraging appropriate participation • Scheduling sessions • Scheduling staff • Providing accommodations • Using the optional reports codes • Other ideas, strategies, issues and options

31. Test Preparation:What is supported by research? Langer, J.A. (2001) American Educational Research Journal Studied two approaches… 1) Treated test preparation as a separate activity, involving practice tests and test taking hints. 2) Integrated test preparation with the curriculum by analyzing test demands and reformulating curriculum as needed to be sure that students would develop the knowledge and skills needed for strong performance on tests.

32. Test Preparation:What is supported by research? • Findings… • Low performing schools treated tests as an additional hurdle separated from curriculum – • implemented the first approach • High performing schools had teachers and administrators who deconstructed and analyzed test items and content standards – • implemented the second approach and obtained higher levels of literacy.

33. Our suggestions for the use of Practice Tests, Released Items, and Teacher Tips 1) Practice Tests are most useful for familiarizing students with test format, item types, and test taking strategies. 2) Released Items are most useful when they are embedded in relevant instructional content throughout the school year. 3) Released student work samples and scoring materials can be used to illustrate and discuss more and less successful responses to test questions. 4) Released items and released student work samples can be used to examine possible student misconceptions. 5) Share the information from the Teacher Tips document. The best test preparation is good teaching and building a positive learning environment in the classroom.

34. Using the Optional Reports Codes: • For districts and schools to group students for analysis at the local level • Groupings based on any factor of interest to the school/district (e.g. class, teacher, feeder school, instructional program) • Six rows = six factors of interest per student • No more than one circle bubbled per row • Schools/districts develop their own coding system or choose not to use field • Keep a record of the key used (NH DOE and MP will not have copies of your key) • Data is included in the student-level data file of NECAP results (district-level). No actual “report” is produced.

36. School Test Coordinator’s Responsibilities (page 2 in your manual) Primary responsibilities: • serve as the school’s contact person with Measured Progress, • ensure that any required additional student labels are ordered, • coordinate all test-related activities, • prepare test administrators to administer NECAP according to directions in the Test Administrator Manual, • observe and monitor test administration in your school, • oversee the inventory, distribution, collection, and return of ALL test materials, and • overall, help the principal maintain test security and ensure compliance with test administration procedures. Help teachers create an environment that will motivate students to do their best.

37. Test Security (page 2) • Test Security relies on the professional integrity of everyone in our schools across all three states. No student should be advantaged or disadvantaged based on how or where the test is administered. • All Student Test Booklets and Student Answer Booklets are secure and may not be copied or duplicated in any way or kept by the school after testing is completed. • Using secure test material to prepare students in any way for this test administration is a violation of test security and testing procedure.

38. Test Security Procedures • Ensure that all school staff who will be involved with the assessment understand the importance of test security and adherence to standard test administration procedures. This includes special educators and special education assistants. • Keep testing materials in a locked location when not in use. Do not remove testing materials from the school. • Inventory test booklets when they arrive at your school. Keep an on-going inventory of materials as they are distributed and returned each day. Although not required, it may be beneficial to have test administrators sign tests in and out each day. • Never leave students alone with testing materials. Do not allow students to carry test materials unescorted from room to room. • Complete and submit the principal’s affirmation of test security document. Keep a copy on file.

39. Breaches in Test Security • Teachers must report any concerns about breaches in test security to the test coordinator and/or principal. • The test coordinator/principal is then responsible for reporting breaches to the district superintendent and to Tim Kurtz at the NH DOE (603-271-3846).

40. End of Workshop Part One

41. Checklists for Principals and Test Coordinators(page iii) • Before Testing • During Testing • After Testing

42. Determining How Students Will Participate Using Accommodations (page 4) Student Participation and Accommodations Accommodations: Guidelines and Procedures – NH 2008 covers these topics: • Determining how students will participate using accommodations • Documenting and bubbling in accommodation codes

43. Accommodations Who is eligible for testing accommodations? ALL students

44. Accommodations • Accommodations do not change what we expect students to know and be able to do. • Test accommodations are based on individual student needs and classroom assessment practice; they are not for the use by an entire classroom or category of students. • They should not give students unfair advantages; rather they are meant to remove barriers that may exist due to a student’s learning style or disability. • Test administrators must be trained in their use. This includes special education assistants and substitutes. • Students should have experience using the accommodation(s). Preferably, they should be accommodations the student uses in day-to-day classroom instruction and assessment.

45. Appendix FTable of Standard Test Accommodations (Page 33)

46. Accommodations Accommodations: Guidelines and Procedures – NH 2008 • Available at www.ed.state.nh.us/assessment. • Using the Table of Standard Test Accommodations, school teams may choose in advance, and use without state approval, any standard accommodation listed in categories A, B, C, or D. • After testing is finished, all accommodations actually used during testing must be recorded on page 2 of the Student Answer Booklet.

47. Accommodations (page 4) Requests for the use of Other Accommodations (E) • Contact NH DOE (Gaye Fedorchak) for permission in advance of testing. • Accommodation(s) must be consistent with those used in student’s regular classroom or student has experience using the accommodation prior to the assessment. • If the requested accommodation is found to be comparable to a standard accommodation, written approval will be given. • Student work done using category A, B, C, D, or approved E accommodations will be fully credited and scored.

48. Modifications(page 4) • If state review determines that your request for an other accommodation will change what the test measures, the state will respond in writing that use of this procedure will produce a test “modification” and must therefore be coded as a “Modification (F)” • Use of a “Modification (F)” will result in no credit given for student work during test sessions in which this modification was used. • Any “Other” Accommodation not registered as “approved” by the NH DOE will be treated as a “Modification (F)”.

49. Accommodations • Expanded information, guidance and forms for choosing, planning, requesting, and using accommodations is available at: www.ed.state.nh.us/assessment in a printable manual called: Accommodations: Guidelines and Procedures – NH 2008Form: Request for Use of Other Accommodations Contact: Gaye Fedorchak at: gfedorchak@ed.state.nh.us or call (603) 271-7383 for more information. • Due Date: October 3, 2008.

50. Scheduling Test Sessions (page 5) • All testing, including accommodated sessions and make-up sessions, must occur within the testing window (October 1 — October 23, 2008). • Test sessions must be scheduled and given in the order presented in the student’s test booklet. • Make-up testing may begin as soon as a student returns to or enters a school. • All grade level classrooms in the school must follow the same testing schedule. To the extent possible, districts should coordinate testing in order to avoid possible breaches in test security. Schools do not need to report their testing schedule to the NH DOE.