What’s on the TEST? - Unpacking the Idaho Standards Achievement Tests (ISAT)

1. What’s on the TEST?-Unpacking the Idaho Standards Achievement Tests (ISAT)

2. Construct of ISAT • Every item on every ISAT test is directly connected to and drawn from the Idaho Content Standards • Content Standards describe by grade and content area “what students should know and be able to do” • Content Standards are found here: • Weblink: http://www.sde.idaho.gov/site/assessment/ISAT/testDevelopment.htm

3. Standards Structure • Standards: large subsections of content standards for a particular grade/content area. [large branches] Grade 10 Language Usage Example: Standard 5: Writing Components

4. Goals • Goals : Goals are subsets of a standard [small branches] • Example: Standard 5: Writing Components • Goal 5.4: Acquire Skills for Using Conventions

5. Objectives Objectives : Subsets of goals- the finest grained description of skills and knowledge [twigs and leaves]

6. Test Blueprints ….…provide the recipe for constructing ISAT test forms by providing an outline of each form and the % of items drawn from the various Standards and Goals. ISAT Blueprints can be found at this link, along with Content Standards, and Cut scores which determine performance levels: http://www.sde.idaho.gov/site/assessment/ISAT/testDevelopment.htm

7. Example: Gr. 10 Language Usage Blueprint StandardGoalObjective Assessed Distribution 3 Writing Process 3.1Prewrite 3.1.2, 3.1.3,3.1.4 [strand 3a] 58-69% 3.3 Revise 3.3.1, 3.3.2, 3.3.3, 3.3.4 } [strand 3b] 3.4Edit 3.4.2 5 Writing Components 5.3Sentence Structure 5.3.1, 5.3.2 [strand 5a] 31-42% 5.4Conventions 5.4.1, 5.4.2 [strand 5b] Total = 100%

8. Analyzing Student Results: Using the NCLB plus Extender Reports The ISAT has two parts: Part one is the No Child Left Behind Core [NCLB core] All students by grade/content area take these same questions. the core determines student performance level. The second part is a short adaptive piece called the Extender, consisting of 10 to 15 additional questions tailored to the student’s performance on the NCLB core. Combining these two sections allows for finer reporting to the ‘strand’ level by scale score. A ‘strand’ consists of one or more goals and a varying number of objectives [see previous slide].

9. NCLB plus Extender District Summary of School Scale Scores Shows scale score comparison at state, district and school level. Stands are highlighted in Red.

10. NCLB plus Extender School Scale Score Summary • Results disaggregated by AYP subgroups

11. NCLB plus Extender School Student Roster • Results by student, by grade, by scale score

12. Evaluating Student Achievement by Strand Compare individual results to school, district and state average: Language Usage Grade 10 Example: Stud. SS Sch. SS Dist. SS State SS • 3a Prewriting 229 229 229 233 • 3b Revising and Editing 223 228 230 233 • 5a Sentence Structure 226 229 229 230 • 5b Conventions 212 226 227 230 Overall Student LU SS: 223 LU Proficiency Minimum: 226

13. The conventions Strand [5b] score is markedly lower than the other scores compared to school, district and state SS averages. 2 objectives comprise this strand: 5.4.1: Demonstrate in writing the correct use of conventions emphasizing pronoun/antecedent agreement, subject/verb agreement, adjective/adverb usage, verb tense, verbals, appositives, compound-complex sentences, clauses, and parallel structure. 5.4.2: Demonstrate in writing the correct use of punctuation and capitalization Instructional focus in these areas [and in strand 3b] could bolster student achievement, moving the student toward Proficiency. *See slide 5 for content limits for these objectives.

14. Sample ISAT Questions • What do ISAT questions look like for objectives 5.4.1 and 5.4.2? 5.4.1: • Which underlined verb creates an error in subject-verb agreement? • A cook stove and sleeping bag is needed for Marco’s upcoming camping adventure. • The reasons Stantelle is unable to go to the hockey game are too many to count. • After the long campaign, it looks like either Ana or Liz is going to be class president. • Both of Grant’s dogs are active and jump all over you when you walk in the door.

15. Sample Question 5.4.2 • Which sentence has an error in colon usage? • Humans need three basic elements to survive: food, air, and water. • A good pair of work boots should have the following: leather soles, waterproof lining, and deep arch supports. • Gradually add these ingredients to the batter: sifted flour, baking soda, and salt. • Some famous American explorers are: Daniel Boone, Richard Byrd, Jonathan Carver, and Meriwether Lewis.

16. What does the ISAT ‘look’ like… Sample released items, along with score keys, for all content areas can be found at this link in the ISAT Toolbox: http://www.sde.idaho.gov/site/assessment/ISAT/ • Additional information: District Test Coordinators can use the School or District Student Data File [CSV] at the DRC Report site to custom sort all student data and test scores. https://www.drc-web.com/reportdelivery/

17. Idaho Standards Achievement Tests Contact: Scott Cook ISAT Coordinator 208-332-6976 scook@SDE.idaho.gov http://www.sde.idaho.gov/site/assessment/ISAT/ ISAT