Transformative Technology Based Alternate Assessment The Three I’s ISAT-Alt, I-PASS & Instruction

1. Transformative Technology Based Alternate AssessmentThe Three I’s ISAT-Alt, I-PASS & Instruction Slide 1 Idaho State Department of Education Division of Assessment

2. Welcome to Idaho Alternate Assessment Training! Please pause this presentation and print the following manual and documents prior to attending this webinar. • ISAT-Alt Manual • Idaho Alternate Assessment Eligibility/Participation Guidelines • Accommodation Guidelines • Assistive Technology Handbook – Idaho Assistive Technology Project • Family Notification Letters (English and Spanish) • Classroom Data Collection Form

3. Changes for 2010-2011 Manuals Revised – Consolidated three manuals into One Manual for the ISAT-Alt and One Quick Guide for I-PASS Revised Eligibility Guidelines - (No DMA, DWA, IRI-Alt added either SAM (Student Centered Assessment Measure or the Core Phonics) Revised Accommodations Guidelines – NAEP Added – ALLOWABLE ACCOMODATIONS DO NOT MATCH ACROSS ASSESSMENTS – List separately on IEP or attach Accommodations form to IEP ISAT-Alt Administration Begins October 15, 2010

4. Changes for 2010-2011 Cont. • ISAT-Alt Submission Date – I-PASS online November 15, 2010 to All student evidence uploaded by March 1, 2011 • IRI – Alt – Pilot last year. This year spring administration only. Two IRI-Alt assessments; either SAM (Student Centered Assessment Measure or the Core Phonics) Posted on ITC midyear. • Elimination of I-PASS Baseline Data - for returning students it is ISAT-Alt score from 2010 • Additional Complexity Levels – Additional Level for Math and Science for a Total of 4 to allow for participation of wider range of student cognitive abilities • Individual Student Reports – Available Late October Online – Print out and send home and/or share at IEP meetings.

5. ISAT-Alt and I-PASS (Individual Portfolio Artifact Submission System)Idaho’s GSEG GRANT IMPLEMENTATION Utilized Federal Department of Education grant funds The ISAT-Alt was developed in response to a federal peer review First in Nation Digital ePortfolio for Alternate Assessment Behavior Imaging Solutions in Boise Idaho – Co-created I-PASS w SDE IT and Assessment Divisions Internet Based HEPPA and FERPA secure data management Teachers upload - Video, Digital Photo, Scanned, Faxed & Saved student evidence of learning of the extended content objectives assessed. I-PASS ePortfolios-Customized Student’s Assessment Needs – Content Area Folders - Evidence of Learning (ECO) Extended Content Area Objectives ISAT-Alt Submission, Rangefinding, Scoring and Standards Setting accomplished online I-PASS Media Gallery and libraries contain classroom data, assessment materials, as well as online training videos Developed during the Summer and Fall of 2009 culminating with the launch of I-PASS upload of ISAT-Alt artifacts during May and June of 2010.

6. Robust Technology Implementation Alternate Assessment4 Components 1. Online Alternate Assessment Learning Community Idaho Training Clearinghouse is the host. Includes; Announcements, Forms, Guidelines, FAQ, Webinar, Podcast, ISAT-Alt Manual, I-PASS Quick guide 2. ISAT-Alt ePortfolio Online - I-PASS 3. Online Field Review – Survey Monkey, excel data driven decisions and revisions based upon field surveys 4. Digital Data Collection – Excel for Accommodations & an Excel Data Collection Sheet for a uniform baseline http://itcnew.idahotc.com/dnn/alternate-assessment.aspx

7. Enhanced Student Data Management • Capacity Improved Handles Large Volumes of Data – Eliminated the alternative which was the submission of 6,000 paper based content area portfolios saving on shipping, handling and contracted scoring. • Digital Process Eliminates Paper • Administrative Monitoring of all processes – custom permission levels for Admins (local, district and state) • Improved Secure Online Individual, District and State Reporting – • $$ & Time Savings –Reduced Costs of Alternate Assessment by at least 1/2 • Rangefinding – Snapshot – 400 Pieces of Evidence Scored in 3 hours! • Scoring – Snapshot – More than 142,000 artifacts scored online by Idaho educators!

8. Former IAA – Rating Scale • Teacher Checklists • No Student Evidence Submitted • Teacher Scored • Reading and Mathematics Only • No Science

9. Benefits of Technology Integrated Assessment Meets Individual Student Needs Transforms Paper into Digital Media Files Provides for Professional Collaboration Teacher Training and Induction Communication to Families and Service Providers Learning Communities Libraries of Exemplars Research Data – Longitudinal and Case Study National Model – Cost Savings in Labor and Time Slide 33

10. Documents Page 3 Documents include: • ISAT-Alt Eligibility/Participation Guidelines • Accommodations Guidelines for Instruction and All Federal and State Assessments (Excel) • ISAT-Alt Portfolio Manual (Includes Assessment, Collection & Submission) • Idaho Training Clearinghouse Assistive Technology Resource Guide • Quick Guide to I-PASS (Individual Portfolio Artifact Submission System)- How to Use the online portal • Family Notification Letters (English and Spanish) • Classroom Data Collection (Excel) All Documents found on the Idaho Training Clearinghouse Alternate Assessment Learning Community at; http://itcnew.idahotc.com/dnn/alternate-assessment.aspx

11. Contents of This Webinar Page 5 Webinar Content • ISAT-Alt Manual • Assistive Technology Resources • Computers for Kids • Education and Training • Instructional Ties to Alternate Assessment Project Plans

12. ISAT-Alt Manual Chapter OneISAT-AltGuidelines and Procedures Page 7 Overview of the ISAT- Alt • Idaho State Department of Education and the State Board of Education • Single Statewide Assessment System for all Idaho public schools and all students • Individuals with Disabilities Education Act of 1997 (IDEA-97) - mandated that every student with a disability participates in statewide and local assessments with or without accommodations or on an alternate assessment. • No Child Left Behind Act of 2001 (NCLB) - requires statewide assessment of all students in grades 3-8 and at least one high school grade annually in: Reading, Language Usage, and Mathematics. • The ISAT and ISAT-Alt • grades 3-10 in Mathematics, Reading and Language Usage • grades 5, 7, and 10 Science

13. 2010-11 ISAT-Alt Schedule of ActivitiesPage 9

14. Alternate Assessment Eligibility/Participation GuidelinesPage 10 in Manual and 125-126 Appendix

15. Participation Page 13 • Grade Level Determinations for Participation • Participation of Students Who Transfer Enrollment • Participation of Students Who Transfer Within State

16. Participation Cont. Pages 14- 15 • Participation of Students Who Transfer In from Out of State • Participation of Students Receiving Home and Hospital Instruction • Excusing Students fromParticipation - Medical Excuse ONLY • SEF Upload Note for District Test Coordinators • Participation of Students from Other States Attending Special Placement Schools in Idaho

17. Content Standards – The Foundation of Assessment Page 16 Idaho Extended Content Standards - grade-level specific - clear link to general education curriculum (i.e., the Idaho Content Standards) Links academic instruction and learning to grade level content through extended standards Content reduced in complexity or modified through the extended content standards Based on grade-level academic skills Achievement standards (Standards Assessed) reflect different expectation for proficiency Combination of extended grade-level content standards and alternate achievement standards Promotes access to general education curriculum Based on individual learning needs and capabilities

18. How to Read the Asssessed Extended Content Standard Tables Pages 16 & 17 Reading Example

19. Who Administers the ISAT-Alt and Collects the Assessment Artifacts? Page 19 Assessment Task Administrators Include; • General education teacher - teaching content • Special education teacher - teaching content • Speech and Language Pathologist - using content • Paraprofessional - under the supervision of a certified teacher Note – Paraprofessionals may also assist by uploading the data into I-PASS through assigned temporary password.

20. ISAT-Alt Summary of Elements & Portfolio Contents Pages 20-22

23. Items NOT Scoreable or Acceptable as Artifacts for SubmissionPage 22 • Items NOT Scoreable or Acceptable as Artifacts for Submission: • Evidence (Artifacts) (data sheets, documents, video or photos) that have any visible identifying information such as student first and last name, school, or school district) • Checklists (except for sight words) • Data sheets (except for sight words) • Single photograph of the student performing the work on the objective without evidence of student work or description of the task. • Narrative descriptions of the student demonstrating the objective without actual evidence of student work • Any entry that does not contain all of the required components and data • Blank sheet of paper • Statement student is unable to perform the task

24. ISAT-Alt Scoring Participation Table

25. Scoring of PortfoliosAccuracy Page 23 • Each entry in the student’s portfolio will be scored on three dimensions: Level of Accuracy Level of Independence Level of Complexity • A summary of the levels for each scoring dimension is shown on the next slides.

26. Scoring Continued Scoring process starts at the teacher level. Two entries for each assessed objective. Teacher provides scores on each dimension for each entry in the portfolio including; Complexity, Independence & Accuracy. Teacher scores are entered into I-PASS via drop down menus. Final scores are assigned to portfolio online by 2 trained scorers. If 2 scores are within one point (adjacent) scores are recorded. If 2 scores vary by more than one point portfolio is directed to a third scorer. I-PASS system records the highest of the 2 scored entries as the final score

27. Scoring of Portfolios Levels of Accuracy

28. Scoring of PortfoliosIndependence Page 24

29. Accommodations Page 25 • IEP Team Decision – Use Accommodations Guidelines Excel found online on ITC • Accommodations MUST be designated and used in both instruction and prior to assessment (not just on the assessment) • Accommodations are NOT consistent across all assessments so should be designated individually for each assessment • Assistive Technology – Must be “considered” annually

30. Accommodations Guidelines Excel http://itcnew.idahotc.com/dnn/iaa/AADocuments.aspx

33. Assistive Technology Page 25 According to IDEA regulations, all accommodations necessary to facilitate participation in state mandated assessment must be provided and assistive technology considered during the annual IEP meeting. Resources for Teachers Idaho Training Clearinghouse Assistive Technology Learning Community – Training and Information

34. Idaho Assistive Technology Handbook Assistive Technology Resource Guide download and print

35. http://www.idahoat.org/dnn/ FREE AT EVLAUATION Nora Jehn Training Coordinator Idaho Assistive Technology Project University of Idaho Center on Disabilities and Human Development 121 W. Sweet Ave.26 Moscow, ID 83843 208-885-6112 800-432-8324 Idaho Assistive Technology Project

36. https://www.idaho.at4all.com/ Idaho Assistive Technology For All

37. Using the Three Scoring Dimensions TogetherPage 27 • Three scores will be multiplied = total entry score. • Astudent who receives a • 3 for Accuracy • 3 for Independence • 3 for Complexity will receive an entry score of • 27 (3 x 3 x 3) Content area score (e.g., in Mathematics) will be the total (sum) of each of the entry scores that the student received on five assessed objectives.

38. Using the Three Scoring Dimensions Together Cont. Mathematics Complexity 3 Independence 4 Accuracy 4 # Objectives Assessed = 5 Highest Mathematics Score Possible Calculation 3 x 4 x 4 x 5 = 240 Mathematics Proficiency Levels Advanced 181-240 Proficient 112-180 Partially Proficient 36-111 Emerging 0-35

39. I-PASS Brief Introduction Complete Training Found on ITC under Quick Guide to I-PASS Page 27 https://apps.sde.idaho.gov/ipass

40. Quick Start Guide to I-PASSBrief IntroductionSeparate Manual and Training Specifically for I-PASS I-PASS Available Online 11-15 Download Quick Start Guide from ITC AA Learning Community Step by Step User Guide & Podcast

41. Idaho Portfolio Artifact Submission System (I-PASS) Page 27What will I see?I-PASS Log In SDE BI- Care Class Screen Media Gallery General Info Library Student Assessment Folders

42. More Information and Separate Training on I-PASS found in the Quick Guide to I-PASSHelp Is Available 24-7! Online Training Videos Online Searchable Knowledge Base Phone & Email Technical Support Behavior Imaging Technologies World Class Service!!

43. Eliminates Manually Filling Out More than 60 Pieces of Paperwork Per Student!Online Drop Down Keyword Menus Designate Scores Complexity Independence Accuracy Automatic Notification Folder is Complete!

44. District Test Coordinators & Contacts Page 28 The District Test Coordinator (DTC) is the central point of contact • For Online Searchable Database of information-how to use functions in the I-PASS Class View: Visit the Knowledge Base home. (control click) & search topics • For I-PASS Classroom View Folders and System Technical Online Support: Behavior Imaging Solutions Technologies for B.I. CARE Email: support@caringtechnologies.com Phone: 1-888-355-7161 • For Forgot Password: A password reset application now exists at the URL below. https://apps.sde.idaho.gov/account Clicking on the “Lost Password” link will give the user a page to fill out their email address and have a password reset email sent to them. • For I-PASS website access questions contact: Cathy Salas Administrative Assistant/Program Specialist, Assessment Division Idaho State Department of Education Email: csalas@sde.idaho.gov For ISAT-Alt administration, collection of evidence for ISAT-Alt, information for I-PASS, please contact: Email: cscholz@sde.idaho.gov (Quickest Response) Carol Scholz, M.Ed. Alternate Assessment Coordinator Idaho State Department of Education

45. Professional Expectations Training Page 29 • Training – Attend Virtual Training Via Archived Webinar • Read and Understand all documents, manuals and guidelines • Follow Guidelines for Eligibility and Accommodations Designation • Consider Assistive Technology

46. Code of Ethics and Security of Assessment Materials Page 30 • Do not share your I-PASS password • Issue temporary password to paraprofessionals via I-PASS for specific length of time – directions in the Quick Guide • Keep all assessment results secure in locked file cabinet

47. Chapter Two ISAT-Alt Assessment Pages 31 - 122 Idaho Extended Content Objectives (ECO’s) Required for the ISAT-Alt Assessment (All content areas consist of FOUR levels of complexity) • Mathematics: 5 Assessed ECO’s • Reading: 5 Assessed ECO’s • Language Usage: 3 Assessed ECO’s Grades 3, 4,5,6,7,8,9 & 10 (Including 9th) • Science: 5 Assessed ECO’s Grades 5, 7 and 10 Only (NOT Including 9th)

48. Example of Assessment ProcessMathematics - Grades 3, 4 & 5 page 33 Assessment Steps • Choose Five Items (tasks) One/Objective According to Grade Level & Complexity/Student. • Begin by choosing the grade level of the student found on the left side of the rubric. • Choose the highest level of complexity possible with the lowest level of supports and highest level of independence. • Collect baseline data at the classroom level. • Teach the concept. • Collect two artifacts per task. (5x2=10 total for Mathematics including; video, 4 digital photos cut and pasted onto a Word doc, scanned or faxed student work) • Compress Video prior to submission. Directions found in the I-PASS Quick Guide. • Submit into I-PASS by March 1, 2011.

49. Collecting Classroom Instructional Ideas, Supports and Ideas for Assistive Technology (Not Required for submission use for classroom reference) Page 35

50. Sample Page of the Assessment Chapter Two Page 36