2013 Spring DAC Meeting

1. 2013 Spring DAC Meeting

2. Important Things to Know about Testing Hot TESTING topics 2013

3. Hot, Hot, Hot Administration Code and Inclusion of Special Populations regulations are unchanged, 2009 versions still effective. Time Chart revised to incorporate time buffer from 2012. Chart shows times and number of items per grade level and subjects. Student Honor Code – Added to focus on test security. TAM is scripted to direct student review and completion.

4. Hot, Hot, Hot • EOC constructed response (CR) items move to local administration (instead of state) in February 2013. • EOC test is the first time Kentucky has tried to blend a state accountability model with a local school grading model.  The results of the test must support both grading and accountability. • The CR items did not provide feedback and instructional information. EOC CRs did not support local grading. • KDE strongly encourages CR scores be included in the EOC final course grade. ·

5. Hot, Hot, Hot • CRs may be generated and scored locally. QualityCore® resources may be used. • CRs may be administered at a different time than the required multiple-choice sessions. • Local districts and schools will determine how to incorporate the CRs into a student’s final course grade. • KDE will be monitoring inclusion of CRs in its annual EOC survey. • The Kentucky Board of Education may decide in the future to develop regulatory language to require the inclusion of CRs.

6. Hot, Hot, Hot • Agreements with ACT, Inc. and NCS Pearson, Inc. to provide Kentucky assessments are through 2017 spring testing. • KDE is monitoring the development of new assessments; staff participates with the PARCC consortium. • Kentucky schools may be asked to field test by new tests. • KDE, at this time, has NOT committed to use any specific future assessment (i.e., PARCC, SBAC, ACT Aspire™, DLM, NCSC).

7. Key assessment themes require the focus of schools, districts and the state Test security and Data Quality

8. Key Assessment Themes TEST SECURITY—checks and processes to monitor appropriate administration of state-required tests DATA QUALITY—collaborative process between OAA and school/district staff to ensure accurate reporting of test results

9. Test Security • Continues to be a critical issue in Kentucky and nationally. • Loss of certification for Kentucky educators emphasizes the seriousness of the issue. • OAA implements recommendations from Kentucky’s security audit. • A Student Honor Code statement has been added to 2013 Student Response Booklets.

10. Student Honor Code

11. Test Security Required Activities • Appropriate training of regulations—Administration Code and Inclusion of Special Populations (2009 versions) • Signatures on Appropriate Practices Form and Administration Code • Seating charts that reflect everyone in each testing room (adults and students) • Bubbling of testing room location codes by content area tests on student response booklets • DACs collect BAC testing certification and KDE collects DAC testing certification form (provided by KDE, not vendor)

12. Test Security Required Activities Certification Form DACs and BACs • E-mail from KDE/OAA and copy in DAC/BAC manual • Completed at end of year to reflect all testing

13. Test Security State Monitoring • Test window visits • Review of seating charts • Collection of DAC certification forms • Review/audit of randomly collected AAA Folders for alternate assessment students • Analysis of outlier test results by Office of Education Accountability • Analysis by vendors (i.e., erasure and others)

14. Test Security State Monitoring Analysis by vendor can produce multiple types of information/reports at room, school or district levels. • Large score changes for a student • Large mean score increases • Probability of matched response analysis • Previous year’s distribution around scores • Pattern analysis • Comparison of individual student scores by item type

15. Test SecurityReporting of Allegations Get the facts straight. • Record the date and time of the incident. • List all involved (i.e., staff, volunteers, students). • Identify content area and test parts impacted. • Identify specific content question(s), if applicable. • Record what you learn. • Report the incident.

16. Test SecurityReporting of Allegations Support Documents • Testing Allegation Reporting Form • Notarized Statements written and signed by each individual involved (teacher, proctor,BAC, principal and/or others). One statement signed by multiple individuals is notacceptable. • Testing Schedule • Seating Chart and Room Number

17. Test SecurityReporting of Allegations Support Documents • Verification of Administration Code Training • Verify/Proctor Signature Sheet • Nondisclosure Agreement (classified/volunteers) • Student Name & SSID • For an allegation involving special education: • verification of student test accommodation(s). • verification of Inclusion of Special Populations training. • a signed copy of the Code of Ethics, record of testing room and test administrator for allegations regarding alternate assessment.

18. Data Quality • The authoritative source of student data in Kentucky is the state student data system, Infinite Campus (IC). • Data are downloaded from IC for vendors and to populate internal applications (i.e., SDRR). • Accountability requests made to OAA are cross-checked with Infinite Campus.

19. Data Quality Keys to Improved Data Matching • Correct entry of student information in IC is critical (name, date of birth and SSID). • Consistently use the student’s name as it appears in IC on all testing records. • State-testing programs are provided SSIDs.

20. Data Quality KDE/OAA Student Data Review and Reporting (SDRR) Application, organized by test, has two critical data accuracy functions: • Rosters • Required by regulation • Testing information for some tests • Record of accountability for all grades 3-12 • (Grade 9 is needed for PLAN and grade 12 is needed for College/Career Readiness reporting.) • Data Review (cleanup before reporting)

21. Accountability Rules • Tested • Every student enrolled on the first day of the testing window must be tested for participation rate purposes. • Accountable • Accountability determined by full academic year (any 100 instructional days of enrollment).

22. Accountability Rules • Spring K-PREP summative window (last 14 instructional days of district calendar) is the point in time where the 100 days of enrollment (full academic year) is determined. April-June K-PREP (Pearson) Summative Test Window January-February April-May Alternate Assessment September EXPLORE PLAN Across Year K-PREP EOC March ACT

23. Accountability Rules

24. Accountability Terms for Schools • “A1” means a school under administrative control of a principal and eligible to establish a school-based decision-making council. • “A1” school is not an alternative program operated by, or as a part of, another school. • “Alternative” program means all other education programs not classified as A1.

25. Flowchart for Determining Accountability For Students in A1 Schools 2013 Kentucky Performance Rating for Educational Progress (K-PREP) Every student enrolled on the first day of the testing window is tested for participation rate purposes. Accountability is determined by full academic year (any 100 days of enrollment). START Has this student not been in any one school but has been enrolled in adistrict for 100 instructional days this school year? NO Has this student been enrolled in another school for 100 instructional days this school year? NO NO Has this student been enrolled in this school for 100 instructional days this school year? Student scores will count in state’s accountability only. YES YES YES Student scores will count in this school’s accountability. Student scores will count in other school’s accountability. Student scores will count in district’s accountability.

26. Flowchart for Determining Accountability For Students in Alternative Programs 2013 Kentucky Performance Rating for Educational Progress (K-PREP) START: Was the student enrolled in an A1 school in adistrict for 100 days this school year before placement in an alternative program? YES NO Was student placed by a governmental agency or the court system? Accountable to A1 school Was the student enrolled 100 days in the A1(or multiple A1s in adistrict) and alternative program(s) combinedor in the alternative program(s) only? Accountable to A1 school where the student would have attended if not enrolled in the alternative program(s) or to district (if student would have attended multiple A1 schools). NO YES NO YES Accountable to the state Note: A student at Kentucky School for the Blind, Kentucky School for the Deaf or Gatton Academy tracks back to the A1 school that he or she would have attended if not in the alternative program.

27. Student Data Review and Reporting Application SDRR

28. Work in SDRR 2013 Spring Rosters 2013 Data Review EXPLORE (Feb.) PLAN (Feb.) The ACT Alternate Assessment K-PREP End-of-Course (QualityCore) K-PREP (3-8, 10,11) College/Career Ready Data COMPASS The ACT (includes National Test Days) KYOTE WorkKeys KOSSA ASVAB Industry Certificate • ACCESS – (EL) • The ACT – Grade 11 • K-PREP – Grades (3-12) • Pearson • QualityCore- End-of-Course (EOC) Training opportunities for SDRR Rosters and Data Reviews will be announced in a DAC Monday E-mail. TEDS

29. Prioritizing Your Data Review School and districts may review all available student information. OAA encourages focus on these priorities. • Step 1 Accountability(Priority One) • Confirm your 100 day students that will contribute to your district or school accountability. • Indicate any non-100 day students that should be removed from your accountability. • Step 2 Demographics(Priority Two) • Check free-reduced lunch and students with disability status (IEP), since these have potential to change over time. • Confirm ethnicity and race categories.

30. Two Sides of Data Review Student Listing Ticket Listing Use Ticket Listing to Update ticket information Close tickets opened in error Check ticket status Use the Student Listing to check • Accountability • Demographics

31. Accountability Rule – 100 Days

32. Rosters • Everything is organized by test this year in SDRR. • Student Data Tool is no longer available in SDRR but is a part of CIITS.

33. Rosters in SDRR

34. Some data is pre-populated from Infinite Campus K-PREP Rosters • Verify student enrollment in grades 3-12 • Include all students enrolled as of the first day of the testing window • Mark Alternate Assessment and Foreign Exchange, as necessary • Tickets created for: • Foreign Exchange Students – Nonparticipation for K-PREP and EOC • Exempted Students – Medical or Extraordinary Circumstances • Save an electronic version of all rosters

35. Continuous Instructional Improvement Technology System CIITS

36. POC = Instructional Supervisor What is CIITS? • Kentucky academic standards and deconstructed standards searchable by subject and grade • Student level information for each teacher • Administrative level reports • Classroom Interim Assessments created from Item Bank or local teacher/school/district items • Summative and Formative Assessments

37. Assessment Data Proposed Additions K-PREP (includes Lexile & Quantile) KOSSA Stanford 10 Alternate K-PREP Growth ASVAB EXPLORE PLAN ACT WorkKeys School Formative District Formative End-of-Course Industry Certs. NWEA MAP KYOTE In Progress COMPASS Discovery Education ACCESS for ELLs

38. Student Data Tool • Student Data Tool reports will be created and pushed down from state level. • Districts will be capable of: • Modifying reports • Modifying student sets • Training sessions will be recorded.

39. Data Details • MAP – New linking study between MAP and K-PREP by spring 2013. • Discovery Education – No linking, yet, to K-PREP. • State Assessment Individual Student results available in fall 2013. • Career Data – Some available by fall 2013. • New Science Standards available after approval by KBE.