Miami-Dade County Public SchoolsOctober 2, 2013 Test Chairperson’s Orientation
Agenda • Morning Session • Resources for Test Chairs • 2013-14 Testing Calendar • Accountability Update • Test Security, Reporting Violations, and Responding to State Inquiries • Updates to the Testing Programs • Afternoon Session • Using the Thinkgate Technology Platform for Interim Assessments
All about you . . . • Type of school • Charter: 53 • Non-Charter: 252 • Other roles • 156 Assistant principals • 70 Teachers • 25 Counselors/Advisors • 36 Academic Coaches • 69 “Other” • Number of years as test chair • Minimum: 1 • Maximum: 28 • Mean: 5.27 Full results on the Test Chairperson’s Webpage
Resources for Test Chairs Helpful links: • Assessment, Research, and Data Analysis • http://oada.dadeschools.net • Test Chair information page • http://oada.dadeschools.net/TestChairInfo/InfoForTestChair.asp • Mentors for new test chairs • Email Kathy Sierra: • email@example.com
Accountability Update Gisela Feild
Test Security, Reporting Violations, and Responding to State Inquiries Dr. Sally A. Shay
Security • Standards, Guidelines, and Procedures for Test Administration and Test Security available at http://oada.dadeschools.net/TestChairInfo/InfoForTestChair.asp • General guidelines adopted by School Board • Florida Test Security Statute and Rule
Caveon Data Forensics • The FLDOE has contracted with Caveon Test Security to provide its Caveon Data Forensics™ for all statewide assessments. • Caveon will analyze data to identify highly unusual test results for two primary groups: • Students with extremely similar test responses; and • Schools with improbable levels of similarity, gains and/or erasures. • Flagging only the most extreme results.
Most Powerful & “Credible” Statistic Measures degree of similarity between two or more test instances Analyze each test instance against all other test instances in the school Possible causes of extremely high similarity: Answer Copying Test Coaching Proxy Test Taking Collusion • Similarity
Based on estimated answer changing rates from: Wrong-to-Right Anything-to-Wrong Find answer sheets with unusual WtR answers Extreme statistical outliers could involve tampering, “panic cheating”, etc. • Erasures Important! No student–level score invalidations based on erasure analysis; erasure analysis limited to school-level flagging for additional review.
Florida Comprehensive Assessment Test (FCAT 2.0) and End-of-Course (EOC) Assessments Maria C. Bruguera, Director I Mara Ugando, Staff Specialist
What’s New? • FCAT Mathematics Retake (2009-10 cohort and earlier) discontinued • Spring 2013 was the last administration • Students must earn a concordant score on the ACT or SAT • Civics End-of-Course Assessment • Administered in Spring 2014 and beyond • One 160-minute session (students may request additional time, if needed)
CBT Assessments: FCAT 2.0 • In 2013-14, the following assessments will be computer-based only [with paper-based versions for students whose individual education plans (IEPs) or Section 504 plans indicate this accommodation]: • FCAT 2.0 – Two 70-minute sessions (completed over two days) • Grade 5 Mathematics • Grade 6 Mathematics (completed in one day) • Grade 6 Reading • Grade 7 Reading • Grade 8 Reading • Grade 9 Reading • Grade 10 Reading • Reading Retake (two sessions of up to ½ of a typical school day)
CBT Assessments: EOC • In 2013-14, the following assessments will be computer-based only [with paper-based versions for students whose individual education plans (IEPs) or Section 504 plans indicate this accommodation]: • End-of-Course – 160+ minutes • Algebra 1 • Biology 1 • Geometry • U.S. History • Civics
Who takes the EOCs? Algebra 1 Geometry, Biology 1, US History • Currently enrolled in spring administration only • Students who failed • Scores invalidated/no score • Virtual 80% complete and recent completers • Adult 80% complete and recent completers • New entries • Currently enrolled in spring administration only • Scores invalidated/no score • Virtual 80% complete and recent completers • Adult 80% complete
New entries to take Algebra 1 EOC • Private schools, out-of-state, out-of-country • Transcripts for students entering with Algebra 1 credit must be reviewed to determine if they have passed an applicable standardized test in lieu of the Florida Algebra 1 EOC. • Schools must submit a transcript via HEAT (Dropdown menu – Foreign Student Records), type EOC Algebra 1 in service request box for a determination. • Coordinate with counseling department to identify these students on entry in order to verify testing status. • For questions, contact Charlene Burks, Administrative Director, Federal & State Compliance Office at firstname.lastname@example.org.
Online Certification Tool • The Certification Tool is to be completed by each school that will administer computer-based assessment(s) in Spring 2014. • Six Sections to complete online: • I. Computer Specifications • II. Student Scheduling Plan • III. Annual Checklist • IV. Administration – Specific Checklist • V. School Computer-Based Assessment Team • VI. Submit to District Office • A webcast training will be posted in January 2014 to provide specific details regarding the completion of the tool.
Infrastructure Trial • The Infrastructure Trial simulates a computer-based test using mock test items that will allow schools to test hardware and network capacity prior to the CBT operational administration. • It should take approximately thirty minutes for users to log in, supply random answers, and submit the test. • Please note that the content of the test used for the Infrastructure Trial is NOT intended for student practice. • Schools must set up the Trial to use all computers scheduled to be used concurrently during each CBT administration. • The Infrastructure Trial is managed in the Training Center. • TestHear accommodated forms are available for the Infrastructure Trial. These forms are larger (50 MB) than regular TestNav forms (2 MB).
Paper Accommodations • Paper-based versions of the CBT assessments will be provided only for students with disabilities that have Individual Educational Plans (IEP)s or Section 504 plans that indicate that the student requires paper-based tests as an accommodation. • IEP’s or Section 504 accommodations should indicate that a student must test on paper if any of the following conditions apply to a student: • Requires an accommodation that cannot be implemented in conjunction with a computer-based administration (e.g., student requires a specialized setting or uses adaptive furniture that cannot accommodate a computer workstation); • Requires an accommodated CBT form that is not available online; • Has a flexible scheduling/extended time accommodation that requires testing one session over more than one day; or • Is Hospital/Homebound. Please note: Large print on paper is considered Unique Accommodation for CBT assessments and must be approved by the FLDOE.
District Level Certification Form • Current policy states that individuals who handle secure materials for statewide assessments (FCAT2.0/EOC) must have state- or district-level teaching certifications. • If there are instances in which a non-certified person will assist the test chairperson with preparing test materials, the District-Level Certification Form must be completed and submitted for approval. • Refer to Weekly Briefing #14536
Common Core Assessments • In 2014-15, Common Core Assessments summative assessments will replace current FCAT 2.0 and EOC tests currently being administered in Writing, Reading, and Mathematics. • Current Florida assessments in non-Common Core content areas will remain in place: • FCAT 2.0 Science in Grades 5 & 8 • Biology 1 EOC assessment • US History EOC assessment • Civics EOC assessment • Retakes for Grade 10 Reading and EOCs as required for graduation
Test Requirements: Standard Diploma Recommending that all EOC results contribute 30% to final course grade going forward.
Test Requirements: Scholar and Merit Designation • In addition to meeting the standard high school diploma requirements: • Merit Designation: requires attainment of one or more industry certifications in addition to meeting the standard high school diploma requirements.
Changes: Implications for Students re. SB 1076 • Algebra 1 • All students in cohort 11-12 and beyond must take and pass the test • EOC score contributes 30% to final course grade • Geometry, Biology 1, US History, and Civics • EOC score contributes 30% to final course grade • Advisory panel is reviewing options for applying EOC score • Will be communicated to schools via Weekly Briefing and students via the Student Portal
New Testing Platforms Thinkgate Florida Item Bank and Test Platform (IBTP)
Florida Item Bank and Test Platform (IBTP) – School Net • Thinkgate PLATFORM • Miami-Dade • Deliver Baseline, Fall, and Winter Interim Assessments • Teacher –made tests All Florida school districts Construct and deliver assessments using Florida item banks PURPOSE Test forms and item bank for content areas tested on FCAT and EOC Future: “gap” courses Items aligned to CC and NGSSS Standards Core: ELA, Math, Science, Social Studies, Spanish Non-Core: Health/PE, Visual and Performing Arts, World Languages, Career/Tech CONTENT Item tryouts and field test in 2013-14 AVAILABLE Roll out October 2013 Available for statewide use in 2014-15
Florida Item Bank and Test Platform (IBTP) Kathleen Sierra, Supervisor
SB 736 – Student Success Act Require at least 50 percent of a school administrator and a classroom teacher’s performance evaluation be based upon student learning growth assessed annually by statewide assessments or, for subjects and grade levels not measured by statewide assessments, by school district assessments.
SB 736 – Student Success Act (cont.) • The bill revises s. 1008.22, F.S., student assessment program for public schools, to: Require school districts to administer student assessments that measure mastery of course content for each course offered, beginning the 2014-2015 school year. Assessments may include: • Statewide assessments; • Other standardized assessments including nationally recognized standardized assessments; • Industry certification examinations; and • District-developed or district-selected EOC assessments
Florida Item Bank and Test Platform (IBTP) • Funded through the Race to the Top (RttT) Grant – Three Year Project • Goals of the Initiative • Develop high quality, standards-based assessments in non-core content areas • Provide Florida public and charter school districts with an extensive bank of assessment items • High Quality, standards-based • Field tested • Vetted by Florida Educators • Once Item bank is fully operational, Florida Districts, schools, and teachers will access to the bank to generate assessments to meet their needs.
IBTP – Core Subject Areas IBTP Core • Item Bank will include test items for 54 grades/subjects • Common Core: • English/Language Arts K-12 • Math K-8 • Algebra I, Geometry, Algebra II • Next Generation Sunshine State Standards: • Science K-8 • Biology, Earth/Space, Chemistry, Physics • World History, US History, American Government, Economics • Spanish: Beginning, Intermediate, Advanced
IBTP – non-Core Subject Areas Item Bank will include items for 150 non-Core courses • Test items will be available for selected courses in: • Physical Education K-12 • Health Education K-12 • Performing Arts • Chorus, Drama, Band, and Instrumental • Visual Arts K-12 • World Languages • French, German, Italian, Latin, and American Sign Language • Career and Technical Education (CTE)
IBTP Core and non-Core Item Tryouts Purpose of Tryout: • Evaluate the test deliver system • Trouble shoot administrative procedures • Gather observational data related to the student’s ability (especially in the primary grade levels) to complete a computer-based assessment • Gather basic item level statistics
IBTP Core Content Item Tryouts • October 14 – November 8, 2013 • Selected schools: • Each region selected representative elementary, middle, and senior high schools • Selected grade levels and subject areas • Computer-based Tests • Multiple choice and short answer items
IBTP non-Core Content Item Tryouts • November 4-22, 2013 • 10 school have been selected that offer the targeted courses • Selected grade levels and subject areas • Computer-based Tests • Multiple choice and short answer items
IBTP non-Core Content Item Field Test • March 10 – April 4, 2014 • Selected schools • Selected grade levels and subject areas • Computer-based Tests • multiple choice • short answer items, and • performance task items
Stanford Achievement Test, Tenth Edition (SAT-10) • Mayda Cabeza, Director I
SAT-10 • What is the SAT-10? • Who is administered the SAT-10? • Grades K - 2, districtwide • Important dates to remember • April 7-11, 2014
SAT-10 • How do SAT-10 materials arrive to schools? • Is the SAT-10 a secure test? • SAT-10 Test Chairperson Training • (February 2014) • School level training of test administrators and proctors • Test Administration • Untimed
SAT-10 Results • School Listing of Results (June) • Must be picked up at ITS • Individual Student Reports (August) • Delivered to schools • Results • Not available on the Parent Portal • Posted to SPI under the tab FCAT Scores • Uses • Referral of students to the district’s gifted program • Early identification of students who would be considered at high risk for problems associated with reading comprehension
Grade 3 Opportunities for Promotion • Section 1008.25, Florida Statutes (F.S.), Eliminating Social Promotion. • Spring FCAT 2.0 Reading • Spring Grade 3 Reading Student Portfolio • Alternative Standardized Reading Assessment (ASRA)—ITBS, Level 9, administered the last two weeks of school • Alternative Assessment for Grade 3 Promotion (AAGTP)—SAT-10, Primary 3, administered in Summer School • Grade 3 Mid-Year Promotion (GTMYP)—ITBS, Level 10, administered in November
Grade 3 Reading Student Portfolio • Administered during the 2nd semester • Participants: All grade 3 students complete a portfolio • Scored at the school site • Represents the 2nd opportunity for a student to be promoted to grade 4 • Student must demonstrate mastery of the benchmarks • Training conducted via Screencast
Alternative Standardized Reading Assessment (ASRA) • Administered the last two weeks of schools. • Participants: • Students scoring FCAT 2.0 Reading level 1 , students who did not participate in the Spring FCAT, and • students without a passing Reading Portfolio • Represents the 3rd and last opportunity within the school year prior to retention. • This administration of the ITBS, Level 9 is locally scored therefore results are available immediately. • Students must score at or above a given cut score on the ITBS to be considered for promotion. • Training conducted via Screencast