Test Chairpersons’ Orientation Miami-Dade County Public Schools September 27, 2012
Agenda • General Session (8:15 – 11:30 a.m.) • Welcome • Dr. Sally A. Shay, Student Assessment • Accountability: School Grades and Annual Yearly Progress • Gisela Feild, and Vilma Rubiera, Assessment, Research, and Data Analysis • 2012-13 Testing Calendar • Updates to the Testing Programs • VPK Assessment • Dr. San Juanita de la Cruz, Early Childhood Education
Agenda • General Session (Continued) • Test Security, Reporting Violations, and Responding to State Inquiries • District Investigations: • Detective Louis Nunez, Miami-Dade School Police • General Session (12:30 – 1:30 p.m.) • Introduction to File Download Manager • Tiffany Davis, American Senior High School and Betty Viada, Miami Lakes Educational Center
Agenda • Breakout Sessions (1:45 – 3:30 p.m.) • Test Chair 101: Basics on preparing test materials • Zulema Lamazares, Henry Flagler Elementary • Edusoft: Testing Platform for Baseline and Interim Assessments • Rudy Azcuy, Instructional Technology • On-line CELLA: Administration for ESOL Placement • Deland Innocent, Bilingual/World Languages
Accountability Gisela Feild, Administrative Director, Assessment, Research and Data Analysis and Vilma Rubiera, Project Manager, Data Analysis
2012-13 Testing Calendar http://oada.dadeschools.net/TestingCalendar/TestingCalendar.asp
Florida Comprehensive Assessment Test (FCAT/FCAT 2.0) and End-of-Course (EOC) Assessments Next Generation Sunshine State Standards (NGSSS) Maria C. Bruguera, Director I Mara Ugando, Staff Specialist
FCAT 2.0 and EOC Updates • Phasing in FCAT 2.0 Writing • Phasing-in FCAT 2.0 Reading computer-based test (CBT) in Grades 7 and 9 • Phasing in FCAT 2.0 Mathematics computer-based test (CBT) in Grade 5 • FCAT (SSS) Reading Retake (graduation test) will not longer be offered in the 2012-13 school year and beyond. • Civics End-of-Course (EOC) will be field tested in selected middle schools
EOC Requirements • EOC Requirements based on cohort year: • Algebra 1, Biology 1, and Geometry EOC Assessments will be administered in grades 6 -12, to enrolled students in an eligible courses in winter, spring, and summer. • Grade 9 students in 2012-13 and younger: must pass the Algebra 1, Biology 1, and Geometry EOC assessments to earn high school credit. • Grade 9 in 2011-12 (Grade 10 students): must pass the Algebra 1 EOC to earn high school credit. In addition, the Biology 1 and Geometry EOC scores will count as 30% of the final course grade. • Grade 9 in 2010-11 (Grade 11 students): the Algebra 1 EOC score will count as 30% of the final course grade. • The US History EOC will count as 30% of the final course grade for ALL students in Grades 9 -12 enrolled in an eligible course. This 30% rule will remain in effect this school year and beyond.
2012–2013 Computer-Based Testing System Minimum Specifications
Certification Tool • The Certification Tool is to be completed by each school that will offer computer-based assessment(s) in the 2012-13 school year. (Please refer to Weekly Briefing #12320.) • Six sections to complete online: • I. Computer Specifications • II. Student Scheduling Plan • III. Annual Checklist • IV. Administration – Specific Checklist • V. School Computer-Based Assessment Team • VI. Submit to District Office • TheCertification Tool Webcast Training is available at: http://oada.dadeschools.net/Screencasts/2013EOC/2012-13CBTSCREENCAST.html.
Certification Tool, cont. • The Certification Tool is to be completed twice in the 2012-13 school year. • One Certification Tool for FALL and WINTER assessments: • Fall 2012 FCAT/FCAT 2.0 Retake: Reading and Mathematics • Winter 2012 EOC Assessments: Algebra 1, Biology 1, and Geometry • One Certification Tool for both SPRING assessments: • Spring 2013 FCAT /FCAT 2.0 Retake: Reading and Mathematics • Spring 2013 FCAT 2.0 Reading and Mathematics • Spring 2013 EOC Assessments: Algebra 1, Biology 1, Geometry, US History, and Civics Field Test (selected schools only)
PearsonAccess • PearsonAccess – www.pearsonaccess.com/fl • A website used for almost all test preparation (e.g., PreID), setup, administration, and reporting tasks. • Correct test administration must be selected each time you log in. • Requires a username and password. • Links to support materials: www.FLAssessments.com/ • PearsonAccess will timeout after 14 minutes of inactivity.
PearsonAccess, cont. • PearsonAccess Training Center • Accessed from the Training Center tab on PearsonAccess Home page. • Provides an opportunity to practice PearsonAccess tasks. • Manage the Infrastructure Trial in preparation for testing. • Requires a username and password.
Platform for Florida’s high-stakes computer-based statewide assessments. Software application installed either on a file server or on each computer that will be used for testing. Secure, locked-down browser. Runs on tablets (except for iPads) but not recommended. TestNav 6.9 Note: This is the URL used for testing this Spring; it is different from the URL used for the Infrastructure Trial.
TestHear • Platform used to deliver accommodated forms (e.g., large print, zoom, color contrast, screen reader, assistive devices) for Florida’s high-stakes computer-based statewide assessments. • Must be installed on all computers that will be used by eligible students requiring accommodated CBT forms. • Local installation is required. • New updated version must be installed. • Available for download at www.FLAssessments.com/downloads. • Note: Audio card and headphones are required for the computers that will run the Screen Reader accommodation.
Proctor Caching • Proctor Caching is a process of loading or “caching” test content locally on a computer at the school level. • Does not require a separate caching server and can run on any workstation on the network that meets minimum requirements. • Proctor Caching software is provided by Pearson. • Reduces test delays due to network congestion. • Provides students with a more seamless testing experience. • Requiredfor all FCAT/FCAT 2.0/EOC computer-based testing in Florida.
Infrastructure Trial • The Infrastructure Trial simulates a computer-based test using mock test items that will allow schools to test hardware and network capacity prior to the CBT operational administration. • It should take approximately thirty minutes for users to log in, supply random answers, and submit the test. • Please note that the content of the test used for the Infrastructure Trial is NOT intended for student practice. • Schools must set up the Trial to use all computers scheduled to be used concurrently during the Fall / Winter / Spring CBT administrations. • The Infrastructure Trial is managed in the Training Center. • TestHear accommodated forms are available for the Infrastructure Trial. These forms are larger (50 MB) than regular TestNav forms (2 MB).
Practice Test (ePat) • Electronic Practice Assessment Tool • Provides students an opportunity to practice using the computer-based platform prior to testing. • Available for download at www.FLAssessments.com/ePATs. • Download ePAT launcher separately from test content. • Accommodated ePATs are also available. Launcher is bundled with the practice test content for accommodated forms. • Scripts and instructions for downloading ePATs are under the Resources tab.
Student Tutorials • www.FLAssessments.com/ePATs Resources tab • Provide additional exposure to the format of computer-based assessments • Viewing the tutorials does not replace the required practice test (ePAT) sessions
District Level Certification Form • Current policy states that individuals who handle secure materials for statewide assessments (FCAT/FCAT 2.0/EOC) must have state- or district-level teaching certifications. • If there are instances in which a non-certified person will assist the test chairperson with preparing test materials, the District-Level Certification Form must be completed and submitted for approval.
Race to the Top Hard to Measure:Physical Education/Health and Visual Arts Kathleen Sierra, Supervisor
RttT District Developed Assessments for Hard to Measure Content Areas • Funded through the Race to the Top (RttT) Grant – Three Year Project • Goals of the Initiative • Develop high quality, standards-based assessments in non-core content areas • Provide Florida public and charter school districts with an extensive bank of assessment items • High Quality, standards-based • Field tested • Vetted by Florida Educators • Once Item bank is fully operational, Florida Districts, schools, and teachers will access to the bank to generate assessments to meet their needs.
RttT District Developed Assessmentsfor Hard to Measure Content Areas(cont.) • How were courses chosen? • Through student enrollment and teacher assignments • Content Areas being developed: • Career and Technical Education • Health Education K-12 • Physical Education K-12 • Performing Arts • Visual Arts • World Languages
RttT District Developed Assessmentsfor Hard to Measure Content Areas(cont.) • Timeline: • 2011-12 and 2012-13 school years • Develop Item Specifications • Develop Test Items, Blueprints, and test forms • 2013-14 school year • Field test • 2014-15 school year • Item Bank fully operational for all Florida public and charter school Districts
Interim Assessment Program Formative Classroom Assessment Felicia Mallory, Executive Director Denetra Collins, Staff Specialist
Purpose of the Baseline Benchmark Assessments (BBA) • To determine students’ baseline knowledge of the Next Generation Sunshine State Standards in Reading, Mathematics, Science and Social Studies. • To provide teachers with a quick snapshot of students’ initial knowledge and abilities to focus instruction. • To provide for state required progress reports in schools classified under the Differentiated Accountability System as Focus, Focus DD, Focus DDD, Prevent, and Priority. • Program guide and instructions for downloading the assessments are available on our website at http://oada.dadeschools.net/IAP/IAP.asp
Purpose of Interim Assessment Tests • To monitor student progress on the Reading, Mathematics, Science and Social Studies Next Generation Sunshine State Standards (Fall, Winter, and Spring) • To provide teachers with classroom assessment tools that will provide reliable student-level benchmark information to inform instruction • To provide students with information on their progress on specific benchmarks • To provide schools with a reliable and valid assessment tool for state progress reporting.
Overview of the Interim Assessment Program • Interim Assessment tests administered three times per year • BBA, fall, winter, and spring • Alignment with the Next Generation Sunshine State Standards and District’s pacing guides • Benchmark Assessment Item Banks for Reading and Mathematics are available in ExamView • Data analysis and disaggregation, score reports, and item analysis are available in Edusoft
Interim Assessment Administration Windows 2012-2013
Students to be Tested • All eligible students* must take the Interim Assessment in Reading, Mathematics, and Science. • Reading, Grades 3-10,* • Mathematics, Grades 3-8* • Science: Grades 5 and 8* • All students enrolled in: • Algebra I** • Geometry** • Biology I** • U.S History** • Civics** • *Students MUST take the test corresponding to the grade level in which they are listed in ISIS (unless they are enrolled in an EOC course in same content area). • **Or an equivalent course (see Appendix D, page 42 of the CBT Supplemental Program Guide)
Administration Format *Paper-based for Baseline only, computer-based in subsequent administrations.
Approximate Testing Times * Longer assessments may be administered over a two-day time period.
Performance Levels The Performance Levels for grades 3-10 reading, 3-8 mathematics, and algebra are outlined below. Students who are likely to score in FCAT levels 3 and above Students whose performance was not sufficient to predict success Students who are likely to score below FCAT level 3
Score Reports • Useful reports that can be retrieved via Edusoft: • Class List Reports • Item Analysis Report • Item Response Report • Student Performance Report • Subgroup Report • Custom Group Report • Performance Band Report
Benchmark Assessment Item Bank • To allow teachers to monitor student progress on the Reading and Mathematics Next Generation Sunshine State Standards • To provide teachers with classroom assessment tools that will provide reliable student-level benchmark information to inform instruction • To provide students with information on their progress on specific benchmarks • Item Bank Resources: • Item Bank Overview • Item Bank Newsletter • Download Examview Test Generator
Comprehensive English Language Learners (CELLA) Felicia Mallory, Executive Director Denetra Collins, Staff Specialist
Overview of CELLA • CELLA is a four-skill English language assessment measuring student proficiency in listening, speaking, reading, and writing. • Students in grades 1 – 12 are administered the • Listening, Reading, and Writing sections in groups • Speaking on a one-on-one basis • Kindergarten students are assessed in all four areas on a one-to-one basis. • Unlike the FCAT, CELLA is not a timed test.
Purposes of CELLA • The test results can provide: • Data useful for charting student progress over time, • Diagnostically useful information about students’ strengths and weaknesses in English, • The language proficiency levels of individual students can be used in making decisions regarding placement into, or exit from English for Speakers of Other Languages (ESOL) programs. • Identifying the proper ESOL level, • Determining whether the District and schools met Annual Measureable Achievement Objectives (AMAOs)
Annual Measurable Achievement Objectives (AMAOs)
Important Dates for 2013 CELLA Administration: Individual Group: March 4 - April 5, 2013
National Assessment of Educational Progress (NAEP) Felicia Mallory, Executive Director Denetra Collins, Staff Specialist
Features of NAEP-TUDA • Provides district-level data to participating urban districts • Provide a common yardstick to measure student achievement in comparison to • Other urban districts • States • Large Central Cities • National Public Schools • Census Regions
Purpose of the National Assessment of Educational Progress (NAEP)/TUDA • A common nationwide measure of student performance • Reports changes over time. • Provides results for the nation, states, and some urban districts. • Secondary indicator for state progress and allows national comparisons between states and large urban districts • Used by the President, Congress, and state leaders to set education policy
Overview of the NAEP • A representative sample of schools and students are selected. • Randomly selected students in grades 4,8, and12 are assessed in reading, mathematics, economics, and writing. • Assessments include multiple-choice and constructed responses. • Assessments are administered by NAEP field staff • Assessments are 90 to 120 minutes, which include testing and answering background questions • Accommodations are offered for ELL and SWD students. • Results are reported by scale scores, subscales, achievement levels, subgroups, and geography