1.17k likes | 1.31k Vues
PVAAS F2F Overview: Evaluating Growth, Projecting Performance. Fall 2013. Welcome!. IU Facilitators Who is here today? District level administrators? School level administrators? Teachers? Instructional coaches? Guidance counselors? Other?. Partners & Teams for Session Activities.
E N D
PVAAS F2F Overview:Evaluating Growth,Projecting Performance Fall 2013
Welcome! • IU Facilitators • Who is here today? • District level administrators? • School level administrators? • Teachers? • Instructional coaches? • Guidance counselors? • Other? F2F Overview 2013
Partners & Teams for Session Activities • Some activities throughout the session will be completed in pairs or small groups, while others will be done independently. • Take a few minutes now to divide yourselves into: • Partners (groups of 2), AND • Small groups (groups of 4-6). F2F Overview 2013
Goal of Session By the end of the session, participants will be able to answer the following questions: • What is PVAAS? • How does PVAAS measure growth? • What does PVAAS tell us about growth in our district and school(s)? • What does PVAAS tell us about how students are projected to perform on a future state assessment? • Which reports are most meaningful for school level planning, course level planning, grade level planning, and student level planning? F2F Overview 2013
What Is PVAAS? F2F Overview 2013
What is PVAAS? • Longitudinal analysis of existing state assessment data • Reliable estimates of academic growth & projections of future performance • Effectiveness of the educational system F2F Overview 2013
What is PVAAS? Grade 5 Grade 6 • Growth of a group of students over time • NOT a simple comparison of test scores Grade 3 Grade 4 F2F Overview 2013
PVAAS Addresses Complex Issues! Research-based Statistical Modeling F2F Overview 2013
Demographics and Growth As long as you can sufficiently account for the prior achievementof the student,… …there is NO significant relationship between demographics and student progress, or growth! F2F Overview 2013
Prior Achievement How can we adequately account for prior achievement? • The SAS EVAAS team has found that the only way to adequately account for prior achievement is to use ALL available test data for each student to dampen the effects of measurement error. • PVAAS does NOT need to adjust for the demographic status of students directly since it is accounting for students’ prior achievement. • In other words, demographics are inherently controlled for in PVAAS by the use of all longitudinal data on all students. F2F Overview 2013
Activity Work with a partner to decide if each statement is true or false. F2F Overview 2013
For More Information Virtual Learning Module PVAAS Misconceptions: Clarifying Questions and Misunderstandings F2F Overview 2013
Two Types of PVAAS Information F2F Overview 2013
What is PVAAS? F2F Overview 2013
LOOKING AHEAD LOOKING BACK F2F Overview 2013
PVAAS Value-Added ReportingHow is growth measured in PVAAS? F2F Overview 2013
PVAASValue-Added Reporting F2F Overview 2013
Measuring Academic Growth Students don’t all start the year at the same place academically F2F Overview 2013
Measuring Academic Growth • Standard for PA Academic Growth • Regardless of their entering achievement level, students should not lose ground academically • Is it not a reasonable goal to maintain the achievement level of a group of students? • Not necessarily increase their achievement level, but maintain their achievement level. F2F Overview 2013
PVAAS Growth Measure &Color Indicators • The Growth Measure represents the amount of growth a group of students has made. • The Color Indicators represent the level of evidence we have in the data to say whether the group of students: • Did NOT meet the standard for PA Academic Growth • Met the standard for PA Academic Growth • Exceeded the standard for PA Academic Growth PVAAS yields a Growth Measure AND a Growth Color Indicator. F2F Overview 2013
Concept of Measuring Growth in PVAAS Prior Achievement for Group Higher Achievement Lower Achievement F2F Overview 2013
Concept of Measuring Growth in PVAAS Prior Achievement for Group Higher Achievement Lower Achievement • For grades 4-8, Math and Reading - represents the mean achievement level of the group of student • For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students F2F Overview 2013
Concept of Measuring Growth in PVAAS Most Recent School Year for Group Prior Achievement for Group Higher Achievement Higher Achievement Lower Achievement Lower Achievement • For grades 4-8, Math and Reading - represents the mean achievement level of the group of student • For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students F2F Overview 2013
Concept of Measuring Growth in PVAAS Most Recent School Year for Group Prior Achievement for Group Higher Achievement Higher Achievement Lower Achievement Lower Achievement • For grades 4-8, Math and Reading - represents the mean achievement level of the group of student • For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students F2F Overview 2013
Concept of Measuring Growth in PVAAS Most Recent School Year for Group Prior Achievement for Group Higher Achievement Higher Achievement Lower Achievement Lower Achievement • For grades 4-8, Math and Reading - represents the mean achievement level of the group of student • For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students F2F Overview 2013
Concept of Measuring Growth in PVAAS Most Recent School Year for Group Prior Achievement for Group Higher Achievement Higher Achievement Lower Achievement Lower Achievement • For grades 4-8, Math and Reading - represents the mean achievement level of the group of student • For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students F2F Overview 2013
Concept of Measuring Growth in PVAAS Most Recent School Year for Group Prior Achievement for Group Higher Achievement Higher Achievement Lower Achievement Lower Achievement • For grades 4-8, Math and Reading - represents the mean achievement level of the group of student • For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students F2F Overview 2013
Regardless of the entering achievement level of the group… F2F Overview 2013
Regardless of the entering achievement level of the group… • Students should not lose ground academically F2F Overview 2013
Regardless of the entering achievement level of the group… • Students should not lose ground academically • A reasonable goal would be to at least maintain the achievement level of the group F2F Overview 2013
Regardless of the entering achievement level of the group… • Students should not lose ground academically • A reasonable goal would be to at least maintain the achievement level of the group • All groups of students can make growth F2F Overview 2013
Practice! • Turn to a partner • Explain the concept of growth Current School Year Previous School Year Higher Achievement Higher Achievement Lower Achievement Lower Achievement F2F Overview 2013
For More Information TWO Virtual Learning Modules Introduction to Measuring Academic Growth Concept of Growth: Connections to Value-Added Reporting F2F Overview 2013
Questions F2F Overview 2013
PVAAS Growth Measure &Color Indicators • The Growth Measure represents the amount of growth a group of students has made. • The Color Indicators represent the level of evidence we have in the data to say whether the group of students: • Did NOT meet the standard for PA Academic Growth • Met the standard for PA Academic Growth • Exceeded the standard for PA Academic Growth PVAAS yields a Growth Measure AND a Growth Color Indicator. F2F Overview 2013
Measuring Growth in PVAAS • Remember, PVAAS does NOT compare the achievement of one group of students in a particular subject and grade with the previous year’s students in the same subject and grade. • PVAAS does NOT use the percentages of students at various academic performance levels to measure growth. • PVAAS uses students’ scale scores within those performance levels to better estimate growth. F2F Overview 2013
PVAAS Value-AddedGrowth Indicators F2F Overview 2013
PVAAS Value-AddedGrowth Indicators F2F Overview 2013
Growth Measures Not Reportedfor Prior Years • PA’s state assessment system is transitioning to include Keystone end-of-course exams and statewide assessments aligned to the PA Common Core over the next several years. • Growth Measures in prior years will NOT be included in fall 2013 reporting (SY12-13). • Anticipated that Growth Measures from up to 3 previous years with 3-year averages will be yielded and reported beginning with fall 2015 reporting (SY14-15). F2F Overview 2013
School Value-Added ReportsGrades 4-8 Math & Reading F2F Overview 2013
PVAAS Value-AddedGrowth Measures • For Reading and Math in grades 4-8, Growth is measured in Normal Curve Equivalent (NCE) units as scale scores cannot be compared from grade to grade and year to year. • The Growth Measure is NOT reported in years and cannot be referenced in terms of number of year’s growth. • The Growth Measure is NOT reported in percentages and cannot be referenced in terms of an increase or decrease in percentage points. F2F Overview 2013
RescalingGrades 4-8: Math & Reading 1000 1100 1200 1300 1400 1500 Scale Score Points • 0 10 20 30 40 50 60 70 80 90 100 NCE Units F2F Overview 2013
Activity:How would you interpret? F2F Overview 2013
School Value-Added ReportsScience, Writing, & Keystone content areas School A School B F2F Overview 2013
PVAAS Value-AddedGrowth Measures • For Science, Writing and Keystone content areas, Growth is measured in scale score points. • The Growth Measure is NOT reported in years and cannot be referenced in terms of number of year’s growth. • The Growth Measure is NOT reported in percentages and cannot be referenced in terms of an increase or decrease in percentage points. F2F Overview 2013
Activity:How would you interpret? F2F Overview 2013
For More Information TWO Virtual Learning Modules Value-Added Report F2F Overview 2013
Performance Diagnostic Report Missing Bar – Insufficient Number of Students Blue Bar – Current Year Whisker – Margin of Error on Growth Value F2F Overview 2013
PVAAS Performance Diagnostic Growth Descriptors - Interpretation What the whiskers tell us… Exceeded the standard for PA Academic Growth Met the standard for PA Academic Growth Zero (0) Line Growth Did not meet the standard for PA Academic Growth F2F Overview 2013
Performance Diagnostic Patterns Reverse Shed Pattern Shed Pattern System benefits higher-achieving students System benefits lower-achieving students F2F Overview 2013