330 likes | 437 Vues
Introduction to CEM Secondary Pre-16 Information Systems. Neil Defty Secondary Systems Programme Manager. Ensuring Fairness. Principles of Fair Analysis : Use an Appropriate Baseline Compare ‘Like’ with ‘Like’ Reflect Statistical Uncertainty. CEM Systems.
E N D
Introduction to CEM Secondary Pre-16 Information Systems Neil Defty Secondary Systems Programme Manager
Principles of Fair Analysis : • Use an Appropriate Baseline • Compare ‘Like’ with ‘Like’ • Reflect Statistical Uncertainty
CEM Systems Principle of Fair Analysis No1 : Use an Appropriate Baseline
The Assessments MidYIS - Year 7, 8 or 9 Developed ability assessments: Vocabulary Maths Non-verbal (Cross-sections, Block Counting and Pictures) Skills (Proof Reading and Perceptual Speed & Accuracy) SOSCA (“INSIGHT Core”) – Year 9 Curriculum-based assessments: Reading (Passage Comprehension, Text Comprehension and Speed Reading) Maths (Number & Algebra, Handling Data and Space, Shapes & Measures) Science (Biology, Chemistry and Physics) INSIGHT – Year 8* or 9 (* depending on numbers) Developed ability assessments (‘MidYIS’) plus Curriculum-based assessments (‘SOSCA’) Yellis - Year 10 or 11 Developed ability assessments: Vocabulary Maths Patterns (Matching and Reflections & Rotations) 1 session – Computer adaptive or paper-based 3 sessions - Computer adaptive 4 sessions - Computer adaptive 1 session - Computer adaptive or paper-based
. Linear Least Squares Regression Subject X -ve VA +ve VA 50 100 150 Residuals Regression Line (…Trend Line, Line of Best Fit) Outcome = gradient x baseline + intercept Correlation Coefficient (~ 0.7)
Some Subjects are More Equal than Others…. Principle of Fair Analysis No2 : Compare ‘Like’ with ‘Like’
Chances Graphs English Language - band D English Language - band C 50 50 35 40 40 31 29 Percent Percent 24 30 23 30 20 20 20 10 9 7 6 10 10 2 2 1 1 1 0 0 0 0 0 U G F E D C B A A* U G F E D C B A A* Grade Grade English Language - band B English Language - band A 50 50 40 35 40 40 Percent 26 24 Percent 30 30 23 21 20 20 8 7 7 5 10 10 2 0 0 0 1 0 0 0 0 0 U G F E D C B A A* U G F E D C B A A* Grade Grade
Burning Question : What is my Value-Added Score ? Better Question : Is it Important ? Principle of Fair Analysis No3 : Reflect Statistical Uncertainty
Grade Points Equivalent Baseline Score The Scatter Plot Look for Patterns… General under- or over-achievement ? Do any groups of students stand out ? – high ability vs low ability ? – male vs female ?
Value Added Feedback Year 7 Pupil Level Residuals to GCSE
Your data is above the Yellis average Your data is below the Yellis average Your data is about the same as the Yellis average Your data is about the same as the Yellis average Attitudinal Feedback
Secondary Pre-16 Contact Details Tel: 0191 334 4255 Email: midyis@cem.dur.ac.uk sosca@cem.dur.ac.uk insight@cem.dur.ac.uk yellis@cem.dur.ac.uk Web: www.cemcentre.org