Scale Scoring A Revised Format for Provincial Assessment Reports
Teachers, parents and the public alike think they know and understand simple scores like total scores, percent correct and percentile ranks. Teachers, parents and the public need to know and understand how to interpret scaled scores. Twing, J. (2002). Vice President, Psychometric Services, NCS Pearson Iowa City.
Beginning with this school year (2007-2008), provincial assessments will be reported on a common scale.
Provincial Assessments • ELLA- Early Literacy Assessment • EEMLA- Early Elementary Mathematical Literacy Assessment • ELA- Elementary Literacy Assessment • JHLA- Junior High Literacy Assessment
Scaled scores allow more accurate interpretations of assessment results. • comparisons of results from year to year • comparisons of results from one grade level assessment to another • comparisons between subject areas
Scaling provides consistency in reporting any assessments results, while allowing for the assessments to vary in format, grade level, and year of administration. Most large-scaled assessment systems use scaled scores.
What is a Scale? • A mathematical conversion of raw scores to a common scale or a derived score. • Different scales may be used to measure the same thing, but they are calibrated differently. (e.g. rulers, thermometers, speedometers, bathroom scales)
Cut Score • Defines the point at which a certain required level of achievement has been demonstrated on the assessment • NOT a mean; the cut score can be above or below the mean, depending on what level of achievement is being defined
Cut Score • A point between passing or not passing, achieving or not achieving, meeting or not meeting expectations. • Cut scores may be set to identify: - not yet meeting expectations, - meeting expectations (satisfactory performance), and - meeting expectations (strong performance)
Properties of Provincial Scale Range: • Scales range from 200 at low end to 800 at the high end • Higher scores mean stronger educational attainment
200-800 scale will avoid confusion with comparison to percentages (1-100) • Aligns with national and international assessment scoring (PCAP, PISA, PIRLS) to allow comparisons
Properties Distribution of Scores: • Provincial mean is set to 500 • On most provincial assessments about 65% of students will place between 400 and 600
Interpreting Results • How close or how far away from the cut score and/or mean did the student perform? • Did the student meet expectations with satisfactory or strong performance?
Additional http://plans.ednet.ns.ca The Department of Education has a website that highlights information on all the assessments. Click on the above link for more information.