Download
1 / 14
140 likes | 245 Vues
This study evaluates the validity of placement scores from the ACCUPLACER test in predicting student success in Freshman Composition and College Algebra at the University of Houston Downtown. By analyzing grades of 1,933 students, we aim to establish the probability of achieving grades B and C based on placement scores. The findings will enhance placement accuracy and inform future students about their likelihood of success. We regularly present these statistics to faculty to ensure alignment and satisfaction with our placement methods.
E N D
A Placement Validity Study for Freshman Composition and College Algebra Gary Greer University of Houston Downtown (greerg@uhd.edu) Annual Conference on The First-Year Experience February 22, 2004 1:45-2:45 PM Addison TX
Purpose of this study • To check the validity of our cut scores. • To be able to translate our student’s placement score into a probability that the student will succeed. • At U. of Houston Downtown we used grades and placement scores to check ACCUPLACER’s accuracy in forecasting student performance.
Setting Cut Scores • NCME recommends in The Code of Fair Test Practices in Education that test usersmonitor the behavior of cut scores in placement. (see www.apa.org/science/fairtestcode.html) • Documentation should include measurement of the relation between predictor and criterion.
Measurement • An Accuplacer placement score is a predictor. • Course grade is the criterion. • Course grade can be predicted by placement score. • Success is defined as a course grade B or grade C. A probability is associated with the grade predicted.
Samples • 844 students (405 Males; 439 Females) took the placement test and Freshman Composition. • 1089 students (432 Males; 657 Females) took the placement test and College Algebra. • Findings from these samples generalize to future students taking Freshman Composition and College Algebra. Probability of making a B is related to a certain placement score.
Research Questions - Freshman Composition • What is the probability that a student with Sentence Skill score “X” will make a B in Freshman Composition? • What is the probability that a student with Sentence Skill score “X” will make a C in Freshman Composition? • What is the correlation between placement score and course grade?
Research Questions – College Algebra • What is the probability that a student with Elementary Algebra score “X” will make a B in College Algebra? • What is the probability that a student with Elementary Algebra score “X” will make a C in College Algebra? • What is the correlation between placement score and course grade?
Decision Probabilities • To both maximize correct decisions and minimize incorrect decisions, place students who have probability of success>.50 (1 success out of 2) • Or choose .67 to get 2 successes out of 3 or .75 to get 3 successes out of 4
True and False Decisions • Correct Decisions determined by • Placing a student into a course who succeeds – true positive • Denying placement to a student who would not succeed – true negative • Incorrect Decisions determined by • Placing a student into a course who will not succeed – false positive • Denying placement to a student who would succeed – false negative
Conclusions • We present statistics of Accuplacer’s placement accuracy to faculty every three years. • We are satisfied when faculty are satisfied. • Data collection and submission for a V study has never been easier.
