1 / 33

Placement Testing

Placement Testing. Dr. Edward Morante. Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College. Dr. Edward A. Morante. EdD – 1974 Counseling Psychology, Teachers College, Columbia University Master’s Thesis: Multivariate analysis of the success of a placement

lynton
Télécharger la présentation

Placement Testing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College

  2. Dr. Edward A. Morante EdD – 1974 Counseling Psychology, Teachers College, Columbia University Master’s Thesis: Multivariate analysis of the success of a placement process at a school for disabled students Research Assistant for Dr. Robert Thorndike, noted professor of testing and measurement 35 years in higher education 13 years Director of Counseling at the university level 8 years as Director of the Basic Skills Assessment Program, New Jersey Department of Higher Education, which developed the first state wide placement test in the US, the first state wide assessment of Developmental Education programs in that state, assessing learning outcomes at two and four-year colleges including the first state wide assessment of sophomore learning outcomes 14 years in a Southern California community college as a counselor, Dean of Educational Research, Resources and Technology; Dean of Student Services and Resources; and Academic Senate President

  3. Dr. Edward A. Morante Distinguished Faculty – National Center for Developmental Education’s Kellogg Institute for 23 years, presenting on placement and assessment Member of the Assessment Council of Western Governors University for 10 years where he helped develop an elaborate system of student assessment needed for degree attainment National TRIO trainer for 10 years on assessment, placement, and evaluation Achieving the Dream data coach from the beginning Consultant, presenter, grant writer, program evaluator for 25 years, including head of the team that evaluated Florida’s statewide placement test (CLAST) and member of the team that evaluated the Texas statewide placement test

  4. Today’s Agenda • Definition & Purpose • Important factors • Placement tests vs. SAT & ACT • Best practices • Predictive validity of placement tests • Evaluating placement instruments and policies

  5. Definition A placement test is a basic skills achievement test that measures skills proficiency (e.g., in reading, writing and/or mathematics).

  6. Purpose To assist entering college students in the selection of beginning courses

  7. Important Factors • Reliability: Essential for score consistency; Calculated reliability coefficients should approach or exceed .90

  8. Important Factors • Reliability • Validity: Essential for measuring what the test is supposed to measure; content / skills / behaviors … college entrance = reading writing math

  9. Important Factors • Reliability • Validity • Criterion-referenced, with standards & proficiencies developed by faculty

  10. Important Factors • Reliability • Validity • Criterion-referenced • Power test, where students demonstrate skills within a reasonable time. “Speededness” should be avoided.

  11. Important Factors • Reliability • Validity • Criterion-referenced • Power test • Decreased opportunity to guess

  12. Important Factors • Reliability • Validity • Criterion-referenced • Power test • Decreased opportunity to guess • Alternate form for contingencies

  13. Important Factors • Reliability • Validity • Criterion-referenced • Power test • Decreased opportunity to guess • Alternate form for contingencies • Cost

  14. Important Factors • Reliability • Validity • Criterion-referenced • Power test • Decreased opportunity to guess • Alternate form for contingencies • Cost • No bias

  15. SAT / ACT vs. placement tests SAT / ACT Select most likely to succeed Predict success Higher order skills No developmental level questions Placement Instruments Assess basic skills Ready to enter college classes? Assess developmental levels

  16. SAT/ ACT uses for placement Multiple variables High scores Academic achievement Should not override placement test results

  17. Best Practice - timing • Administer after college admittance and before orientation and registration • Preparation for placement testing?

  18. Best Practice - Process • Do not make a placement based upon the results of one score of one test (avoid error variance by using multiple variables)

  19. Best Practice - Process • Test all entering students • Collect available background info • Analyze these multiple data • Integrate information using multiple variables • Make decisions about placement for each student for each basic skills content area

  20. Best - Multiple Variables • Placement test and components • SAT / ACT • High School rank, GPA, course work • Motivation • Maturity • Family & Work • Support ….How can this be done quickly & efficiently?

  21. Best - Multiple Variables ….How can this be done quickly & efficiently? Work with the metrics of the test - Gordon

  22. Predictive validity Predictive validity is an inappropriate methodology for evaluating an achievement test such as a placement test. (recent CCRC report) Assess skills Assess proficiencies

  23. Assessing A test shouldbe evaluated in the context of both the test itself and how it is used. -Messick

  24. Assessing • Faculty examination of the content • Sampling of skills • Alignment w/ HS?

  25. Assessing Placement Processes: Is the process followed? Who has override power? Rigid or flexible?

  26. Assessing Placement Processes: How many changes are made by students after placement?

  27. Assessing Are students placed appropriately? Ask the experts . . .

  28. Assessing Are students placed appropriately? Ask the experts . . . Faculty!

  29. Assessing Faculty Assessment of Student Placement Survey All faculty who teach all levels of developmental classes + All faculty who teach first level college ENGL & Math • 4-6 Weeks – ask to individually rate the appropriateness of each student’s placement Entry proficiencies, not motivation, etc.

  30. Assessing Faculty Assessment of Student Placement Survey Ratings system: Appropriately placed Should be placed in a lower level Should be placed in a higher level Results compiled with an expected outcome of 80%

  31. Last thought Assessment and placement are only the beginning of the process. Student learning is the goal, and it is much more difficult to accomplish!

  32. Questions?

  33. Placement Testingwith Dr. Edward A. Morante Faculty to Faculty Webinar Series

More Related