E N D
NASP 2001 Years of Psychometric and Research Advances in School Psychology Fifty Richard W. Woodcock April 19, 2001
Fifty years of … Cognitive theory and assessment Three Strands
Fifty years of … Cognitive theory and assessment Psychometrics and test development Three Strands
Fifty years of … Cognitive theory and assessment Psychometrics and test development Research techniques and tools Three Strands
Path of Progress Better Better Better Better Cognitive Cognitive Inform- Instructional Theory Tests tion Planning
The primary purpose for testing should be to find out more about the problem, not to get an IQ. Guiding Principle
Conceptualizations of Intelligence Single General Ability
Conceptualizations of Intelligence Single General Ability Pair of Abilities
Conceptualizations of Intelligence Single General Ability Pair of Abilities Incomplete Set of Broad Abilities
Conceptualizations of Intelligence Single General Ability Pair of Abilities Incomplete Set of Broad Abilities “Complete” Set of Broad Abilities
Nine Broad CHC Factors • Stores of Acquired Knowledge • Comprehension-Knowledge (Gc) • Reading-Writing (Grw) • Mathematics (Gq)
Nine Broad CHC Factors • Stores of Acquired Knowledge • Comprehension-Knowledge (Gc) • Reading-Writing (Grw) • Mathematics (Gq) • Thinking Abilities • Long-Term Retrieval (Glr) • Visual-Spatial Thinking (Gv) • Auditory Processing (Ga) • Fluid Reasoning (Gf)
Nine Broad CHC Factors • Stores of Acquired Knowledge • Comprehension-Knowledge (Gc) • Reading-Writing (Grw) • Mathematics (Gq) • Thinking Abilities • Long-Term Retrieval (Glr) • Visual-Spatial Thinking (Gv) • Auditory Processing (Ga) • Fluid Reasoning (Gf) • Cognitive Efficiency • Processing Speed (Gs) • Short-Term Memory (Gsm)
Conceptualizations of Intelligence Single General Ability Pair of Abilities Incomplete Set of Broad Abilities “Complete” Set of Broad Abilities Narrow Abilities Underlying Broad Abilities
Examples of Narrow Abilities Comprehension-Knowledge (Gc) Language development (LD) General information (K0) Listening ability (LS)
Examples of Narrow Abilities Comprehension-Knowledge (Gc) Language development (LD) General information (K0) Listening ability (LS) Long-Term Retrieval (Glr) Associative memory (MA) Meaningful memory (MM) Naming facility (NA)
Examples of Narrow Abilities Comprehension-Knowledge (Gc) Language development (LD) General information (K0) Listening ability (LS) Long-Term Retrieval (Glr) Associative memory (MA) Meaningful memory (MM) Naming facility (NA) Short-Term Memory (Gsm) Working memory (WM) Memory span (MS)
6 5 CONCEPTUALIZATION LEVEL 4 3 2 1 0 1910 1920 1930 1940 1950 1960 1970 1980 1990 2000 2010 YEAR OF PUBLICATION Trend of Conceptualizations
The Good News … Tests of the future will be more informative.
… and the Bad News Tests of the future will be more informative. Tests of the future will be more complex as test developers close the gap between cognitive theory and practice.
CHC Cognitive Performance Model Stores of Acquired Knowledge (Gc. Gq, Grw) Thinking Abilities (Glr, Gv, Ga, Gf) Cognitive/Academic PERFORMANCE Cognitive Efficiency (Gs.Gsm)
CHC Cognitive Performance Model Stores of Acquired Knowledge (Gc. Gq, Grw) Thinking Abilities (Glr, Gv, Ga, Gf) Cognitive/Academic PERFORMANCE Cognitive Efficiency (Gs.Gsm) Facilitator-Inhibitors (Internal, External)
Two Concomitant Developments Joint factor analysis studies Cross-battery assessment
Institute for Applied Psychometrics www.IAPsych.com Join the Cattell-Horn-Carroll (CHC) Discussion Listserv at…. • At IAP home page click on • “Join one of IAP listservs” • On listserv page, enter your email address • in the box provided and then click the • ‘Join List' button • Follow instructions as provided • Enjoy
Psychometrics & Test Development • 1. The Test Standards • 2. Rasch model analysis • 3. Co-norming of cognitive and achievement tests
Psychometrics & Test Development • 1. The Test Standards
Test Standards 1954: Technical Recommendations for Psychological Tests and Diagnostic Techniques
Test Standards 1954: Technical Recommendations for Psychological Tests and Diagnostic Techniques 1966, 1974, 1985, 1999: Standards for Educational and Psychological Testing
Psychometrics & Test Development • 1. The Test Standards • 2. Rasch model analysis
Sample-free calibration Benefits from Rasch Modeling
Sample-free calibration Item-free measurement Benefits from Rasch Modeling
Sample-free calibration Item-free measurement Simplified equating of tests Benefits from Rasch Modeling