Pattern Matching for Construct Validity
The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches
The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches - Theories - Ideas - Hunches Conceptualization task
The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches Conceptualization task Theoretical pattern
The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches Conceptualization task Theoretical pattern - Observations - Data - Measures
The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches Conceptualization task Theoretical pattern Data Organization - Observations - Data - Measures - Observations - Data - Measures
The Pattern-Matching Model - Theories - Ideas - Hunches Conceptualization task Theoretical pattern Observed Pattern Data Organization - Observations - Data - Measures - Observations - Data - Measures
The Pattern-Matching Model - Theories - Ideas - Hunches Conceptualization task Theoretical pattern Pattern matching Observed Pattern Data Organization - Observations - Data - Measures - Observations - Data - Measures - Observations - Data - Measures
The Pattern-Matching Model - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Theoretical pattern Pattern matching Observed Pattern Observational Realm Data Organization - Observations - Data - Measures
A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Theoretical pattern Pattern matching Observed Pattern Observational Realm Data Organization - Observations - Data - Measures
A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Pattern matching Observed Pattern Observational Realm Data Organization - Observations - Data - Measures
A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Concept Map Pattern matching Observed Pattern Observational Realm Data Organization - Observations - Data - Measures
A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Concept Map Pattern matching Observed Pattern Observational Realm Data Organization - Observations - Data - Measures - Arithmetic? - Geometry? - Reading?
A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Concept Map Pattern matching Observed Pattern Observational Realm Data Organization Data Analysis - Observations - Data - Measures - Arithmetic? - Geometry? - Reading?
A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Concept Map Pattern matching Observed Pattern Observed Pattern Observational Realm Data Organization Data Analysis - Observations - Data - Measures - Arithmetic? - Geometry? - Reading?
A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Concept Map Pattern matching Pattern match r Observed Pattern Observed Pattern Observational Realm Data Organization Data Analysis - Observations - Data - Measures - Arithmetic? - Geometry? - Reading?
A Pattern-Matching Example Theoretical realm Spelling Arithmetic Test questions Algebra Geometry Reading Observational realm
A Pattern-Matching Example Theoretical realm Spelling Arithmetic Algebra Geometry Reading Closer if more similar Observational realm
A Pattern-Matching Example Theoretical realm Spelling Arithmetic Algebra Farther if less similar (low distance means more similar) Geometry Reading Observational realm
Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Pattern-Matching Example Theoretical realm Spelling Arithmetic Algebra Farther if less similar (low distance means more similar) Geometry Reading Observational realm
Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Pattern-Matching Example Theoretical realm Spelling Arithmetic Algebra Farther if less similar (low distance means more similar) Geometry Reading High interitem correlation means more similar. Observational realm
Spelling Arithmetic Algebra Geometry Reading A Pattern-Matching Example Theoretical realm Observational realm
Spelling Arithmetic Algebra Geometry Reading A Pattern-Matching Example Theoretical realm Observational realm
Spelling Arithmetic Algebra Geometry Reading A Pattern-Matching Example Theoretical realm Matrix of inter-point distances Observational realm
Spelling Arithmetic Algebra Geometry Reading Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Pattern-Matching Example Theoretical realm Matrix of inter-point distances Observational realm
Spelling Arithmetic Algebra Geometry Reading Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Pattern-Matching Example Theoretical realm Matrix of inter-point distances Observational realm
Spelling Arithmetic Algebra Geometry Reading Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Pattern-Matching Example Theoretical realm Matrix of inter-point distances Matrix of inter-item correlations Observational realm
Spelling Arithmetic Algebra Geometry Reading Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Patter- Matching Example Theoretical realm Matrix of inter-point distances Pattern match r Matrix of inter-item correlations Observational realm
A Pattern-Matching Example Theoretical realm Matrix of inter-point distances Pattern match r Matrix of inter-item correlations Observational realm
A Pattern-Matching Example Theoretical realm Pair Distance 1,2 .342 1,3 .457 ... ... n,n-1 3.241 Matrix of inter-point distances Pattern Match r Matrix of inter-item correlations Observational realm
A Pattern-Matching Example Theoretical realm Pair Distance 1,2 .342 1,3 .457 ... ... n,n-1 3.241 Matrix of inter-point distances Pattern Match r Matrix of inter-item correlations Items Correlation 1,2 .92 1,3 .89 ... ... n,n-1 .03 Observational realm
A Pattern-Matching Example Theoretical realm Pair Distance 1,2 .342 1,3 .457 ... ... n,n-1 3.241 Matrix of inter-point distances Pattern Match r r = -.93 Matrix of inter-item correlations Items Correlation 1,2 .92 1,3 .89 ... ... n,n-1 .03 Observational realm
A Pattern-Matching Example Theoretical realm Pair Distance 1,2 .342 1,3 .457 ... ... n,n-1 3.241 Matrix of inter-point distances Estimate of construct validity Pattern match r r = -.93 Matrix of inter-item correlations Items Correlation 1,2 .92 1,3 .89 ... ... n,n-1 .03 Observational realm
Why Does Pattern Matching Work? • Theoretical pattern is like a fingerprint -- more detail is better, if you can match it to reality. • If you find a match to a detailed theoretical pattern, it provides evidence for your theory. • The more detail, the less likely there are alternative explanations (threats) to construct validity.
Disadvantages of Pattern Matching • Requires a detailed conceptual framework • Requires that theoretical and observed patterns are structured the same
Advantages of Pattern Matching • More general and flexible than MTMM • Yields an overall estimate of construct validity • Requires you to specify what you think about the constructs • Treats convergence and discrimination as a continuum
