1. Construct Validity PUSH

2. CONSTRUCT VALIDITYFactor analysis: Bivariate correlations

3. CONSTRUCT VALIDITYFactor analysis (Principal component analysis) • Best solution = 8 factors • Practice Improvement • Learning* • Reassurance, Confirmation • Recall • Frustration not enough info • Frustration too much info • Disagree • Harmful Total variance explained = 89.8% *No impact

4. CONSTRUCT VALIDITYMultilevel Factor Analysis • Accounting for dependence due to multiple ratings for each InfoPOEM • Best solution = 9 factors • Practice Improvement • Learning • Reassurance • Confirmation • Recall • Frustration not enough info • Frustration too much info • Disagree • Harmful • Accounting for dependence due to multiple ratings from each participant • Best solution = 8 factors • Practice Improvement • Learning • Reassurance, Confirmation • Recall • Frustration not enough info • Frustration too much info • Disagree • Harmful Total variance explained = 90.0% Total variance explained = 97.5%

5. Results - Summary • Use of the method is good • The ten most frequent impact patterns account for 89% of all reports of ‘cognitive impact’ • An eight factor solution explains 90% of total variance, and is a good fit for the data