70 likes | 210 Vues
This presentation by Brenda explores how demand characteristics and range effects impact human performance in research settings. It highlights how participant desires to conform and perform well can skew results, affecting ecological validity and reproducibility. The discussion covers possible solutions, such as minimizing deception and utilizing statistical controls. Additionally, it delves into adaptation level theory and sensory processing, proposing optimal study designs to mitigate these effects. The implications for system design and testing are also examined, emphasizing the importance of understanding these biases.
E N D
Measuring Human Performance:Demand Characteristics and Range Effects Orne (1961) and Poulton (1975) Presenter: Brenda
The Problem Set (1) • Research participant responses may be affected by Demand Characteristics • Want to be ‘good’ participants and perform well • Want to perform as expected • May guess the hypothesis and want to help (or not) the researcher’s goal • Negatively affects reproducibility, ecological validity • Related to Hawthorne Effect?
What to do about Demand Characteristics • Study • Minimize • Deception • Control of information to participant • Minimal researcher/participant contact • Account for it statistically • Post-research survey one-sample t test on mean • Correlate survey results to dependent variable • Stats with and without positive outliers • Between-Subjects Design
The Problem Set (2) • Range effects may account for performance • Central tendency in human response behavior • Common in within-subjects designs • Suspect in many venues of performance • Subjects learn the range of stimuli and adjust or confuse response • Could it be something else? • Adaptation Level Theory (Helson, 1964) • Sensory system physiology • Parallel processing • Exhaustive serial scanning
What to do about Range Effects • Use between-subjects design as the standard • Use within-subjects design followed by a between-subjects design with different groups of participants
System Testing and Operations • Do demand characteristics and range effects play a role in system design/testing? • How would human-system interaction be influenced? • Unintended consequences in operational settings?
Additional References • Perceived Awareness of the Research Hypothesis (PARH) Scale • Rubin, M., Paolini, S., & Crisp, R. J. (2010). A processing fluency explanation of bias against migrants. Journal of Experimental Social Psychology, 46, 21-28. • https://sites.google.com/site/markrubinsocialpsychresearch/a-measure-of-the-influence-of-demand-characteristics • US Army Land Warrior System • http://www.nap.edu/openbook.php?record_id=5436&page=R1 • http://www.scribd.com/doc/95088640/Human-Factors-Evaluation-of-Land-Warrior-Version-1-0