Assessing Survey Research, a principled approach
120 likes | 265 Vues
This document outlines a structured framework for assessing survey quality, highlighting the need for rigorous evaluation criteria in various contexts, including judicial processes. Key principles for quality research include neutrality, transparency, and adherence to best practices. The paper discusses the building blocks of survey research—questionnaires, sampling, data collection, analysis, and reporting. Special attention is given to Internet surveys, addressing unique challenges such as sampling coverage and non-response. Essential for both experienced researchers and beginners, it serves as a comprehensive guide for effective survey assessment.
Assessing Survey Research, a principled approach
E N D
Presentation Transcript
Assessing Survey Research,a principled approach Benoît Gauthier Circum Network Inc. CES Annual Conference Banff, May 20-23, 2001 gauthier@circum.com http://circum.com 819.770.2423
The problem • Need a way to assess survey quality • No structured framework exists • Attempts by WAPOR members • Same problem in various contexts, in particular in the judicial process
Criteria for quality research • Rigour • recognized best practices of survey research • Neutrality • absence of bias • Balance • sufficient yet parsimonious resources • Transparency • all the relevant background for an assessment
Survey research building blocks • Questionnaire • Sampling • Data collection • Data management • Data analysis • Reporting
The case of Internet surveys • Internet survey-specific issues • Mick P. Couper (POQ, 2000) • sampling frame coverage • non-response, for probability samples • browser variations in rendering • panel conditioning (longitudinal studies)
The case of Internet surveys • Sampling frame coverage = sN • Non-response = sN • Browser variations = qN • Panel conditioning = cN • Only neutrality is at issue
Internet surveys: conclusion • Internet-based surveying does not affect the basics of good research • Only 3 of 24 assessment areas show specifics • Good research is good research, on or off the Internet
Conclusion • Principles and criteria for an exhaustive, fair and constructive review of survey research projects • Guide to the experienced researcher • Discovery tool for the beginner This document is available at http://circum.com under "Recent documents"