150 likes | 264 Vues
Explore the evolution, features, and evaluation process of web survey software tools for efficient data collection. Learn about the latest trends, pricing, social media presence, and software functionalities.
E N D
Web survey software Ana Slavec, Vasja Vehovar, Nejc Berzelak and Katja Lozar Manfreda University of Ljubljana, Slovenia COST WEBDATANET Meeting Amsterdam, November 30 2011
Web Survey Methodology website • http://www.websm.org • WebSM site launched in 1998 at the University of Ljubljana • 2003-2005: Redesign (5th EU Framework Program) • After 2005: All essential components being updated • 2009 AAPOR Warren J. Mitofsky Innovators Award • Some statistics: • 6087 authors • 5700+ bibliographic records (books, papers, conference presentations, etc.) • 400+ online survey software tools
WebSM Software Database • Software on WebSM since 2005: • http://www.websm.org/c/1283/Software/ • More than 400 software tools listed • Planned extensive evaluation and redesign in three steps: • Analysis of observations based on filled evaluation form (without hand-on testing) for all products:http://www.1ka.si/websm&preview=on • Testing low-price end software (easily accessible) - see draft evaluation form: http://www.1ka.si/a/10197&preview=on • Testing advanced solutions (expensive, hardly accessible)
I. Basic observations • 400 software listed with basic observations: • language, code availability, offices in countries, charges, hosting, trial version, sample questionnaires • The 2010 update found the number of newcomers is declining, while many software passed out • The 2011 update extended the list of observations • more details on pricing and languages, website data, social media, features, etc. • http://www.1ka.si/websm&preview=on
- Basic observations: pricing • 44 (12%) tools are free and 320 (88%) are commercial • Two groups: • low price-end pruducts with elaboreated price tables, • high-price-end products where a request for quote need to be submitted
- Basic observations: website data http://www.freewebsitereport.org
- Basic observations: social media • 116 software tools have a Facebook profile(~1500 fans on average) • 118 software tools have a Twitter profile(~1300 followers on average) • 52 software tools have a YouTube channel(~56 subscribers on average)
II. Web Survey Software Features Previous research: • Kazcmirek (2006, 2008), • Crafword (2002, 2006), • Zuckerberg (2006), • Vehovar et. al. (2005), • Berzelak (2006), • Macer (2002). • Focus on recruitments/invitations and questionnaire design. Foreseen evaluation : • Questionnaire design • Appearance • Routing • Sample management • Multi-mode support • Data security • Paradata • Data Export • Reporting http://www.1ka.si/a/10197&preview=on
Levels of web software support Web software can support different steps in the survey process: • The weakest point is preparing and drafting the questionnaire: draft versions are often prepared in a word processor and exchanged by e-mail. • Possible solution: Integration of questionnaire preparation and drafting into web survey software from the very first ideas.
Experiment • 16 graduate students working in 4 random groups working on two topics: attituded towards wild animals and sports activities of exchange students • Each group has done each topic in either mode: • Online, using pilot software developed to support required functionalities (except for inline editing) (experimental group) • Offline, using word processor and communicating through e-mail, online groups (control group) • Results: • No significant differences in time spent • Users were much more satisfied with online mode • More about the experiment (presentation at ISM Workshop): • http://workshop.websm.org/uploadi/editor/1314653351Websurveysoftware_final.pdf
Ideas for cooperation • Analysis of basic observatoins • Feedback on second questionnaire: http://www.1ka.si/a/10197&preview=on • Participation in the evaluation of top software tools (possible COST deliverable) • Paper on web survey software: • from eSocialScience (collaboration, teamwork) perspective, or • from web survey software perspective (key features, e.g. Crawford 2006)
More … • About Web Survey Methodology: • http://www.websm.org • About Our University and Faculty: • http://www.uni-lj.si • http://www.fdv.si • About Me: • E-mail: ana@ris.org • LinkedIN: http://www.linkedin.com/in/anaslavec 15