140 likes | 149 Vues
The Annual Dutch Business Inquiry Developing and Testing the electronic form. Ger Snijkers Evrim Onat Jo Tonglet Statistics Netherlands Division of Business Statistics. Developing the electronic form. In three steps: 1. Small scale usability test (31-1-’05) - Small development team
E N D
The Annual Dutch Business InquiryDeveloping and Testing the electronic form Ger Snijkers Evrim Onat Jo Tonglet Statistics Netherlands Division of Business Statistics CES, 13-15 June 2005, Geneva
Developing the electronic form • In three steps: • 1. Small scale usability test(31-1-’05) • - Small development team • - Prototype of the e-form • 2. Improving the e-form (1-10-’05) • - additional usability tests • 3. Implementation (15-2-’06) CES, 13-15 June 2005, Geneva
1. Tested e-form 1 Tested form 2 Test waves 3 Research issues 4 Conclusions CES, 13-15 June 2005, Geneva
2. Test waves 1 Tested form 2 Test waves 3 Research issues 4 Conclusions CES, 13-15 June 2005, Geneva
3. Research issues 1 Tested form 2 Test waves 3 Research issues 4 Conclusions 1. How does the e-form work in practice? - Completing the questionnaire - Question-and-answer process • What features should be included to make it easy to use? - ‘Computer-assisted’ tools to make it respondent friendly - User wishes 3. How should the e-form be designed in relation to the paper form? - The same or a different design - ‘look-and-feel’ of paper and e-form CES, 13-15 June 2005, Geneva
3. Research issues1. How does the questionnaire work? 1 Tested form 2 Test waves 3 Research issues 4 Conclusions • Laborious and complex process - Long, complex questionnaire (≥ 25 items) - Complex completion process: several sessions, several informants kick-and-rush behaviour - Imagine ... a respondent sitting behind his/her computer ... Respondent got lost in the questionnaire CES, 13-15 June 2005, Geneva
3. Research issues2. Features to make it easy to use? 1 Tested form 2 Test waves 3 Research issues 4 Conclusions • What am I supposed to do (next)? - Easy to download and install - Clear instructions and explanations - Easy to send data back • How is the questionnaire built up? - Show how the questionnaire is structured - Help to find the way in the questionnaire - No hidden rules, no unexpected functionalities • Where am I? What did I do so far? - Provide overview of the completion process - Clear navigation, no scrolling - Printing function • Where can I put these data? - Entry-search (google) CES, 13-15 June 2005, Geneva
3. Research issues3. Design of paper and e-form? 1 Tested form 2 Test waves 3 Research issues 4 Conclusions • The computer is different than paper - The e-form reacts to the respondent - Reading from the screen is different - Navigating and getting an overview works differently - Kick-and-rush behaviour, even stronger than on paper In order to get good data in time … CES, 13-15 June 2005, Geneva
4. Conclusions 1 Tested form 2 Test waves 3 Research issues 4 Conclusions • Visual design Clear and logical Simple, transparent, consistent No hidden and unexpected functionalities • Support the completion process other mode, other features, other visual design Different than paper form, same ‘look-and-feel’ • Tailor to kick-and-rush behaviour Small sections, small tasks Short and clear explanations CES, 13-15 June 2005, Geneva
Web questionnaire design is communication design CES, 13-15 June 2005, Geneva