Questionnaire Design

1. Questionnaire Design Diana M. Bensyl, PhD, MA EIS Field Assignments Branch, EFAB Supervisor

2. The Survey Process Hypothesis and planned analysis dictate what to collect and how Balance content value to sample burden

3. Questionnaire Basics Use when other data unavailable or inadequate Decide if using sample or cohort Consider best method of administration Need for qualitative and quantitative items Purpose will influence content Secondary analysis Medical recordsPurpose will influence content Secondary analysis Medical records

4. Use of Findings Surveillance or descriptive epidemiology Outbreak investigation Evaluation or needs assessment Theory or hypothesis testing (exploratory)

5. Structuring a Useful Survey Basic structure Data collection methods Developing survey items Standardization

6. Survey Purpose Specific objectives Outline basic analyses (shell tables) Scope of information needed What do you know already? What else can guide you? Think these through before you write items Structure questions and responses so they are easily analyzeable. Draft an outline of the final report , detailing how to answer the fundamental data analysis concerns. This pinpoints exactly which pieces of information will be required and leads to the construction of a "data analysis plan"�which connects the data collection objectives to each of the specific questions and how they should be asked. Think these through before you write items Structure questions and responses so they are easily analyzeable. Draft an outline of the final report , detailing how to answer the fundamental data analysis concerns. This pinpoints exactly which pieces of information will be required and leads to the construction of a "data analysis plan"�which connects the data collection objectives to each of the specific questions and how they should be asked.

7. Survey Opening ID self, organization Explain purpose Describe questions and how they�ll be asked Time estimate Permission to refuse Assurance of confidentiality HELLO, My name is Dr. Bensyl from CDC. We are gathering information about people�s experiences at Camp X. I would like to ask you some multiple choice questions about health and health practices. This should take about 15 minutes. You do not have to answer any question you do not want to, and you can end the interview at any time. Any information you give me will be confidential. HELLO, My name is Dr. Bensyl from CDC. We are gathering information about people�s experiences at Camp X. I would like to ask you some multiple choice questions about health and health practices. This should take about 15 minutes. You do not have to answer any question you do not want to, and you can end the interview at any time. Any information you give me will be confidential.

8. Survey Body Begin with easy, non-intrusive questions Most important questions near beginning Sensitive questions near end During the past 30 days, have you had at least one drink of any alcoholic beverage such as beer, wine, a malt beverage or liquor? During the past 30 days, how many times have you driven when you�ve had too much to drink? During the past 30 days, have you had at least one drink of any alcoholic beverage such as beer, wine, a malt beverage or liquor? During the past 30 days, how many times have you driven when you�ve had too much to drink?

9. Survey Closing Thank for participation Offer how and when results available That was my last question. Everyone�s answers will be combined to help us provide information about the health practices of people in this state. If you have any questions about the survey, please call (give appropriate state telephone number). Thank you very much for your time and cooperation. That was my last question. Everyone�s answers will be combined to help us provide information about the health practices of people in this state. If you have any questions about the survey, please call (give appropriate state telephone number). Thank you very much for your time and cooperation.

10. Tips Be culturally sensitive Logical order with appropriate transitions Pre-coded responses facilitate data entry

11. Structuring a Useful Survey Basic structure Data collection methods Developing survey items Standardization

12. Questionnaire Method Considerations Cost Time Logistics Resources Question content Resources: how many questionnaires vs # of staffResources: how many questionnaires vs # of staff

13. Method Effects on Data Collection Length of the questionnaire Complexity of the questionnaire Reading level of items Disclosure of sensitive information Data quality (e.g., completeness) Ease of data entry and analysis Once you�ve chosen a method, then you need to make sure that you work within the constraints of that method.Once you�ve chosen a method, then you need to make sure that you work within the constraints of that method.

14. Types of Survey Data Collection Self-administered (written) Telephone Personal interview Internet

15. Self-Administered Pros Less expensive Easy to administer Individual or group Mail Anonymous May aid disclosure of sensitive information

16. Self-Administered Cons Must consider reading level & directions Need simple format (few or no skips) If anonymous, cannot address inconsistent or missing responses Variable response rates (depend on situation & setting)

17. Telephone Interview Pros Can be automated Complex survey formats possible Minimize inconsistent/missing responses May aid disclosure of sensitive information CATI Com A computerized questionnaire is administered to respondents over the telephone. The interviewer sits in front of a computer screen Upon command, the computer dials the telephone number to be called. When contact is made, the interviewer reads the questions posed on the computer screen and records the respondent's answers directly into the computer. Interim and update reports can be compiled instantaneously, as the data are being collected. CATI software has built-in logic, which also enhances data accuracy. The program will personalize questions and control for logically incorrect answers, such as percentage answers that do not add up to 100 percent. The software has built-in branching logic, which will skip questions that are not applicable or will probe for more detail when warranted. puter-assisted telephone interviewingCATI Com A computerized questionnaire is administered to respondents over the telephone. The interviewer sits in front of a computer screen Upon command, the computer dials the telephone number to be called. When contact is made, the interviewer reads the questions posed on the computer screen and records the respondent's answers directly into the computer. Interim and update reports can be compiled instantaneously, as the data are being collected. CATI software has built-in logic, which also enhances data accuracy. The program will personalize questions and control for logically incorrect answers, such as percentage answers that do not add up to 100 percent. The software has built-in branching logic, which will skip questions that are not applicable or will probe for more detail when warranted. puter-assisted telephone interviewing

18. Telephone Interview Cons Can be expensive Requires trained staff or special software Time consuming Surveys need to be brief Uncomfortable for many respondents Not everyone has a phone Many people monitor calls

19. Personal Interview Pros Complex survey formats can be used Response rates generally high Interviewer presence is motivating Can be short or long Minimizes inconsistent or missing responses Easy to diagnose question content problems

20. Personal Interview Cons Expensive Requires trained staff Complex logistics Time consuming Least anonymity Can inhibit disclosure of sensitive information

21. Internet Survey Pros and Cons Pros Low cost Fast Eases data analysis Might be good for sensitive topics Cons Cannot control who responds Survey easily terminated

22. Structuring a Useful Survey Basic structure Data collection methods Developing survey items Standardization

23. Operationalization of Variables