1 / 62

Designing Your Survey

Designing Your Survey. By the end of this lesson you will be able to: Define the 6 goals of the questionnaire survey. Differentiate between a biased and an unbiased survey question. Develop survey questions from preliminary objectives. Design a survey that:

elvin
Télécharger la présentation

Designing Your Survey

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Designing Your Survey

  2. By the end of this lesson you will be able to: • Define the 6 goals of the questionnaire survey. • Differentiate between a biased and an unbiased survey question. • Develop survey questions from preliminary objectives.

  3. Design a survey that: • has appropriate sample sizes and strategy • measures the impact of your Pride campaign on SMART objectives for each target audience • measures exposure to your Pride campaign activities

  4. Thurs Learning to Detect Bias and Poorly written questions Reading Activity Writing the best possible survey questions Creating Questions from Preliminary Objectives Drafting Your Stages of Behavior Questions Determining Sample Sizes and Calculating Your Sites Sample Size Assignment, Rubrics and Research Plan Review Friday SESSION TOPICS AND TIMING

  5. Activity 1: Learning to Detect Bias and Poorly Written Questions (Basics) PURPOSE: • To practice recognizing “bias” on questions and identify what makes a question biased 45 minutes

  6. Revisit the Theory of Change

  7. INSTRUCTIONS: Read the Designing Your Survey Lesson Content (pp 321-336) – 20 minutes Proceed to your workshop group (3-4 persons per groups) and answer the guiding questions in pages 295-298 – 10 minutes Record your groups responses and report your results (5 minutes) ACTIVITY 2: READING

  8. Why Conduct an Interview Survey • Surveys are research tools that provide quantitative information about people in your target area. • The systematic sampling will make your respondents “representative” of the population of interest. • Surveys are ideal tools to measure change in your target audiences because you can measure the “baseline” and post-campaign levels. • The difference between baseline and post-campaign survey results provides an estimate of the impact of your campaign on that variable.

  9. Questionnaires and your Pride Campaign • You will implement 2 surveys during your campaign: • During the planning phase (baseline) • At the conclusion of your camp

  10. Goals for your survey 1. Describe your Target Audience(s) “ 90 % of all fishers surveyed are male and 60 % of those are over the age of 40”

  11. Goals for your survey– pre campaign 2. Assign Respondents to their Appropriate Stage-of-Behavior-Change “Among fishermen surveyed, 5 percent are currently setting rattraps on their boats, 5 percent are currently thinking about setting rattraps...”

  12. Goals for your survey– pre campaign 3. Establish a Baseline for your SMART Objectives “30% of Fishers know that rats get to Serena on fishing boats” can be the basis for setting the SMART Objectives: “By 2013, the percentage of Fishers who know that rats travel to Serena on their boats will increase from 30% to 50%

  13. K IC A Goals for your survey– post campaign Attitude Knowledge Interpersonal communications 4. Measure the impact of your PRIDE campaign in achieving your SMART Objectives Control site

  14. Goals for your survey– pre campaign CARE FOR THE LASTING PRIDE 5. Measure the Audience Exposure to your Pride Campaign and Attribute Effects to your Pride Campaign A campaign to protect Tagbilaran City’s underwater kingdom

  15. Goals for your survey– pre campaign 6. Ground Truth – test your assumptions about community, strategy, and ToC "99% of community members know about the importance of keeping rats off of the island”… what does this tell you about your ToC?

  16. DESIGNING YOUR QUESTIONNAIRE

  17. A Note of Caution… Developing and implementing quantitative surveys is a lot of work • bias questions • ask questions ofthe wrong people, or at least not enough of the “right” ones, of your critical target audience(s) • ask too many questions • make mistakes in choosing your samples - your baseline and post-campaign samples are not comparable • make mistakes during data entry you enter the wrong data into the wrong variable and end up with meaningless results

  18. Biased Questions The most important challenge of survey questions is that they can be BIASED: Biased questions mean: they make respondents tend to pick one response over another because of the way the question is worded or the way the response options are offered.

  19. Biased Questions Biased questions: • Try to educate • Assume what they ask (are leading) • Are double-barreled, asking 2 questions at once • Are ambiguous or confusing

  20. Key Elements of Good Survey Questions? • Unbiased – not leading or pushing respondents towards a specific answer • Tied to Objectives • Time bound • Clear • Not Judgemental

  21. Writing good survey questions Other important criteria for good survey questions: • Include a relevant time frame • Use filter questions as needed • Don’t overlap (e.g. age ranges) • Use appropriate language for the respondents

  22. Activity 3: Writing the Best possible Survey Questions Purpose: To Practice writing “good” survey questions and appropriate response choices Instructions: (Turn to pages 299-310) • Work in pairs • Read through each of the survey questions assigned to you and the corresponding responses found • For each of the question, do the following: • Identify what makes this as poorly written questions

  23. Survey Questionnaire #1

  24. Survey Questionnaire #2

  25. Survey Questionnaire #3

  26. Survey Questionnaire #5

  27. Survey Questionnaire #6

  28. Survey Questionnaire #7

  29. Survey Questionnaire #8

  30. Survey Questionnaire #9

  31. Survey Questionnaire #10

  32. Survey Questionnaire #11

  33. YOUR QUESTIONS?

  34. Read and review the lesson content especially on Biased and Unbiased questions (pages 326-336) 2. Read Lesson Content pages 337-348. Write in a piece of paper 2-3 questions (per participant) that you would want to be clarified or know more. READING ASSIGNMENTS FOR TOMORROW

  35. REQUIREMENTS: Identified Preliminary Target Audience Preliminary SMART Objectives DESIGNING YOUR QUESTIONNAIRE

  36. ONLY ONE QUESTIONNAIRE (Pre and Post KAP Survey) for all target audiences • Some questions though may not be applicable to some audience • Create a system where some questions are answered by certain target audience while others are not. How Many QUESTIONNAIRES?

  37. Factors that can affect your survey are: • the number of respondents • length of questions • who will administer • Data entry • Data analysis and writing • Cost • Include questions that will answer only the six goals of survey How Many QUESTIONS should I ask?

  38. Where do the survey questions come from? KEY CHARACTERISTICS • Date • Enumerator Name • Form # • Geographic Area/ Sampling location • Respondent Information: Age, gender, education level, income sources, religion? • Knowledge Question • Attitude Question • Interpersonal Communication Question • Behavior Change Question • Stages of Behavior Change • Barrier Removal (As Appropriate) • Exposure to Materials

  39. SMART Examples

  40. Behavior Change and Questionnaire Surveys

  41. Sample Behavior Change Questions • Clearly define the “desired behavior change” of your campaign • Make one question each along the Stages of Behavior (Behavior Change continuum) • Example:..\..\EXAMPLE behavior change questions.docx

  42. Exposure Questions • Make at least 8-10 Examples of potential materials that you will be producing in your campaign and ask the participants if they have see • See example ..\..\EXAMPLE media exposure questions.docx

  43. TOP TIPS • Complete each interview in about 30 minutes or less • The categories should also be “exhaustive;” that is, there is no other possible response that a respondent wants to give but cannot. • Be sure that your questions directly relate to what it is you are studying, especially for those questions intended to measure SMART objectives.

  44. Top Tips….. 4. Be very aware of the fact that people in your target communities may not have the same vocabulary as you. 5. If you want to force people to choose from a short list of possible responses, use the closed-ended format. 6. If there are some questions that you feel might be sensitive you should put these at the end of the survey so that respondents don’t get upset at the beginning.

  45. Top Tips 7. Have one person do the first translation from the language the survey was drafted in into the second language. Then, have a different person translate the survey back into the original language (back translation). 8. “Administer the survey to a small number of respondents (five is usually enough) similar to your target population to make sure that categories are clear and complete”.

  46. Key Elements of Good Survey Questions? • Unbiased – not leading or pushing respondents towards a specific answer • Tied to Objectives • Time bound • Clear • Not Judgemental

  47. Writing good survey questions Other important criteria for good survey questions: • Include a relevant time frame • Use filter questions as needed • Don’t overlap (e.g. age ranges) • Use appropriate language for the respondents

  48. Writing good survey questions FILTER QUESTIONS In the past 6 months, have you talked to anyone about benefits to the community of a well enforced sanctuary? YES NO If you have, please tell me all of the people with whom you have talked to about this. [ ] Have not talked to anyone [ ] Talked to spouse/partner [ ] Talked to parents, or in-laws [ ] Talked to your children aged 16 or older [ ] Talked to your children aged 15 or younger [ ] Talked to friend or neighbour [ ] Talked to village elder or local authority [ ] Talked to National government environmental officials [ ] Talked to Non-government environment officials [ ] Talked to Local government environmental officials [ ] Talked to a Local XXXX Fisher or Gleaner [ ] Other ________________

  49. Writing good survey questions • RESPONSE QUESTIONS TO CATEGORIES SHOULD NOT OVERLAP • PROVIDE ACCURATE TRANSLATION • CLOSE VERSUS OPEN-ENDED QUESTIONS

  50. ORDER OF QUESTIONS • Use transitions between modules – use to switch from one topic to another • Provide Accurate translation • Review and Pretest your Questionnaire

More Related