EMR 6500: Survey Research

1. EMR 6500:Survey Research Dr. Chris L. S. Coryn Kristin A. Hobson Spring 2013

2. Agenda Elements of the sampling problem Some basic concepts of statistics Case Study #1

3. Elements of the Sampling Problem

4. Technical Terms (Again) An element is an object on which a measurement is taken A population is a collection of elements to which an inference is made A sample is a collection of sampling units drawn from a frame or frames Sampling units are nonoverlapping collections of elements from the population that cover the entire population A frame is a list of sampling units

5. How to Select the Sample: The Design of the Survey Sample

6. How to Select the Sample The objective of sampling is to estimate population parameters such as the mean, proportion, or total The quantity of information is controlled by the number of units included in a sample and the method used to select a sample

7. How to Select the Sample • The primary questions addressed by sampling theory are: • What sampling procedure should be used? • What number of sampling units should be included in a sample? • The answer to both depends on how much information one is willing to buy

8. How to Select the Sample If is the population parameter of interest and is an estimator of then a bound on the error of estimation, B, should be specified that represents the difference in absolute value between and

9. How to Select the Sample A probability, , specifies the fraction of times in repeated samples the the error of estimation is less than B

10. How to Select a Sample Typically B is set to and, therefore, will be approximately .95 Once a bound, B, has been specified, along with its associated probability, , different sampling designs can be compared to determine which is most efficient for a particular purpose

11. Probability Sampling Statistical estimation requires randomness in sampling designs so that properties of statistical estimators can be assessed probabilistically Sampling designs based on planned randomness are probability samples

12. Simple Random Sampling The basic probability sampling design, simple random sampling, consists of selecting a group of n sampling units in such a way that all samples of size n have the same probability of selection

13. Stratified Random Sampling A stratified random sample is one obtained by separating the population elements into discrete, nonoverlapping groups, called strata, and then selecting a simple random sample from each stratum

14. Stratified Random Sampling • The principle reasons for using stratified random sampling rather than simple random sampling are: • Stratification may produce a smaller bound on the error of estimation than would be produced by a simple random sample of the same size (this is particularly true if measurements within strata are homogenous) • The cost per observation may be reduced by stratification of the population elements into convenient groupings • Estimate of population parameters may be desired for subgroups of the population (these subgroups should then be identifiable strata)

15. Cluster Sampling Cluster sampling is a less costly alternative to simple or stratified random sampling if the cost of obtaining a frame that lists all population elements is very high or if the cost of obtaining observations increases as the distance separating elements increases

16. Cluster Sampling • Cluster sampling is an effective design for obtaining a specified amount of information under the following conditions: • A good frame listing all population elements is not available or is very costly to obtain, but a frame listing clusters is easily obtained • The cost of obtaining observations increases as the distances separating the elements increases

17. Cluster Sampling Clusters typically consist of herds, households, or other units of clustering (e.g., an orange tree forms a cluster of oranges for investigating insect infestations) A farm herd contains a cluster of livestock for estimating proportions of diseased animals Elements within a cluster are often physically close together and hence tend to have similar characteristics and the measurement on one element within a cluster may be correlated with the measurement on another

19. Systematic Sampling Systematic sampling involves random selection of one element from the first kelements and then selecting every kth element thereafter

20. Systematic Sampling • Systematic sampling is a useful alternative to simple random sampling for the following reasons: • Systematic sampling is easier to perform in the field and hence is less subject to selection errors by field-workers than are either simple random samples or stratified random samples, especially if a good frame is not available • Systematic sampling can provide greater information per unit cost than simple random sampling can provide for certain populations with certain patterns in the arrangement of elements

21. Multi-Stage Sampling • Sampling conducted in stages, often taking into account the hierarchical (nested) structure of a population • Primary sampling units (PSUs) are sampled first (e.g., cities) • Secondary sampling units (SSUs) are sampled next (e.g., city blocks) • Ultimate sampling units (actual elements) are sampled last (e.g., households) • Especially useful when no frame can be established for a single-stage sample

22. Multi-Stage Sampling For a fixed sample size of elements, a multi-stage sampling design is almost always less efficient than a simple random sample (though often more feasible) Variance estimation methods for complex sample designs must be used to obtain correct standard errors

23. Multiple-Frame Sampling

24. Quota Sampling A nonprobability sampling method (although randomness is sometimes part of the design) in which a prespecified number of surveys is obtained from specific subgroups of a target population (e.g., Republicans, Democrats) Introduces unknown sampling biases into survey estimates

25. Chain-Referral Sampling Snowball sampling methods for sampling in rare/hard-to-reach populations One or more persons having the trait of interest serve as seeds and identify others Persons with many connections are likely to be included, whereas isolated persons may not be included at all Information about network connections in the sample can be used to weight sample units (respondent-driven sampling, which is premised on Markov-chain theory)

26. Recruitment Network

27. Equilibrium

28. Planning a Survey

29. Planning A Survey Statement of objectives Target population The frame Sample design Method of measurement Measurement instrument Selection and training of fieldworkers The pretest (pilot) Organization of fieldwork Organization of data management Data analysis

30. Some Basic Concepts of Statistics

31. Finite Population Correction Most statistical theory is premised on an underlying infinite population Sampling theory and practice is founded on the assumption of sampling from a finite population In the general framework of finite population sampling, sample sizes of size n are taken from a population of size N In the finite population case, the variance estimate of a statistical estimator must be adjusted due to the fact that not all data from a finite population are observed, using the finite population correction (fpc)

32. Finite Population Correction For simple random samples (without replacement) the fpc is expressed as or Where f is the sampling fraction or rate

33. Finite Population Correction The fpc is, therefore, the fraction of a finite population that is not sampled Because the fpc is literally a factor in the calculation of an estimate of variance for an estimated finite population parameter, the estimated variance is reduced to zero if n = N

34. Finite Population Correction • When n is small relative to N, the fpc is close to unity • In samples of very large populations f is very small and the fpc may be ignored • Ignore if 1-n/N>.95 • Although the fpc is applicable for estimation, it often is not necessary for many inferential uses such as statistical significance testing (e.g., comparison between sampled subgroups).

35. Estimate of Population Mean

36. Estimate of Population Proportion where

37. Estimate of Population Total

38. Case Study #1

39. Case Study Activity • In small groups, address the following questions in relation to Case Study #1 relying only on the material that was discussed thus far in the semester • Has the surveyor committed any serious error(s)? • If so, what type and why? If not, why?