PHSSR IG CyberSeminar Introductory Remarks

1. PHSSR IG CyberSeminarIntroductory Remarks Bryan Dowd Division of Health Policy and Management School of Public Health University of Minnesota

2. Causation versus AssociationWho Cares? • The purpose of public health systems and services research is to examine the impact of the organization, financing, and delivery of public health services at the local, state, and national levels on population health. • By “impact,” I assume we mean the causal effect on population health of changing one of those factors.

3. Causation versus Association • Linking “impact” and “causal effect” to change highlights a common distinction between causation and association. • “Association” (the weaker term) often refers to relationships among variables whose observed values come from a single observation of each subject (cross-sectional data). • “Causation” often refers to relationships among variables whose observed values come from multiple observations of each subject (time-series data).

4. Causation versus Association But many analytic techniques are designed to draw causal inferences from cross-sectional data. And the fact that two variables change their values over time is no guarantee that the change in one variable caused the values of the other variable to change. Much of our empirical research attempts to distinguish causal relationships from spurious relationships.

5. But from a practical perspective … • In public health, there often comes a time when we must act: choosing a particular course of action or the status quo. Examples: • Should we impose a quarantine? • Should we inspect restaurants once a month or once a decade? • Should we inoculate the population against a particular disease?

6. Association = status quo? The practical and empirical question is, “Do the data support taking one specific course of action versus an alternative?” In that context, saying the policy variable (that we control) and the outcome variable (that we are trying to influence) are merely associated, but not causally related, is equivalent to answering, “No. We should not take a particular course of action.” So “association” often is synonymous with “stay the course” or “maintain the status quo.”

7. But that’s illogical ! “Staying the course” when the data do not support causal links between the policy variable and the outcome is illogical. If we can’t establish a causal relationship between the policy variable and the outcome of interest, then we have no way of knowing whether “staying the course” will continue to be “associated with” the same value of the outcome variable that it is now.

8. The bottom line … We may speak of “association” but we always act as though we have drawn valid causal inferences, even when we choose not to change anything. So the most important question about causal inference is not how to pretend we don’t draw them, but how to make them as reliable as possible so that we make good decisions.

9. The Basic Research Question  X Y What would happen to Y if we were to change X by one unit (sometimes we add, “… holding the effect of other variables constant?”) X could be continuous (e.g., income) or binary (e.g., treatment versus control group). Sometimes called the “marginal effect” of X on Y, which we could denote β.

10. Challenges: Omitted variable bias  Enrollment in a Health outcome smoking cessation program Family health history Omitted variable, Omitted Confounder, Spurious Correlation

11. Challenges: Mediating Variables  Education Health outcome Income Controlling for income in a regression of health outcomes on education means that β is the partial effect of education on health outcomes, not the full effect. Which one do you want to estimate?

12. Challenges: Reverse Causality 1 Health Insurance Health Status 2 Reverse causality We hypothesize that having health insurance affects health status, but the relationship we observe could be due, at least in part, to the reverse effect (medical underwriting).

13. What Methodologies? What methodologies can be used to assess causal relationships in HSR and PHSSR? What forms of manipulation of the policy variables of interest can produce reliable causal inference? This is the area of great disagreement. When and why did that disagreement occur?

14. Regression & Correlation Multivariate regression & Partial correlation Experimental data: Galton, Pearson, Fisher Observational data: Wright Randomized trials Structural equation modeling Sample selection models Instrumental variables Propensity scores DAGs Natural experiments A Brief History The “big split” in 1926 - 1928 Time Panel data (Granger causality, etc.)

15. A Brief History 1926 - Ronald Fisher. Randomization. We (the analyst) must manipulate the policy variables. A research design solution. 1928 - Philip Wright. Instrumental variable estimation. Other types of manipulation can produce valid causal inference. A modeling solution. Many social scientists still are reluctant to use the word “causal” to describe their causal models.

16. Today Today we have a broad menu of methods to choose from, but residual resistance to using approaches other than randomized trials. Some estimation approaches: 1. Randomization 2. Instrumental variables 3. Natural experiments 4. Sample selection models

17. Example  Health department Population health characteristics or outcomest programs (“interventions”)t-1 Past health problems Community risk (unobserved) factors (unobserved)

18. One Solution: Randomization  Randomization Intervention Outcome v u Randomly assign health departments to interventions. Often not practical, ethical or cost-effective.

19. Another Solution: Instrumental Variables and Natural Experiments  External event Intervention Outcome v u Some event external (“exogenous”) to the health department (e.g., legislation, “encouragement”) that, like randomization, results in the intervention being adopted by some departments but not others, but has no direct effect on the outcome.

20. Another Solution: Sample Selection Models  External event Intervention Outcome v ρ u Incorporate the correlation (ρ) of unobserved variables (v and u) into the estimation of the causal parameter β. Same data requirements for all methods. Estimation approaches vary for different types of dependent variables.

21. Two Applications The relationship between local public health spending and measures of public health outcomes. The policy question: What is the effect of changing the level of local public health spending on public health outcomes? Both authors recognize that local public health departments were not randomized to different levels of spending.