Download
1 / 14
170 likes | 316 Vues
Bivariate Regression Analysis. Theoretical Models Basic Linear Models: Deterministic Version Basic Linear Models: Stochastic Version Statistical Assumptions Estimating Linear Models Residuals (and the Pursuit of Truth…) An Example. Theoretical Linear Models.
E N D
Bivariate Regression Analysis • Theoretical Models • Basic Linear Models: Deterministic Version • Basic Linear Models: Stochastic Version • Statistical Assumptions • Estimating Linear Models • Residuals (and the Pursuit of Truth…) • An Example
Theoretical Linear Models • The basis of “causality” in models • Time ordering • Co-variation • Non-spuriousness • Examples • Fire Deaths f (# of fire trucks at the scene) • Job Retention f (current job satisfaction) • Income f (education)
a b Deterministic Linear Models • Theoretical Model: • b0andb1are constant terms • b0 is the intercept • b1 is the slope • Xi is a predictor of Yi Yi b0 Xi
Stochastic Linear Models • E[Yi] = b0+b1Xi • Variation in Y is caused by more than X: error (ei) • So:
ei ei=0 X Assumptions Necessary for Estimating Linear Models 1. Errors have identical distributions Zero mean, same variance, across the range of X 2. Errors are independent of X and other ei 3. Errors are normally distributed
Y X Normal, Independent & Identical ei Distributions (“Normal iid”) Problem: We don’t know: a) if error assumptions are true; b) values for b0 and b1 Solution: Estimate ‘em!
Estimating Linear Models This is the formula for RESIDUALS -- which you will come to know and cherish.
Residuals: Statistical Forensics • Residuals measure prediction error: • ei > 0 if Yi > Yi • ei < 0 if Yi < Yi Y ^ ^ X
Stata and Regression: Predicting Incarceration with Average income • Stata dataset: Guns.dta • From “Data for empirical exercises” • What are your expectations? Why? • Stata command: • Regression: “regress incarc_rate avginc” • Output:
In our data, some observed values are larger than would be predicted by average income alone Residual Analysis
