SlideServe
Télécharger Obtenir Pro
Menu
Accueil Pro
Préférences
ApparenceLight Aide et commentaires
© SlideServe · v2026

Robust Regression

keaira avatar
keaira
52 diapositives · 946 Views · Aug 30, 2014

Robust Regression. Regression Methods. We are going to look at three approaches to robust regression: Regression with robust standard errors Regression with robust standard errors including the cluster option Regression with random effect Regression with fixed effect.

Robust Regression - slide 1
01 / 52Robust Regression
1 / 17

Télécharger la présentation

Robust Regression
Une image / un lien ci-dessous est fourni (tel quel) pour télécharger la présentation

Politique de téléchargement : le contenu du site vous est fourni TEL QUEL pour votre information et votre usage personnel ; il ne peut être vendu, concédé sous licence ni partagé sur d’autres sites sans l’accord de son auteur.Le contenu vous est fourni TEL QUEL, pour votre information et votre usage personnel uniquement. Téléchargez la présentation en cliquant sur ce lien. Lors du téléchargement, si vous ne parvenez pas à télécharger une présentation, l’éditeur a peut-être supprimé le fichier de son serveur.Pendant le téléchargement, si vous ne parvenez pas à obtenir une présentation, le fichier a peut-être été supprimé par l’éditeur.

F I N

Plus de contenu associé

Transcription de la présentation

  1. Robust Regression

  2. Regression Methods • We are going to look at three approaches to robust regression: • Regression with robust standard errors • Regression with robust standard errors including the cluster option • Regression with random effect • Regression with fixed effect

  3. We will look at a model that predicts the api 2000 scores • Our focus is whether the average class size in K through 3 (acs_k3) and average class size 4 through 6 (acs_46) affect the academic performance

  4. use a new data set • http://www.ats.ucla.edu/stat/stata/webbooks/reg/elemapi2

  5. 4.1.1 Regression with Robust Standard Errors • The Stata regress command includes a robust option for estimating the standard errors using the Huber-White sandwich estimators. • Such robust standard errors can deal with a collection of minor concerns about failure to meet assumptions, • Minor problems about normality • Heteroscedasticity • Some observations that exhibit large residuals, leverage or influence.

  6. With the robust option, the point estimates of the coefficients are exactly the same as in ordinary OLS, but the standard errors take into account issues concerning heterogeneity and lack of normality.

  7. As with the robust option, the estimate of the coefficients are the same as the OLS estimates, but the standard errors take into account that the observations within districts are non-independent.  • If you have a very small number of clusters compared to your overall sample size it is possible that the standard errors could be quite larger than the OLS results. For example, if there were only 3 districts, the standard errors would be computed on the aggregate scores for just 3 districts. 

  8. Using the Cluster Option • The elemapi2 dataset contains data on 400 schools that come from 37 school districts. It is very possible that the scores within each school district may not be independent, and this could lead to residuals that are not independent within districts.   • We can use the cluster option to indicate that the observations are clustered into districts (based on dnum) and that the observations may be correlated within districts, but would be independent between districts. 

  9. Control for random effect (school district)

  10. Control for fixed effect (school district)

  11. 2.4 Examine Distribution Assumption • Classical regression assumption requires that the outcome (dependent) to be normally distributed. • In large sample, this assumption is not that important because of Central Limit Theory • In small sample, however, the distribution assumption could be relevant • We will investigate issues concerning normality.

  12. Here we check the normality of enroll • We start with making some graphs • Hisgram • Kdesnity

  13. We can use the normal option to superimpose a normal curve on this graph and the bin(20) option to use 20 bins.  The distribution looks skewed to the right.

  14. An alternative to histograms is the kernel density plot, which approximates the probability density of the variable. • Kernel density plots have the advantage of being smooth and of being independent of the choice of origin, unlike histograms. • Stata implements kernel density plots with the kdensity command.

  15. Having concluded that enroll is not normally distributed, how should we address this problem?  • We may try to transform enroll to make it more normally distributed.  Potential transformations include taking the log, the square root or raising the variable to a power. • Stata includes the ladder and gladder commands to help selecting the right transformation. Ladder reports numeric results and gladder produces a graphic display.

  16. This indicates that the log transformation would help to make enroll more normally distributed.  • Let's use the generate command with the log function to create the variable lenroll which will be the log of enroll. • Note that log in Stata will give you the natural log, not log base 10. To get log base 10, type log10(var)

  17. 2. 5 Summary • Simple Regression • Multiple Regression • Hypothesis Testing • Examine the normality assumption