Distribution and Outliers

1 / 22

# Distribution and Outliers

## Distribution and Outliers

- - - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - - -
##### Presentation Transcript

1. Distribution and Outliers

2. Screening (Significant Effects)

3. Hadlum vs Hadlum A univariate example that illustrates deviation from a normal pattern.

4. Normal duration Percentage (n=13634) Duration of Pregnancy Bannet (1978) Appl. Statist. 27, 242-250

5. Comparison of Hadlum Jr. to normal pattern Normal duration Percentage (n=13634) Hadlum Jr.

6. Deviation = observed value - predicted value residual measurement Model  ^ y y Model validation

7. Normal Population - Cumulative plots Traditional Graphical paper Normal distribution paper

8. Normal plot 1) Sort the observations in increasing order 2) Let each observation present a percent interval that equals of the normal distribution If the observations are normally distributed, they plot like a straight line in the normal plot! Deviation from straight line implies outlying observations or non-normal distribution

9. Scull capacity of the Maoris

10. Sculls from a cemetery maximum Karl Pearson (1931) Tables for Statisticans and Biometricans, Biometric Lab., London

11. Is the largest scull from a Maori? Hypothesis: The Maoris have less scull capacity than the whites - the largest scull is a contaminant shipwrecked sailor or missionary?

12. Probability plot Scull Capacity

13. What to do with the damned point destroying the curve?

14. The easy way: Erase it!

15. Example P. Garrigues R. De Sury M. L. Angelin J. Bellocq J. L. Oudin M. Ewald Geochemica et Cosmochimica Acta, 52, (1988) 375-384

16. Data ? ?

17. Robust regression? Two outliers Useful tool to avoid thinking? Sloppy data analyst can find relief in robust regression

18. Observation r=0.865 Two phenomena influencing the ratio (predictor) No prediction possible!

19. Parallel displacement - perfect result for the one who wants to be “straight-lined”

20. Let the computer restore harmony and beauty