1 / 29

Monday, November 11 Statistical Power

Monday, November 11 Statistical Power. Monday, November 12 Statistical Power It teaches you about the importance of effect size,  (gamma). Monday, November 12 Statistical Power It teaches you about the importance of effect size,  (gamma).

hoai
Télécharger la présentation

Monday, November 11 Statistical Power

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Monday, November 11 Statistical Power

  2. Monday, November 12 • Statistical Power • It teaches you about the importance of effect size,  (gamma).

  3. Monday, November 12 • Statistical Power • It teaches you about the importance of effect size,  (gamma). • It helps put the risk of Type I error,  (alpha) into perspective.

  4. Monday, November 12 • Statistical Power • It teaches you about the importance of effect size,  (gamma). • It helps put the risk of Type I error,  (alpha) into perspective. • It helps you appreciate the value of the sample size, N.

  5. Monday, November 12 • Statistical Power • It teaches you about the importance of effect size,  (gamma). • It helps put the risk of Type I error,  (alpha) into perspective. • It helps you appreciate the value of the sample size, N. • It simply makes you a better person.

  6. Monday, November 12 • Statistical Power • It teaches you about the importance of effect size,  (gamma). • It helps put the risk of Type I error,  (alpha) into perspective. • It helps you appreciate the value of the sample size, N. • It simply makes you a better person. •  =  x f (N)

  7.  =  x f (N)

  8. Let’s sample from HSB universe of N=300 where we know the population values.

  9. What causes you to decide on a value of  under H1?

  10. What causes you to decide on a value of  under H1? The alternative hypothesis should be the point at which we say, “aha, it’s important enough to pay attention to”!

  11. What causes you to decide on a value of  under H1? The alternative hypothesis should be the point at which we say, “aha, it’s important enough to pay attention to”! Would you pay attention to Stanley Kaplan raising SAT’s by 10 points? 20 points? 30 points? …

  12. What causes you to decide on a value of  under H1? The alternative hypothesis should be the point at which we say, “aha, it’s important enough to pay attention to”! Would you pay attention to Stanley Kaplan raising SAT’s by 10 points? 20 points? 30 points? … So you set the value of alternative hypothesis at a point that you care about -- a value of practical significance.

  13. What causes you to decide on a value of  under H1? The alternative hypothesis should be the point at which we say, “aha, it’s important enough to pay attention to”! Would you pay attention to Stanley Kaplan raising SAT’s by 10 points? 20 points? 30 points? … So you set the value of alternative hypothesis at a point that you care about -- a value of practical significance. Power analysis says, if the effect is of that magnitude, what is the risk that I will fail to detect it, by failing to reject the null hypothesis.

  14. If I really care about a 5-point difference, then this is bad news.

  15. “Reality” H0 True H0 False Type I Error  Reject H0 Yeah! Decision Yeah! Don’t Reject H0 Yeah!

  16. “Reality” H0 True H0 False Yeah! Type I Error  Reject H0 Yeah! Decision Yeah! Type II Error  Don’t Reject H0 Yeah!

  17. Statistical Power 1 -  The ability to avoid Type II error (fail to reject H0 that should be rejected).

  18. Ordinarily, one is well advised to take the largest sample that is practical and then determine if this sample has adequate power for detecting a difference large enough to be of interest. Researchers often strive for power  80 with  = .05. More often, however, one finds that power is low even for detecting differences large enough to be of practical importance.

  19. Problem You develop a new measure of social efficacy for adolescent girls, with 24 items on a 3-point scale. The scale seems to have  = 18, and  = 16. You are asked to evaluate a new program to promote social efficacy in adolescent girls, and want to use your scale. You sample 16, but alas find that the sample mean of 22 does not allow you to reject the null hypothesis at =.05. You’re really really frustrated because you think that a 4-point gain is meaningful. What should your next steps be?

  20.  =  x f (N)  =  N 1/2  = 4/16 = .25 N = 16  = 1.0

  21.  =  x f (N)  =  N 1/2  = 4/16 = .25 N = 16  = 1.0 What would it take for power = .80? N = ( /  )2 N = (2.8 / .25)2 = 125.44

  22. What can you do to increase power? • Increase n

  23. What can you do to increase power? • Increase n • Decrease measurement error

  24. What can you do to increase power? • Increase n • Decrease measurement error • Increase , say, from .05 to .10 (or fiddle with tails*)

  25. What can you do to increase power? • Increase n • Decrease measurement error • Increase , say, from .05 to .10 (or fiddle with tails*) • *not advised

  26. What can you do to increase power? • Increase n • Decrease measurement error • Increase , say, from .05 to .10 (or fiddle with tails*) • Increase the magnitude of the effect • *not advised

  27. You are a better person because now you appreciate this better!

More Related