Download
1 / 24
240 likes | 353 Vues
Hypothesis Testing. An introduction. Big picture. Use a random sample to learn something about a larger population. Two ways to learn about a population. Confidence intervals Hypothesis testing. Confidence Intervals.
E N D
Hypothesis Testing An introduction
Big picture Use a random sample to learn something about a larger population.
Two ways to learn about a population • Confidence intervals • Hypothesis testing
Confidence Intervals • Allow us to use sample data to estimate a population value, like the true mean or the true proportion. • Example: What is the true average amount students spend weekly on alcohol?
Hypothesis Testing • Allows us to use sample data to test a claim about a population, such as testing whether a population proportion or population mean equals some number. • Example: Is the true average amount that students spent weekly on alcohol $20?
General Idea of Hypothesis Testing • Make an initial assumption. • Collect evidence (data). • Based on the available evidence, decide whether or not the initial assumption is reasonable.
Example: Grade inflation? Population of 5 million college students Is the average GPA 2.7? How likely is it that 100 students would have an average GPA as large as 2.9 if the population average was 2.7? Sample of 100 college students
Making the Decision • It is either likely or unlikely that we would collect the evidence we did given the initial assumption. • (Note: “Likely” or “unlikely” is measured by calculating a probability!) • If it is likely, then we “do not reject” our initial assumption. There is not enough evidence to do otherwise.
Making the Decision (cont’d) • If it is unlikely, then: • either our initial assumption is correct and we experienced an unusual event • or our initial assumption is incorrect • In statistics, if it is unlikely, we decide to “reject” our initial assumption.
Idea of Hypothesis Testing: Criminal Trial Analogy • First, state 2 hypotheses, the null hypothesis (“H0”) and the alternative hypothesis (“HA”) • H0: Defendant is not guilty. • HA: Defendant is guilty.
An aside:Identification of hypotheses • The null hypothesis always represents the status quo, i.e. the hypothesis that requires no change in current behavior. • The alternative hypothesis is the conclusion that the researcher is trying to make.
Criminal Trial Analogy (continued) • Then, collect evidence, such as finger prints, blood spots, hair samples, carpet fibers, shoe prints, ransom notes, handwriting samples, etc. • In statistics, the data are the evidence.
Criminal Trial Analogy(continued) • Then, make initial assumption. • Defendant is innocent until proven guilty. • In statistics, we always assume the null hypothesis is true.
Criminal Trial Analogy(continued) • Then, make a decision based on the available evidence. • If there is sufficient evidence (“beyond a reasonable doubt”), reject the null hypothesis. (Behave as if defendant is guilty.) • If there is not enough evidence, do not reject the null hypothesis. (Behave as if defendant is not guilty.)
Important “Boohoo!” Point • Neither decision entails proving the null hypothesis or the alternative hypothesis. • We merely state there is enough evidence to behave one way or the other. • This is also always true in statistics! No matter what decision we make, there is always a chance we made an error. • Boohoo!
Definitions: Types of Errors • Type I error: The null hypothesis is rejected when it is true. • Type II error: The null hypothesis is not rejected when it is false. • There is always a chance of making one of these errors. But, we will want to minimize the chance of doing so!
Example: Putting it all together Population of many, many adults Is average adult body temperature 98.6 degrees? Or is it lower? Average body temperature of 80 sampled adults is 98.4 degrees. Sample of 80 adults
Example (continued) • Specify hypotheses. • H0: = 98.6 degrees • HA: < 98.6 degrees • Make initial assumption: = 98.6 degrees • Collect data: Average body temp of 80 sampled adults is 98.4 degrees. How likely is it that a sample of 80 adults would have an average body temp as low as 98.4 if the average body temp of population was 98.6?
Using the p-valueto make the decision • The p-value represents how likely we would be to observe such an extreme sample if the null hypothesis were true. • The p-value is a probability, so it is a number between 0 and 1. • Close to 0 means “unlikely.” • So if p-value is “small,” (typically, less than 0.05), then reject the null hypothesis.
Example (continued) The p-value can easily be obtained from statistical software like MINITAB. Test of mu = 98.6000 vs mu < 98.6000 The assumed sigma = 0.600 Variable N Mean StDev SE Mean Z P Temp 80 98.4 0.67 0.0671 -2.80 0.0026 (Generally, the p-value is labeled as “P”)
Example (continued) • The p-value, 0.0026, indicates that, if the average body temperature in the population is 98.6 degrees, it is unlikely that a sample of 80 adults would have an average body temperature as extreme as 98.4 degrees. • Decision: Reject the null hypothesis. • Conclude that the average body temperature is lower than 98.6 degrees.
What type of error might we have made? • Type I error here is claiming that average body temp is lower than 98.6 when in fact it really isn’t. • Type II error here is failing to claim that the average body temp is lower than 98.6 when it is. • We rejected the null hypothesis, i.e. claimed body temp is lower than 98.6, so we may have made a Type I error. (Boohoo!)
