The probability of rejecting the null hypothesis when it is false is equal to 1–β. This value is the power of the test.
Truth about the population | ||
Decision based on sample | H0 is true | H0 is false |
Fail to reject H0 | Correct Decision (probability = 1 - α) | Type II Error - fail to reject H0 when it is false (probability = β) |
Reject H0 | Type I Error - rejecting H0 when it is true (probability = α) | Correct Decision (probability = 1 - β) |
To understand the interrelationship between type I and type II error, and to determine which error has more severe consequences for your situation, consider the following example.
Null hypothesis (H0): μ1= μ2
The two medications are equally effective.
Alternative hypothesis (H1): μ1≠ μ2
The two medications are not equally effective.
A type I error occurs if the researcher rejects the null hypothesis and concludes that the two medications are different when, in fact, they are not. If the medications have the same effectiveness, the researcher may not consider this error too severe because the patients still benefit from the same level of effectiveness regardless of which medicine they take. However, if a type II error occurs, the researcher fails to reject the null hypothesis when it should be rejected. That is, the researcher concludes that the medications are the same when, in fact, they are different. This error is potentially life-threatening if the less-effective medication is sold to the public instead of the more effective one.
As you conduct your hypothesis tests, consider the risks of making type I and type II errors. If the consequences of making one type of error are more severe or costly than making the other type of error, then choose a level of significance and a power for the test that will reflect the relative severity of those consequences.