Select the analysis options for Power and Sample Size for 1 Proportion

Stat > Power and Sample Size > 1 Proportion > Options

Select the alternative hypothesis or specify the significance level for the test.

Alternative Hypothesis
From Alternative Hypothesis, select the hypothesis that you want to test:
  • Less than: Use this one-sided test to determine whether the population proportion is less than the hypothesized proportion. This one-sided test has greater power than a two-sided test, but it cannot detect whether the population proportion is greater than the hypothesized proportion.

    For example, an engineer uses this one-sided test to determine whether the proportion of defective parts is less than 0.001 (0.1%). The one-sided test has greater power to determine whether the proportion is less than 0.001, but it cannot detect whether the proportion is greater than 0.001.

  • Not equal: Use this two-sided test to determine whether the population proportion differs from the hypothesized proportion. This two-sided test can detect differences that are less than or greater than the hypothesized value, but it has less power than a one-sided test.

    For example, a bank manager tests whether the proportion of customers who have savings accounts this year differs from last year's proportion, 0.57 (57%). Because any difference from last year's proportion is important, the manager uses this two-sided test to determine whether this year's proportion is greater than or less than last year's proportion.

  • Greater than: Use this one-sided test to determine whether the population proportion is greater than the hypothesized proportion. This one-sided test has greater power than a two-sided test, but it cannot detect whether the population proportion is less than the hypothesized proportion.

    For example, a quality analyst uses this one-sided test to determine whether the proportion of acceptable electrical switches is greater than 0.98. This one-sided test has greater power to determine whether the proportion is greater than 0.98, but it cannot determine whether the proportion is less than 0.98.

For more information on selecting a one-sided or two-sided alternative hypothesis, go to About the null and alternative hypotheses.

Significance level

Use the significance level to minimize the power value of the test when the null hypothesis (H0) is true. Higher values for the significance level give the test more power, but also increase the chance of making a type I error, which is rejecting the null hypothesis when it is true.

Usually, a significance level (denoted as α or alpha) of 0.05 works well. A significance level of 0.05 indicates that the risk of concluding that a difference exists—when, actually, no difference exists—is 5%. It also indicates that the power of the test is 0.05 when there is no difference.
  • Choose a higher significance level, such as 0.10, to be more certain that you detect any difference that possibly exists. For example, a quality engineer compares the stability of new ball bearings with the stability of current bearings. The engineer must be highly certain that the new ball bearings are stable because unstable ball bearings could cause a disaster. Therefore, the engineer chooses a significance level of 0.10 to be more certain of detecting any possible difference in the stability of the ball bearings.
  • Choose a lower significance level, such as 0.01, to be more certain that you detect only a difference that actually exists. For example, a scientist at a pharmaceutical company must be very certain that a claim that the company's new drug significantly reduces symptoms is true. The scientist chooses a significance level of 0.01 to be more certain that any significant difference in symptoms does exist.