Interpret the key results for Power and Sample Size for 1 Proportion

Complete the following steps to interpret Power and Sample Size for 1 Proportion. Key output includes the comparison proportion, the sample size, the power, and the power curve.

Step 1: Examine the calculated values

Using the values of the two power function variables that you entered, Minitab calculates the comparison proportion, the sample size, or the power of the test.

Comparison p

Minitab calculates the comparison proportion. The difference between the comparison proportion and the hypothesized proportion is the minimum difference for which you can achieve the specified level of power for each sample size. Larger sample sizes enable the test to detect smaller differences. You want to detect the smallest difference that has practical consequences for your application.

Sample size

Minitab calculates how large your sample must be for a test with your specified power to detect the difference between the hypothesized proportion and comparison proportion. Because sample sizes are whole numbers, the actual power of the test might be slightly greater than the power value that you specify.

If you increase the sample size, the power of the test also increases. You want enough observations in your sample to achieve adequate power. But you don't want a sample size so large that you waste time and money on unnecessary sampling or detect unimportant differences to be statistically significant.

Power

Minitab calculates the power of the test based on the specified comparison proportion and sample size. A power value of 0.9 is usually considered adequate. A value of 0.9 indicates you have a 90% chance of detecting a difference between the hypothesized proportion and the population comparison proportion when a difference actually exists. If a test has low power, you might fail to detect a difference and mistakenly conclude that none exists. Usually, when the sample size is smaller or the difference is smaller, the test has less power to detect a difference.

Results Sample Comparison p Size Power 0.045 500 0.431131 0.045 1000 0.764259 0.085 500 0.449114 0.085 1000 0.703796
Key Results: Comparison p, Sample Size, Power

These results show that, if the comparison proportion is 0.045 and the sample sizes are 500 and 1000, then the power of the test is approximately 0.43 and 0.76, for each sample size respectively. If the comparison proportion is 0.085 and the sample sizes are 500 and 1000, then the power of the test is approximately 0.45 and 0.7, for each sample size respectively. Because the power of the test is not adequate to accommodate a comparison proportion of 0.045 and 0.085, you should increase the sample size, if possible. You can also use the power curve to determine at what comparison proportion the test may achieve adequate power (0.9) for the specified sample size.

Step 2: Examine the power curve

Use the power curve to assess the appropriate sample size or power for your test.

The power curve represents every combination of power and comparison proportion for each sample size when the significance level is held constant. Each symbol on the power curve represents a calculated value based on the values that you enter. For example, if you enter a sample size and a power value, Minitab calculates the corresponding comparison proportion and displays the calculated value on the graph.

Examine the values on the curve to determine the difference between the comparison proportion and the hypothesized proportion that can be detected at a certain power value and sample size. A power value of 0.9 is usually considered adequate. However, some practitioners consider a power value of 0.8 to be adequate. If a hypothesis test has low power, you might fail to detect a difference that is practically significant. If you increase the sample size, the power of the test also increases. You want enough observations in your sample to achieve adequate power. But you don't want a sample size so large that you waste time and money on unnecessary sampling or detect unimportant differences to be statistically significant. If you decrease the size of the difference that you want to detect, the power also decreases.

In this graph, the power curve for a sample size of 500 shows that the test has a power of 0.431 for a comparison proportion of 0.045 and a power of 0.449 for a comparison proportion of 0.085. For a sample size of 1000, the power curve shows that the test has a power of 0.764 for a comparison proportion of 0.045 and a power of 0.704 for a comparison proportion of 0.085. Because the power of the test is not adequate to detect a difference between the comparison proportion and baseline proportion of 0.065, try to increase the sample size, if possible. You can also use the power curve to determine different values that correspond to an adequate level of power with the specified sample size.

By using this site you agree to the use of cookies for analytics and personalized content.  Read our policy