Step 1: Determine whether the association between the response and the term is statistically significant
To determine whether the association between the response and each term in the model is statistically significant, compare the p-value for the term to your significance level to assess the null hypothesis. The null hypothesis is that there is no association between the term and the response. Usually, a significance level (denoted as α or alpha) of 0.05 works well. A significance level of 0.05 indicates a 5% risk of concluding that an association exists when there is no actual association.
P-value ≤ α: The association is statistically significant
If the p-value is less than or equal to the significance level, you can conclude that there is a statistically significant association between the response variable and the term.
P-value > α: The association is not statistically significant
If the p-value is greater than the significance level, you cannot conclude that there is a statistically significant association between the response variable and the term. You may want to refit the model without the term.
If there are multiple predictors without a statistically significant association with the response, you can reduce the model by removing terms one at a time. For more information on removing terms from the model, go to Model reduction.
All factors in a fully nested ANOVA model are random. Consequently, a factor that is statistically significant indicates that it contributes to the amount of variation in the response.
Step 2: Examine the variance components
Examine the variance components to determine how much of the variation in the study can be attributed to each random term. Higher values indicate that the term contributes more variability to the response.