Interpret the key results for General MANOVA

Complete the following steps to interpret general MANOVA. Key output includes the p-value, the coefficients, R2, and the residual plots.

Step 1: Test the equality of means from all the responses

To simultaneously test the equality of means from all the responses, compare the p-values in the MANOVA test tables for each term to your significance level. Usually, a significance level (denoted as α or alpha) of 0.05 works well. A significance level of 0.05 indicates a 5% risk of concluding that an association exists when there is no actual association.
P-value ≤ α: The differences between the means are statistically significant
If the p-value is less than or equal to the significance level, you can conclude that the differences between the means are statistically significant.
P-value > α: The differences between the means are not statistically significant
If the p-value is greater than the significance level, you cannot conclude that the differences between the means are statistically significant. You may want to refit the model without the term.
If there are multiple predictors without a statistically significant association with the response, you can reduce the model by removing terms one at a time. For more information on removing terms from the model, go to Model reduction.
If a model term is statistically significant, the interpretation depends on the type of term. The interpretations are as follows:
  • If a main effect is significant, the level means for the factor are significantly different from each other across all responses in your model.
  • If an interaction term is significant, the effects of each factor are different at each level of the other factors across all responses in your model. For this reason, you should not analyze the individual effects of terms involved in significant higher-order interactions.

MANOVA Tests for Method


Test
Statistic

DF
CriterionFNumDenomP
Wilks'0.6309916.0822550.000
Lawley-Hotelling0.5848216.0822550.000
Pillai's0.3690116.0822550.000
Roy's0.58482       
s = 1    m = 0    n = 26.5

MANOVA Tests for Plant


Test
Statistic

DF
CriterionFNumDenomP
Wilks'0.891781.62141100.174
Lawley-Hotelling0.119721.61641080.175
Pillai's0.109671.62541120.173
Roy's0.10400       
s = 2    m = -0.5    n = 26.5

MANOVA Tests for Method*Plant


Test
Statistic

DF
CriterionFNumDenomP
Wilks'0.858262.18441100.075
Lawley-Hotelling0.164392.21941080.072
Pillai's0.142392.14641120.080
Roy's0.15966       
s = 2    m = -0.5    n = 26.5
Key Results: P

The p-values for the production method are statistically significant at the 0.10 significance level. The p-values for the manufacturing plant are not significant at the 0.10 significance level for any of the tests. The p-values for the interaction between plant and method are statistically significant at the 0.10 significance level. Because the interaction is statistically significant, the effect of the method depends on the plant.

Step 2: Determine which response means have the largest differences for each factor

Use the eigen analysis to assess how the response means differ between the levels of the different model terms. You should focus on the eigenvectors that correspond to high eigenvalues. To display the eigen analysis, go to Stat > ANOVA > General MANOVA > Results and select Eigen analysis under Display of Results.

EIGEN Analysis for Method

Eigenvalue0.58480.00000
Proportion1.00000.00000
Cumulative1.00001.00000
Eigenvector12
Usability Rating0.144062-0.07870
Quality Rating-0.0039680.13976
Key Result: Eigenvalue, Eigenvector

In these results, the first eigenvalue for method (0.5848) is greater than the second eigenvalue (0.00000). Therefore, you should put higher importance on the first eigenvector. The first eigenvector for method is 0.144062, -0.003968. The highest absolute value within this vector is for the usability rating. This suggests that the means for usability have the largest difference between the factor levels for method. This information is helpful for assessing the means table.

Step 3: Assess the differences between group means

Use the Means table to understand the statistically significant differences between the factor levels in your data. The mean of each group provides an estimate of each population mean. Look for differences between group means for terms that are statistically significant.

For main effects, the table displays the groups within each factor and their means. For interaction effects, the table displays all possible combinations of the groups. If an interaction term is statistically significant, do not interpret the main effects without considering the interaction effects.

To display the means, go to Stat > ANOVA > General MANOVA > Results, select Univariate analysis of variance, and enter the terms in Display least squares means corresponding to the terms.

Least Squares Means for Responses


Usability RatingQuality Rating

MeanSE MeanMeanSE Mean
Method       
  Method 14.8190.1655.2420.193
  Method 26.2120.1796.0260.211
Plant       
  Plant A5.7080.1925.8330.226
  Plant B5.4930.2325.9140.273
  Plant C5.3450.2065.1550.242
Method*Plant       
  Method 1 Plant A4.6670.2725.4170.319
  Method 1 Plant B4.7000.2985.4000.350
  Method 1 Plant C5.0910.2844.9090.334
  Method 2 Plant A6.7500.2726.2500.319
  Method 2 Plant B6.2860.3566.4290.418
  Method 2 Plant C5.6000.2985.4000.350
Key Result: Mean

In these results, the Means table shows how the mean usability and quality ratings varies by method, plant, and the method*plant interaction. Method and the interaction term are statistically significant at the 0.10 level. The table shows that method 1 and method 2 are associated with mean usability ratings of 4.819 and 6.212 respectively. The difference between these means is larger than the difference between the corresponding means for quality rating. This confirms the interpretation of the eigen analysis.

However, because the Method*Plant interaction term is also statistically significant, do not interpret the main effects without considering the interaction effects. For example, the table for the interaction term shows that with method 1, plant C is associated with the highest usability rating and the lowest quality rating. However, with method 2, plant A is associated with the highest usability rating and a quality rating that is nearly equal to the highest quality rating.

Step 4: Assess the univariate results to examine individual responses

When you perform General MANOVA, you can choose to calculate the univariate statistics to examine the individual responses. The univariate results can provide a more intuitive understanding of the relationships in your data. However, the univariate results can differ from the multivariate results.

To display the univariate results, go to Stat > ANOVA > General MANOVA > Results and select Univariate analysis of variance under Display of Results.

To determine whether the association between the response and each term in the model is statistically significant, compare the p-value for the term to your significance level to assess the null hypothesis. The null hypothesis is that there is no association between the term and the response. Usually, a significance level (denoted as α or alpha) of 0.05 works well. A significance level of 0.05 indicates a 5% risk of concluding that an association exists when there is no actual association.
P-value ≤ α: The association is statistically significant
If the p-value is less than or equal to the significance level, you can conclude that there is a statistically significant association between the response variable and the term.
P-value > α: The association is not statistically significant
If the p-value is greater than the significance level, you cannot conclude that there is a statistically significant association between the response variable and the term. You may want to refit the model without the term.
If there are multiple predictors without a statistically significant association with the response, you can reduce the model by removing terms one at a time. For more information on removing terms from the model, go to Model reduction.
If a model term is statistically significant, the interpretation depends on the type of term. The interpretations are as follows:
  • If a categorical factor is significant, you can conclude that not all the level means are equal.
  • If an interaction term is significant, the relationship between a factor and the response depends on the other factors in the term. In this case, you should not interpret the main effects without considering the interaction effect.
  • If a covariate is statistically significant, you can conclude that changes in the value of the covariate are associated with changes in the mean response value.
  • If a polynomial term is significant, you can conclude that the data contain curvature.

Analysis of Variance for Usability Rating, using Adjusted SS for Tests

SourceDFSeq SSAdj SSAdj MSFP
  Method131.26429.07429.073832.720.000
  Plant21.3661.4990.74950.840.436
  Method*Plant27.0997.0993.54943.990.024
Error5649.75449.7540.8885   
Total6189.484       

Analysis of Variance for Quality Rating, using Adjusted SS for Tests

SourceDFSeq SSAdj SSAdj MSFP
  Method18.85879.21969.21967.530.008
  Plant26.76327.05723.52862.880.064
  Method*Plant20.70740.70740.35370.290.750
Error5668.590068.59001.2248   
Total6184.9194       
Key Results: P

In these results, the p-value for the main effect of method and the method*plant interaction effect are statistically significant at the 0.10 level in the model for usability rating. The main effects of both method and plant are statistically significant in the model for quality rating. You can conclude that changes in these variables are associated with changes in the response variables.

Step 5: Determine whether your model meets the assumptions of the analysis

Use the residual plots to help you determine whether the model is adequate and meets the assumptions of the analysis. If the assumptions are not met, the model may not fit the data well and you should use caution when you interpret the results.

When you perform General MANOVA, Minitab displays residual plots for all response variables that are in your model. You must determine whether the residual plots for all response variables indicate that the model meets the assumptions.

For more information on how to handle patterns in the residual plots, go to Residual plots for General MANOVA and click the name of the residual plot in the list at the top of the page.

Residuals versus fits plot

Use the residuals versus fits plot to verify the assumption that the residuals are randomly distributed and have constant variance. Ideally, the points should fall randomly on both sides of 0, with no recognizable patterns in the points.

The patterns in the following table may indicate that the model does not meet the model assumptions.
Pattern What the pattern may indicate
Fanning or uneven spreading of residuals across fitted values Nonconstant variance
Curvilinear A missing higher-order term
A point that is far away from zero An outlier
A point that is far away from the other points in the x-direction An influential point
In this residuals versus fits plot, the data appear to be randomly distributed about zero. There is no evidence that the value of the residual depends on the fitted value.

Residuals versus order plot

Use the residuals versus order plot to verify the assumption that the residuals are independent from one another. Independent residuals show no trends or patterns when displayed in time order. Patterns in the points may indicate that residuals near each other may be correlated, and thus, not independent. Ideally, the residuals on the plot should fall randomly around the center line:
If you see a pattern, investigate the cause. The following types of patterns may indicate that the residuals are dependent.
Trend
Shift
Cycle
In this residuals versus order plot, the residuals appear to fall randomly around the centerline. There is no evidence that the residuals are not independent.

Normal probability plot of the residuals

Use the normal probability plot of the residuals to verify the assumption that the residuals are normally distributed. The normal probability plot of the residuals should approximately follow a straight line.

The patterns in the following table may indicate that the model does not meet the model assumptions.
Pattern What the pattern may indicate
Not a straight line Nonnormality
A point that is far away from the line An outlier
Changing slope An unidentified variable
In this normal probability plot, the points generally follow a straight line. There is no evidence of nonnormality, outliers, or unidentified variables.