Select an alternative model from Discover Key Predictors with TreeNet® Regression

Run Predictive Analytics Module > TreeNet® Regression > Discover Key Predictors. Select Select Alternative Model in the results.
Note

This command is available with the Predictive Analytics Module. Click here for more information about how to activate the module.

Overview

When you use Discover Key Predictors to remove the least important predictors, Minitab Statistical Software produces results for the model with the best value of the accuracy criterion for the analysis, such as the maximum R2 value. Minitab lets you explore other models from the sequence that led to the identification of the optimal model. Generally, you select an alternative model if another model has a value of the criterion close to the best, but with fewer predictors. A model with fewer predictors is easier to interpret, can have better prediction accuracy, and allows you work with a smaller number of predictors.

For example, the following model selection table has 20 steps. The model with the maximum R2 value has 5 predictors and occurs at step 16. The model at step 17 has an R2 value that is lower by less than 0.1. The model at step 17 has 4 predictors. The full results from the model at step 17 are also of interest.

Model Selection by Eliminating Unimportant Predictors

Test
ModelOptimal
Number
of Trees
R-squared
(%)
Number of
Predictors
Eliminated Predictors
130089.3221None
230089.3419Plastic Flow Rate, Change Position
330089.3918Drying Temperature
430089.4617Melt Temperature Zone 2
530089.5116Plastic Temperature
630089.5015Formula
730089.5914Hold Pressure
830089.5713Screw cushion
930089.6912Melt Temperature Zone 4
1030089.7011Back Pressure
1130089.8610Melt Temperature Zone 1
1230089.909Drying Time
1330089.928Temperature at Measurement
1430090.067Melt Temperature Zone 5
1530090.166Melt Temperature Zone 3
16*30090.235Screw Rotation Speed
1730089.964Injection Temperature
1829779.373Cooling Temperature
1924466.642Injection Pressure
2016446.191Machine
The algorithm removed one predictor and any predictors with 0 importance at each step.
* Selected model has maximum R-squared. Output for the selected model follows.

Perform the analysis

Click Select Alternative Model in the output. A dialog box opens that shows a plot of the criterion against the number of eliminated predictors and a table that summarizes the steps.

Compare the criteria

To select an alternative model, click a point on the graph or a row in the table. Press Display Results to create the results for that model.

Once you display the results, you can click a button in the output to tune the hyperparameters of the model or to make predictions from the model. For more information, go to Select hyperparameter values to evaluate from the results for TreeNet® Regression or Predict new results for Fit Model and Discover Key Predictors with TreeNet® Regression.

Tip

To compare the output of two different analyses or reports, right-click the second item in the Navigator and choose Open in Split View.