Perform stepwise regression for Fit Binary Logistic Model

Stat > Regression > Binary Logistic Regression > Fit Binary Logistic Model > Stepwise

Method

Stepwise removes and adds terms to the model for the purpose of identifying a useful subset of the terms. If you choose a stepwise procedure, the terms that you specify in the Model dialog box are candidates for the final model. For more information, go to Basics of stepwise regression.

Specify the method that Minitab uses to fit the model.
  • None: Fit the model with all of the terms that you specify in the Model dialog box.
  • Stepwise: This method starts with an empty model, or includes the terms you specified to include in the initial model or in every model. Then, Minitab adds or removes a term for each step. You can specify terms to include in the initial model or to force into every model. Minitab stops when all variables not in the model have p-values that are greater than the specified Alpha to enter value and when all variables in the model have p-values that are less than or equal to the specified Alpha to remove value.
  • Forward selection: This method starts with an empty model, or includes the terms you specified to include in the initial model or in every model. Then, Minitab adds the most significant term for each step. Minitab stops when all variables not in the model have p-values that are greater than the specified Alpha to enter value.
  • Backward elimination: This method starts with all potential terms in the model and removes the least significant term for each step. Minitab stops when all variables in the model have p-values that are less than or equal to the specified Alpha to remove value.
Note

The terms that are included in the final model can depend on hierarchy restrictions for models. For more information, see the topic on Hierarchy below.

Potential terms

Displays the set of terms that the procedure will assess. Indicators (E or I) next to the term in the list signify how the procedure handles the term. The Method you choose determines the initial settings in this list. You can modify how the procedure handles the terms with the two buttons below. If you don't use these buttons, the procedure can add or remove the term from the model based on its p-value.
  • E = Include term in every model: Select a term and click this button to force the term into every model regardless of its p-value. Click the button again to remove this condition.
  • I = Include term in the initial model: Select a term and click this button to include the term in the initial model. The procedure can remove these terms if its p-value is too high. Click the button again to remove this condition. This button is only available if you choose Stepwise in Method.

Alpha to enter and remove

Alpha to enter
Enter the alpha value that Minitab uses to determine whether a term can be entered into the model. You can set this value when you choose Stepwise or Forward selection in Method.
Alpha to remove
Enter the alpha value that Minitab uses to determine whether a term is removed from the model. You can set this value when you choose the Stepwise or Backward elimination in Method.

Hierarchy

You can determine how Minitab enforces model hierarchy during a stepwise procedure. The Hierarchy button is disabled if you specify a non-hierarchical model in the Model dialog box.

In a hierarchical model, all lower-order terms that comprise the higher-order terms also appear in the model. For example, a model that includes the interaction term A*B*C is hierarchical if it includes these terms: A, B, C, A*B, A*C, and B*C.

Models can be non-hierarchical. Generally, you can remove lower order terms if they are insignificant, unless subject area knowledge suggests that you include them. Models that contain too many terms can be relatively imprecise and can reduce the ability to predict the values of new observations.

Consider the following tips:
  • Fit a hierarchical model first. You can remove insignificant terms later.
  • If you standardize your continuous predictors, fit a hierarchical model to produce an equation in uncoded (or natural) units.
  • If your model contains categorical variables, the results are easier to interpret if the categorical terms, at least, are hierarchical.
Hierarchical model
Choose whether the stepwise procedure must produce a hierarchical model.
  • Require a hierarchical model at each step: Minitab can only add or remove terms that maintain hierarchy.
  • Add terms at the end to make the model hierarchical: Initially, Minitab follows the standard rules of the stepwise procedure. At the final step, Minitab adds the terms that produce a hierarchical model, even if their p-values are greater than the Alpha to enter value.
  • Do not require a hierarchical model: The final model can be non-hierarchical. Minitab will add and remove terms based only on the rules of the stepwise procedure.
Require hierarchy for the following terms
If you require a hierarchical model, choose the types of terms that must be hierarchical.
  • All terms: Terms that include continuous and/or categorical variables must be hierarchical.
  • Terms with categorical predictors: Only terms that include categorical variables must be hierarchical.
How many terms can enter at each step
If you require hierarchy at each step, choose the number of terms that Minitab can add at each step in order to maintain hierarchy.
  • At most one term can enter at each step: A higher-order term can enter the model only if hierarchy is maintained when adding that single term. All lower-order terms that comprise the higher-order must already be in the model.
  • Extra terms can enter to maintain hierarchy: A higher-order term can enter the model even if it produces a non-hierarchical model. However, the terms that are necessary to produce a hierarchical model are also added, even if their p-values are greater than the Alpha to enter value.

Display the table of model selection details

Specify the information to display about the stepwise procedure in the Session window.
  • Details about the method: Display the type of stepwise procedure and the alpha values to enter and/or remove a predictor from the model.
  • Include details for each step: Display the coefficients, p-values, and model summary statistics for each step of the procedure.
By using this site you agree to the use of cookies for analytics and personalized content.  Read our policy