Deployment settings

Find detailed guidance on the Settings tab.

The Settings tab includes the observation ID settings, alert thresholds, and email alert settings.

Observation ID

ID Name: Specify the name for the unique observation identifier that links the prediction and stability data into a complete record.

Note

The ID Name cannot be changed once a deployment begins processing prediction requests.

Require Observation ID for prediction requests: While the Observation ID is required to generate stability reports, you can also require the Observation ID for prediction requests.

Prediction Timestamp

Timestamp Variable Name: Specify the name for the timestamp variable. When you provide timestamp data with the request, the system uses the provided timestamp in place of the system generated timestamp.

Production Data Period

Select the default production period for the drift status displayed on the deployments page.

Drift Report: Variable Thresholds

Enter the values of PSI that indicate moderate drift and severe drift. The default values are traditional thresholds. The threshold for moderate drift traditionally identifies when to use your judgment regarding continued use of the champion model. The threshold for severe drift traditionally identifies when to retrain the model. The moderate drift threshold must be less than the severe drift threshold.

Enter smaller values to change the drift status in response to smaller differences between the baseline data and the production data. Enter larger values to change the drift status for larger differences between the baseline data and the production data. For more information on the PSI metric, go to Details about the Population Stability Index (PSI).

Drift Report: Overall Drift

Specify which drift to include in the overall drift of the champion model.

Select Prediction drift to include drift of the predicted response variable.
Select variables show data drift and enter the number of variables to include drift of the predictor variables.

When the model exhibits moderate or severe overall drift according to your specified thresholds, you will receive an email with details about the model drift status at the end of the production period.

Alerts: Email Configuration

Specify one or more email addresses to receive alerts when the drift status of a champion model changes. Separate multiple email addresses with spaces, commas, or semi-colons.