Model Stability

After the bulk inference has been performed, the analysis process must be performed before population and characteristic stabilities are available to explore.

"Population Stability" tab displays how the distribution of prediction scores of the newly inferenced bulk sample compare to that of the currently selected default bucketing. If there is no default bucketing, the population stability is shown on six buckets of equal width. The "Population Stability Index" value is also displayed at the top.

The "Characteristic Stability" tab measures the deviation of individual features from the old and new populations. The main metric here is the PSI, which is highlighted in different colours (depending on whether the feature is considered stable or not).

For each feature, PSI values below 0.1 are considered "stable" and displayed in green; values between 0.1 < PSI < 0.25 are coloured in amber as a warning; PSI values >= 0.25 are considered unstable and therefore highlighted in red.

The Rejections tab will record any failed inferences. These are usually due to unseen values for categorical features present in the uploaded dataset. A reason will be provided so that the record can be inspected and corrected for any data issues in subsequent uploads, if applicable.