Yes. TruEra's Model Score Instability (MSI) metric captures the distributional difference of model scores between two splits. A high MSI signals that the model's outputs have shifted. Meanwhile, a Feature Influence Instability (FII) metric captures the difference in influences between the train/test and OOT data distributions for each feature. A high FII indicates a strong feature influence contribution to model instability. For more on model and data drift analysis tools, see Drift.
Please sign in to leave a comment.