StabilityLab Sample Report

Bias/Variance Decomposition
Dave Guggenheim
Read 5 Minutes

This blog doesn't support graphics well, so the charts and plots are missing from this report.

================================================================================
DATA STABILITY MEASUREMENTS REPORT
================================================================================
Generated: 2026-01-20 21:36:14

----------------------------------------
CONFIGURATION
----------------------------------------
Problem Type: classification
Target Variable: Gone
Dataset Shape: (1470, 25)
ADASYN Applied: True
Population Iterations: 200

----------------------------------------
POPULATION ESTIMATOR
----------------------------------------
Iterations: 200
Best Seed: 133 (Score: 0.8957)
Worst Seed: 165 (Score: 0.8390)
Median Score: 0.8685
Std Dev: 0.0094
Median Seed: 3

----------------------------------------
BIAS/VARIANCE DECOMPOSITION
----------------------------------------

WORST (Seed 165): SEVERE STRESS
 Train/Test Bias²: 0.012278 / 0.111521
 Train/Test Var: 0.006474 / 0.012186
 Total Gap: 0.104956

MEDIAN (Seed 3): SEVERE STRESS
 Train/Test Bias²: 0.012706 / 0.107063
 Train/Test Var: 0.006504 / 0.013705
 Total Gap: 0.101559

BEST (Seed 133): MODERATE STRESS
 Train/Test Bias²: 0.012487 / 0.103039
 Train/Test Var: 0.006624 / 0.012172
 Total Gap: 0.096100

----------------------------------------
ISGG
----------------------------------------
Score: 0.836758
Severity: HIGH
Pattern: Critical features driving instability

----------------------------------------
DFIS
----------------------------------------
Score: 0.003127
Condition: ENHANCEMENT - Stable importance AND decomposition

----------------------------------------
FWDD
----------------------------------------
Score: 1.644701
Severity: HIGH
Problematic Features: JobInvolvement, JobSatisfaction, OverTime, StockOptionLevel, BusinessTravel_Travel_Frequently

----------------------------------------
TOP IMPORTANT FEATURES (Median Seed)
----------------------------------------
 1. OverTime: 0.1429
 2. MaritalStatus_Single: 0.0959
 3. StockOptionLevel: 0.0738
 4. JobInvolvement: 0.0508
 5. JobSatisfaction: 0.0452
 6. JobRole_Laboratory Technician: 0.0446
 7. BusinessTravel_Travel_Frequently: 0.0428
 8. MonthlyIncome: 0.0334
 9. DistanceFromHome: 0.0334
 10. EnvironmentSatisfaction: 0.0322

================================================================================
END OF REPORT
================================================================================