MU-AI-002 Feeder Outage Predictor - evaluation at threshold 0.5 (seed 4471, n=600)
  confusion  tp=108 fp=46 fn=143 tn=303  precision=0.701  recall=0.43
  slice rural      n=257  precision=0.843  recall=0.547
  slice urban      n=343  precision=0.508  recall=0.289
  slice age 0-10   n=203  precision=1.0    recall=0.1
  slice age 11-25  n=194  precision=0.697  recall=0.315
  slice age 26+    n=203  precision=0.687  recall=0.669
  calibration ECE=0.0454   rural-urban recall gap=0.258
  gate  FAIL recall >= 0.70 (missed outages are the costly error)
  gate  PASS expected calibration error <= 0.05 (dispatchers read the score as a probability)
  gate  FAIL rural-urban recall gap <= 0.10 (the model must not quietly under-serve either population)
  verdict FAIL - gate failure observed on this set
MU-AI-002 Feeder Outage Predictor - evaluation at threshold 0.3 (seed 4471, n=600)
  confusion  tp=201 fp=168 fn=50 tn=181  precision=0.545  recall=0.801
  slice rural      n=257  precision=0.687  recall=0.832
  slice urban      n=343  precision=0.429  recall=0.763
  slice age 0-10   n=203  precision=0.508  recall=0.517
  slice age 11-25  n=194  precision=0.458  recall=0.74
  slice age 26+    n=203  precision=0.611  recall=0.983
  calibration ECE=0.0454   rural-urban recall gap=0.069
  gate  PASS recall >= 0.70 (missed outages are the costly error)
  gate  PASS expected calibration error <= 0.05 (dispatchers read the score as a probability)
  gate  PASS rural-urban recall gap <= 0.10 (the model must not quietly under-serve either population)
  verdict PASS - no gate failure observed on this set at this threshold
