Same number, different safety
Two monitors with identical AUC but different attack-score spread. Drag the shared AUC and watch how many attacks each catches at a 2% audit budget — the tail, not the area, is what matters.
Innocent Attacks (Monitor A) Attacks (Monitor B)
Monitor A — attacks spread wide
caught @ 2%: 47%
Monitor B — attacks compressed
caught @ 2%: 9%
ROC (identical area)
AUC (both)
0.92 = 0.92
A caught @ 2%
47%
B caught @ 2%
9%