Same number, different safety
Two monitors with identical AUC but different attack-score spread. Drag the shared AUC and watch how many attacks each catches at a 2% audit budget — the tail, not the area, is what matters.
Same number, different safety
Two monitors with identical AUC but different attack-score spread. Drag the shared AUC and watch how many attacks each catches at a 2% audit budget — the tail, not the area, is what matters.
Innocent Attacks (Monitor A) Attacks (Monitor B)
Monitor A — attacks spread wide
caught @ 2%: 47%
Monitor B — attacks compressed
caught @ 2%: 9%
ROC (identical area)
AUC (both)
0.92 = 0.92
A caught @ 2%
47%
B caught @ 2%
9%
Embed this demo
Use the chrome-less embed view inside an iframe:
<iframe src="/demos/monitor-tails/embed" width="100%" height="360" style="border:0"></iframe>