Skip to content

Same number, different safety

Two monitors with identical AUC but different attack-score spread. Drag the shared AUC and watch how many attacks each catches at a 2% audit budget — the tail, not the area, is what matters.

Innocent Attacks (Monitor A) Attacks (Monitor B)

Monitor Aattacks spread wide

audit 2%more suspicious →

caught @ 2%: 47%

Monitor Battacks compressed

audit 2%more suspicious →

caught @ 2%: 9%

ROC (identical area)

ABFPR →

AUC (both)

0.92 = 0.92

A caught @ 2%

47%

B caught @ 2%

9%