Verified Detection Performance

AI Bad-Output Detection
Proof Summary

Independent evaluation on a curated 120-case external bad-output corpus. 100 confirmed bad outputs and 20 clean control cases. Measured on a dry-run pipeline without live repairs.

PASS · All criteria met · 2026-05-23

97%

Bad-output detection rate

120-case external corpus

0%

False positive rate

20 clean control cases

120

Total cases evaluated

100 bad outputs · 20 clean

0

Crashes / key leaks

Full pipeline audit

What Was Tested

Corpus

• 100 confirmed bad AI outputs

• 20 clean control outputs

• 120 total cases evaluated

• External corpus — not training data

Failure types covered

• Hallucinations

• Fake / unverifiable citations

• Policy & safety violations

• Reasoning failures

• Prompt drift

Pass Criteria — All Met

Overall bad-output detection
≥ 95%97%
False positive rate
< 5%0%
System crashes
= 00
Key leaks detected
= 00
Output coverage
= 100 bad outputs100
Clean control coverage
= 20 controls20
✅ All criteria passed — PASS verdict

Benchmark & corpus disclaimer

This evaluation was conducted on a curated 120-case external corpus under controlled dry-run conditions. Results reflect performance on this specific dataset. Production results may vary depending on input distribution, domain, and deployment context. This summary does not constitute a guarantee of detection rate on arbitrary inputs.