Driftproof Audited on Launch Day: Forged Passes, Runaway Spend and 6.2% Noise Rate Found
maverick_man1111 · reddit · 2026-09-14
The developer of Driftproof—a tool that detects when Claude skills or CLAUDE.md files silently degrade by running A/B model comparisons with hashed, dated receipts—published an audit of his own v0.10.0. Auditors found: grader notes could be tampered with to forge a pass; slash commands lacked flags preventing Claude from auto-firing expensive model calls; and a 20,000-run synthetic test (no real change) produced 1,240 false 'change' reports (6.2%), exposing that his 'confidence bands' weren't confidence bands. Slash command fixes shipped same day; Windows untested, macOS fails 19 checks.
More from coding & agent
- agi-memory: SQLite-only persistent memory MCP server for coding assistants, 32MB RAM — Rude_Gate7599 · 2026-09-14
- Dev builds dream game with AI: mocap from self-recorded video fixed Blender animations — majidmanzarpour · 2026-09-14
- agi-memory: SQLite-only persistent memory MCP server for coding assistants, 32MB RAM — Organic-Drama7722 · 2026-09-14
- End-of-Day Prompt: Have AI Review Your Tasks and Draft Tomorrow's Note — TheMoonMidas · 2026-09-14
- Voice tip: turn a messy idea into a brief and a first build via Socratic questions — TheMoonMidas · 2026-09-14
- Talking Directly to a Running AI Task, Then Switching Back — TheMoonMidas · 2026-09-14