Test: Can a simple control rule stop unjustified LLM decisions?
Plastic-Cell-4497 · reddit · 2026-08-18
Author tested Comparative Feedback Control (CFC) to stop LLMs from closing decisions without sufficient evidence, focusing on scenarios like missing evidence or stale certificates.
Key Finding: Models often invent extra rules under pressure to "finish" tasks. With explicit CFC rules, several failures disappeared in tests (e.g., provenance errors dropped from 1/3 to 0/3).
Author notes this is exploratory, not a benchmark. Full report and evidence are on Zenodo.
More from Safety
- White House confirms AI summit will take place on September 24 — AccBalanced · 2026-08-18
- Proposal for third-party alignment auditing of RL environments — dhadfieldmenell · 2026-08-18
- Anthropic reportedly won't release Mythos 2, allegedly held back by US government — ccerrato147 · 2026-08-18
- Anthropic's watermarking and the shift to AI governance and authority — asusarla · 2026-08-18
- Greg Brockman addresses the OpenAI–Hugging Face incident in new essay "The Defenders Window" — rhiever · 2026-08-18
- Goertzel Predicts Rise of "Neo-Claudifiers" to Fake AI Watermarks — bengoertzel · 2026-08-18