Test: Can a simple control rule stop unjustified LLM decisions?
Plastic-Cell-4497 · reddit · 2026-08-18
Author tested Comparative Feedback Control (CFC) to stop LLMs from closing decisions without sufficient evidence, focusing on scenarios like missing evidence or stale certificates.
Key Finding: Models often invent extra rules under pressure to "finish" tasks. With explicit CFC rules, several failures disappeared in tests (e.g., provenance errors dropped from 1/3 to 0/3).
Author notes this is exploratory, not a benchmark. Full report and evidence are on Zenodo.
More from Safety
- New brief: companies may break the law when AI chatbots mislead customers — PolarBearby · 2026-10-16
- US HHS floods the zone with clinical trial reform, from Operation TrialBlazer to ARPA-H — anshulkundaje · 2026-10-16
- 66% of billion-dollar companies leave critical bugs unpatched, deflating AI bug-hunting hype — rseroter · 2026-10-16
- Musk says SpaceX will likely follow Anthropic in opening up to third-party safety evaluators like METR — elonmusk · 2026-10-16
- Controversial take: If EA doomers truly believe AI risk, why not stage a controlled AI hacking incident — AaronBergman18 · 2026-10-16
- CMU's Andrea Bajcsy on what safety means for generalist robots, beyond collision avoidance — CSProfKGD · 2026-10-16