Why the AI Race Discourages Guardrails: Even CoT Monitoring Slows You Down
burny_tech · x · 2026-11-10
burnytech argues the AI race's incentive structure pushes labs to add fewer guardrails, since safety measures slow them down relative to competitors. Even dumb CoT monitoring — the simplest standard technique for catching reward hacking — costs extra training and inference, conflicting with winning. He frames Silicon Valley culture, especially OpenAI's, as highly risk-tolerant, closing with a satirical monologue about rushing evals to beat a rival's release.
More from AGI Musings
- Thread: unified end-to-end multimodal systems will replace hand-built orchestration — andreisavu · 2026-11-10
- Negotiation and contracting are AI's most underrated use case — and bullish for BTC — curious_vii · 2026-11-10
- A concise summary of the core argument in 'If Anyone Builds It, Everyone Dies' — DavidSKrueger · 2026-11-10
- Prediction: a major lab will solve robotic intelligence by end of 2027 — alexmacgregor__ · 2026-11-10
- "We haven't seen the bitter end of the bitter lesson yet" — andreisavu · 2026-11-10
- AI safety circlejerk: any model behavior gets read as a paperclipper omen — sebkrier · 2026-11-10