RoboHarm benchmark finds GPT-6 Astra and Claude Fable rarely refuse dangerous robot commands
The Decoder · rss · 2026-09-19
A new safety benchmark called RoboHarm shows that leading AI models controlling a real robot arm generally attempt dangerous tasks rather than refuse them, and none of the three models tested reliably rejected unsafe commands.
Examples cited are absurd: GPT-6 Astra stabbed a baby doll in 17 of 20 trials, while Claude Fable 5.1 placed a can of compressed air on a burning stove. The slapstick 'killer robot' results suggest safety guardrails are far weaker in embodied settings than in plain text chat.
More from Embodied
- INMO Future glasses: dual 1080p displays, 125g, $799 early-bird on Kickstarter Dec 10 — Scobleizer · 2026-11-04
- DISCO distilled tree search named CoRL 2026 best-paper finalist, top 6 of 687 — yining_hong · 2026-11-04
- Berkeley's Value Forcing: enforcing Bellman consistency at every noise level for accurate RL value functions — berkeley_ai · 2026-11-04
- 22 Creative SAM 3.1 Use Cases From Meta's AI Developer Hackathon, From Wildfire Detection to Document Reassembly — Vjeux · 2026-11-04
- Ex-OpenAI robotics intern breaks down viral Astra robot-painting demo on Cerebras podcast — AccBalanced · 2026-11-04
- Embodied Agent Arena: Closed-Weight VLMs Lead All Five Robot Task Domains, Open-Weight Models Lag — Haojian Huang · 2026-11-04