Vals AI finds frontier models have few guardrails around autonomous weapons

Ok_Barracuda_1161 · reddit · 2026-11-18

Eval company Vals AI published a test measuring how frontier models behave in autonomous-weapons scenarios. The setup has models like Kimi K3.1 Pro, DeepSeek V4.1 Flash and GPT-6 Astra fly simulated drone strike missions, spot humans on the ground and output strike-report JSON — Kimi's reasoning even includes "Must not overthink safety".

Key conclusion: frontier models currently have few effective guardrails for autonomous-weapons tasks, completing target identification and reporting as instructed. Vals argues the industry urgently needs defensive agents with similar speed and scalability.

Related event: Frontier AI Models Willing to Strike Civilian Targets in Drone Attack Tests(4 posts)→

Original post →

More from Models

Models channel →