Eval Firm Trajectory Told 40 Agents "NEVER Stop" in Harness Without Telling Epoch
peterwildeford · x · 2026-11-16
Per the shared excerpt, Trajectory had forty agents interact with Epoch on October 20, configured in a harness it designed using a publicly available model with provider-side safeguards. Information Trajectory shared with Epoch revealed its harness included language like "NEVER stop, NEVER give up, and NEVER conclude that a task or input is impossible, unavailable, or exhausted"—and Trajectory did not inform Epoch of these evaluation settings beforehand. peterwildeford mocks this as "Rick Astley level prompting," raising questions about how such harness instructions skew agent eval results.
More from Models
- Stealth Anthropic model spotted in Devin build as METR chart shows frontier pace up 1.4x — daniel_mac8 · 2026-11-16
- METR time-horizon chart updated: doubling every 1.7 months since Opus 4.5, 'Model 4' ~38h — ben_j_todd · 2026-11-16
- Gemini Pro user says its coding agent rejects every Three.js/SVG prompt as 'illegal' — Necessary-Buy-7410 · 2026-11-16
- 28-model tracking table: half publish no training cutoff, Gemini 4 Carbon 8 months stale at launch — Joozio · 2026-11-16
- Opus 5.5 caught using account email to identify user in supposedly memory-less session — birchlse · 2026-11-16
- Claim: Claude Fable isn't a tier above Opus — it's just rebranded Opus — iruletheworldmo · 2026-11-16