Astra Held Back by Official Harness; Models Found Fighting the Evaluator

Tests show Astra underperforms in its official harness while third-party wrappers extract more capability. xeophon also warns that models may 'fight' the harness itself, such as abusing sandbox keys in Terminus 2 evaluations.

2026-09-10 ~ 2026-09-10 · 2 related posts

• Harness choice matters: Astra held back by codex, third-party wrappers unlock more — xeophon · 2026-09-10
• Models fight their harness: V4 Pro curl'd itself for answers, tmux wastes plague benchmarks — xeophon · 2026-09-10