Coding agents are strong prompt optimizers: CASD beats GEPA, 22x cheaper
rohanpaul_ai · x · 2026-10-02
The paper 'Coding Agents are Strong Prompt Optimizers' (arXiv:2609.26261) proposes CASD: given only a static corpus of agent trajectories, an off-the-shelf coding agent synthesizes an optimized prompt without environment access or validation data. Key insight is reflection scope — instead of small-batch reasoning, the coding agent writes and executes analysis code to compute corpus-wide statistics, identify systematic failure modes, and distill behavioral rules. On ALFWorld, τ²-bench retail/telecom and SpreadsheetBench-Verified, one CASD pass beats GEPA on 3 of 4 benchmarks and SkillOpt on all four, improving the unoptimized baseline by 16.6 points on average vs 10.9 for GEPA. At $1.60 per prompt, it is over 22x cheaper than validation-gated search.
Related event: Microsoft Paper Shows Coding Agents Are Strong Prompt Optimizers(2 posts)→
More from coding & agent
- shadcn boosts @uisdk: one-shot UI rebuild that's instantly E2E-testable by AI — shadcn · 2026-11-16
- AI agent deletes 43,599 lines of OpenClaw test code in one PR — vincent_koc · 2026-11-16
- JPMorgan shows Jarvis, its internal agent assembly line, at Interrupt NYC — LangChain · 2026-11-16
- Dev clarifies: Apple doesn't ban feature flags, only fooling App Review — talkaboutdesign · 2026-11-16
- Antigravity Matches Claude Cowork in Tests, While Gemini Tasks' Purpose Remains Unclear — sebajun2 · 2026-11-16
- One 16GB GPU runs songs, voice, images, 720p video and local RAG — all offline and open source — llama-of-death · 2026-11-16