Harness Doubles Down on Multi-Model Benchmark Scores
ycombinator · x · 2026-07-16
Poetiq claims their harness led to massive score improvements for several models on benchmarks.
- Reports indicate that Opus 4.8 / GPT-5.5 running on this system comprehensively outperformed Fable / GPT 5.6 Sol.
- Poetiq stated that their RSI system makes benchmarks "too easy." Given a benchmark, it builds its own solutions and beats SOTA across 6 categories: math, coding, planning, long context, tool usage, and web applications.
- They emphasized that no manual tuning was involved.
More from coding & agent
- An MCP server signs every AI agent tool call into a verifiable Merkle chain — Funky_Chicken_22 · 2026-07-22
- Claude Code skill uses 10 Markdown rules to make outputs ADHD-friendly — alex_verem · 2026-07-22
- A Firecracker-based platform says it can host 6,000 AI agents on one 256 GB server — maritime_sh · 2026-07-22
- A better path to agent autonomy is running waves, finding friction, and iterating — JnBrymn · 2026-07-22
- AI agent designers map the visual and tonal cues behind companionship products — Unlikely-Platform-47 · 2026-07-22
- Coding agents are heading toward an AI-writes, AI-reviews, human-approves workflow — aftahi_ai · 2026-07-22