Frontier labs still trail routed model systems on DRACO deep-research tasks
iamtrask · x · 2026-07-22
Andrew Trask says frontier AI labs have lost the “deep research” frontier on DRACO, a benchmark for deep-research tasks.
- Since May, OpenRouter, Sakana AI, and Los Alamos National Laboratory have each reported that routed combinations of models beat individual frontier systems.
- OpenMined re-ran the OpenRouter experiment and says the result still holds a month later.
- In one example, a routed system reached Fable-level quality at roughly half the price of Anthropic’s Fable API, and the top single frontier model only placed sixth in the reproduced setup.
Related event: DRACO Benchmark Shows Routing Systems Outperform Single Frontier Models(2 posts)→
More from Research
- Nature Physics: reprogrammable refractive index enables arbitrary multimode wave control for ML — MarioKrenn6240 · 2026-10-27
- Wakaru open-sources ontologize: labeling datasets from model activations — amplifiedamp · 2026-10-27
- EMNLP Oral paper traces multilingual representations in LLMs with cross-layer transcoders — ZhijingJin · 2026-10-27
- GPT-6 Pro reruns crime research: GTA V's 2013 launch tied to violence dips in four regions — emollick · 2026-10-27
- OpenAI's Aaron Lou on leaving a Stanford PhD for OpenAI, diffusion LMs vs autoregression — aaron_lou · 2026-10-27
- CLT-Forge: Open-source toolkit for cross-layer transcoder training and attribution graphs — ZhijingJin · 2026-10-27