PrimeIntellect releases full traces from largest open experiment on autonomous AI research
burny_tech · x · 2026-08-17
PrimeIntellect has released data from the largest open experiment to date on how frontier models perform AI research autonomously.
Key Findings & Details:
- Experiment Setup: 100+ autonomous runs across 10+ models, sandboxed on 8xH200s for up to 8 days, iterating on the nanoGPT optimizer track.
- Performance: The best runs closed 82% of the gap to a record built by dozens of humans over months.
- Open Data: Full traces, scratchpads, and reasoning streams from open-weight models have been released, providing valuable data for startups working on autoresearch.
More from coding & agent
- Devs say LLM coding mistakes are a different class: overcomplication, inferred limits, worse at higher reasoning — Mu5_ · 2026-10-16
- How do you debug bad agent runs when you already have tracing? — Sensitive-Parsnip-12 · 2026-10-16
- Where does pre-task context live for agents? Devs debate workflows beyond handoff — shishen2026 · 2026-10-16
- No-instruction autonomous agent wakes up, sets own goals, and tries hacking by default — sethlazar · 2026-10-16
- CODESTRUCT reframes codebases as AST action spaces to fix brittle LLM code agents — burkov · 2026-10-16
- Would you install another SDK for agent debugging on top of your tracing stack? — Sensitive-Parsnip-12 · 2026-10-16