PRIMESCIENTIST teaches research agents to allocate experiments, +10.3% reward with 50.6% fewer attempts
rohanpaul_ai · x · 2026-09-27
- Core idea: research agents should decide where to spend experiments rather than pushing one idea until the budget runs out. PRIMESCIENTIST keeps competing executable plans in a tree; results update branch values while the allocation policy explores broadly when resources are plentiful and concentrates on stronger branches as budget shrinks.
- Results: on 12 FIRE-Bench tasks it delivered 10.3% higher average reward than AutoResearch with 50.6% fewer research attempts under the same token budget, using fewer attempts on 23 of 24 tasks overall.
Related event: PrimeScientist Uses MCTS to Allocate Research Budget, Boosting Reward 10.3%(2 posts)→
More from coding & agent
- Baseten's Guide: Evaluate Open Models for Coding Agents on Your Own PRs — baseten · 2026-11-16
- Google Research open-sources PaperOrchestra, a multi-agent framework for writing AI papers — google-research · 2026-11-16
- ffmpeg-skill gives coding agents local video editing via 42 FFmpeg tools and MCP — kajisho5 · 2026-11-16
- Agents Now Reply to Slack Messages on Their Own, Resolving a Prod Incident Ghost-to-Ghost — iamrobotbear · 2026-11-16
- Engineer's Interview Prep Method: Use Claude to Find Which Answers Undersell Your AI Work — brandon_galang · 2026-11-16
- DeepSeek open-sources its app frontend "chat-demo", already at 3.9k stars — NielsRogge · 2026-11-16