Pro² Agent paper: explicit Problem State lifts autonomous AI R&D to 76% MLE-Bench

rohanpaul_ai · x · 2026-11-21

The arXiv paper 'Pro² Agent: Scientific Problem Probing for Autonomous AI R&D' (Google + Johns Hopkins) argues LLM research agents stall on hard problems because they only optimize a codebase without representing the problem structure. Pro² Agent replaces the codebase state with an explicit Problem State — suspected bottlenecks, candidate solutions from targeted literature research, and confidence levels updated through controlled hypothesis testing. It matches the best reported 70.7% medal rate on full MLE-Bench at 24 hours and reaches a record 76.0% at 48 hours, performs competitively on PostTrainBench, and emits transparent research notes reusable by human researchers.

Original post →

More from coding & agent

coding & agent channel →