Google & JHU's Pro² Agent hits 76% MLE-Bench medal rate by tracking bottlenecks

rohanpaul_ai · x · 2026-11-21

A Google–Johns Hopkins paper introduces Pro² Agent, which shifts an AI research agent's primary state from the codebase to an explicit 'Problem State': suspected bottlenecks, candidate fixes from the literature, and confidence in each, updated via single-variable experiments before committing changes. It reaches a reported-best 76.0% medal rate on all 75 MLE-Bench tasks within 48 hours (70.7% at the standard 24-hour budget), and its first solution already medals on 57.6% of MLE-Bench Lite vs 28.8% for MARS. Takeaway for agent builders: write down and update what is blocking progress, and test one change per experiment.

Original post →

More from coding & agent

coding & agent channel →