Google's Pro² Agent hits 76% medal rate on MLE-Bench, a new record

dair_ai · x · 2026-11-21

Google and Johns Hopkins researchers introduce Pro² Agent, achieving a 76.0% medal rate on the full MLE-Bench — the highest reported on the complete benchmark.

The core insight: autonomous research agents usually keep editing a codebase until a metric moves, which leaves them stuck in the wrong part of the solution space on hard tasks because they never write down what they think is wrong.

Key ideas:

Results: 70.7% under the standard 24-hour budget (matching the best reported), 76.0% with 48 hours.

Related event: Google's Pro² Agent Tops MLE-Bench with Record 76% Medal Rate(3 posts)→

Original post →

More from coding & agent

coding & agent channel →