Google's BuggyMLE injects bugs into ML repos, dropping top model solve rate from 95% to 9%

omarsar0 · x · 2026-11-23

Google Research and DeepMind released BuggyMLE: Scaling Machine Learning Engineering Difficulty with Bug Injection, tackling the rapid saturation of repository-level coding benchmarks by deliberately injecting controlled bugs into ML engineering tasks.

Key points:

Original post →

More from Models

Models channel →