Elie Bakouch: current AI research benchmarks overfit and can't track RSI

eliebakouch · x · 2026-11-19

Researcher Elie Bakouch weighed in on debates about AI research benchmarks, arguing they do measure "something" but fail to capture what AI research actually cares about — track 1 likely overfits heavily on both performance improvements and hyperparameters. His core point: these benchmarks are nowhere near the hardest tier, and if the community wants to genuinely track RSI (recursive self-improvement) progress, far harder benchmarks are needed.

Original post →

More from Research

Research channel →