The Resolution Hypothesis: agent evolution stalls because noisy evals can't spot real improvements

ShanghaiTech · hf · 2026-11-19

A ShanghaiTech + ByteDance + BIGAI + SUSTech paper, "The Resolution Hypothesis," argues that agent evolution (proposers generating prompts/skills/memories, selection keeping higher scorers) stalls not because methods fail to propose better artifacts, but because noisy evaluations can't reliably identify them.

Across 7 evolution methods, 6 models and over 10M LLM calls, the hypothesis holds at two levels:

Implication: progress requires making true improvements detectable and accumulable, rather than piling on new proposal methods.

Original post →

More from coding & agent

coding & agent channel →