Researcher lists three explanations for "model nerfing," one intentional

gleech · x · 2026-11-11

Responding to whether "model nerfing" is real, researcher gleech lays out three mechanisms: (1) boring — accidental anthropomorphic correlations; (2) boring — compute load balancing shifting traffic to new weights reduces effort on the old model; (3) exciting — vendors intentionally dialing down the old model before a new release to make it look better, though he notes this is risky. He hasn't run tests himself but says variance exists, and offers a testable check: compare model behavior on weekends vs weekdays.

Original post →

More from Models

Models channel →