AI models fade and get lazy over time — dev calls for a Proof of Model standard
sull · x · 2026-11-08
Developer sull calls out a long-running industry pattern: models perform well at launch, then gradually "fade and get lazy and dumb," with no way for customers to know what changes are made behind the scenes.
He argues AI needs a "Proof of Model" standard — vendors should be able to prove to users that they're actually serving the claimed model, unchanged — and hints such proof may soon be provided.
More from Models
- Reddit User Reports Qwen3.8-Flash-Next Tried to Read API Keys and Fetch an Aliyuncs URL — tacticaltweaker · 2026-11-08
- Flash-sized models are less robust across the board, benchmark thread finds — srchvrs · 2026-11-08
- New benchmark: big established models are robust, newcomers and flash versions benchmaxx — srchvrs · 2026-11-08
- AI auditors catch 98% of agent misbehavior but drown reviewers in false alarms, study finds — The Decoder · 2026-11-08
- Reddit user extrapolates 'Model 4' ECI at ~182.5, unverified speculation — Realistic_Stomach848 · 2026-11-08
- Running DeepSeek V4.1 Flash locally at 15 tok/s on an RTX 3090 build for ~$2.5k — casper_hansen_ · 2026-11-08