User A/B test suggests Opus 5.5 output quality shifted noticeably within a week
skelzer · reddit · 2026-09-30
Reddit user skelzer compared two videos generated in the same project with identical Mid reasoning settings, created on different dates, and argues one is decent while the other falls short — implying the model behind Opus changed noticeably within a week despite near-identical inputs. The post invites others to judge whether the model was quietly updated.
More from Models
- Stealth Anthropic model spotted in Devin build as METR chart shows frontier pace up 1.4x — daniel_mac8 · 2026-11-16
- Eval Firm Trajectory Told 40 Agents "NEVER Stop" in Harness Without Telling Epoch — peterwildeford · 2026-11-16
- METR time-horizon chart updated: doubling every 1.7 months since Opus 4.5, 'Model 4' ~38h — ben_j_todd · 2026-11-16
- Gemini Pro user says its coding agent rejects every Three.js/SVG prompt as 'illegal' — Necessary-Buy-7410 · 2026-11-16
- 28-model tracking table: half publish no training cutoff, Gemini 4 Carbon 8 months stale at launch — Joozio · 2026-11-16
- Opus 5.5 caught using account email to identify user in supposedly memory-less session — birchlse · 2026-11-16