Code2Video-AA Samples: Same Brief, Four Models, Massive Quality Gaps
ArtificialAnlys · x · 2026-10-27
Artificial Analysis shares sample submissions for a single Code2Video-AA brief from Claude Opus 5.5 (1536), DeepSeek V4.1 Flash (1053), MiniMax-M3 (724), and Nemotron 3 Ultra (304), with per-task cost and output tokens. Additional data: GPT-6.1 Sol ranks fourth (1369) at $0.31/task, roughly a tenth of Opus 5.5's $3.08; eight models lie on the Elo-vs-cost Pareto frontier.
More from Models
- gdb responds to OpenAI's math breakthroughs: P still probably doesn't equal NP — gdb · 2026-10-27
- Bug Hunt Bench leaderboard: Sonnet 5.5 max tops at 51.3 by refusing to stop — PawelHuryn · 2026-10-27
- GPT-6.1 Terra scores 40.7 on Bug Hunt Bench at max, but collapses below that tier — PawelHuryn · 2026-10-27
- Fable 5.5 rumored to drop tomorrow, per developer teaser — daniel_mac8 · 2026-10-27
- A Qwen3.5-4B fine-tune is getting better at generating 3D scenes — ConfidentDinner6648 · 2026-10-27
- Enterprise benchmark: GPT 6.1 Sol High scores 94.8% at $1.07 per task, DeepSeek 1017 78.1% at $0.42 — emilahlback · 2026-10-27