Everyone posts 3D render and SVG evals, but nobody shows the refusals and quotas
BLUECOW009 · x · 2026-09-23
The author points out a blind spot in benchmark hype: while fans happily post 3D render and SVG generation evals for new models, nobody posts the refusal rates or quota limits — implying the showcased evals may be cherry-picked and real-world usability is overstated.
More from Models
- Third-party test: Claude Opus 5.5 renders finer 3D scenes but costs 13x more than GPT-6 Sol — testingcatalog · 2026-09-23
- Tester claims Claude Opus 5.5 has the best visual design output of any model tested — burny_tech · 2026-09-23
- GPT-6 Sol Codex system prompt leaked: over 294,000 characters dumped on GitHub — gaganghotra_ · 2026-09-23
- Claude 5.5 (live) keeps generating user turns, reports user — BlackHC · 2026-09-23
- Code benchmarks are mostly slop: dev calls for narrow evals per domain, not one score — almmaasoglu · 2026-09-23
- Grok 4.7 turns an envelope sketch into playable puzzle game Lightweave in minutes — luismbat · 2026-09-23