Vision+Logic Benchmark: Gemini Leads, GPT Stagnates
Afinetheorem · x · 2026-08-13
On a custom vision and logic benchmark, the author found Grok 4.6 and Qwen3.8 Max to be mediocre, scoring between Gemini 2.0 Flash Lite and GPT 5.6 Luna. Gemini models remain the best at this type of task, while GPT models, despite being decent, haven't significantly improved since the o3 release over a year ago.
Related event: Gemini Leads in Visual-Logic Evaluation as GPT Hits Bottleneck(2 posts)→
More from Models
- Unverified claim: Apple and Meta's 816B-parameter Muse Spark Open runs on two Mac Studios — TansuYegen · 2026-10-16
- Gemini 4 model card: model eliminated months of trial-and-error on bioweapons research — Puzzleheaded-King584 · 2026-10-16
- Every AI picks 7: Anthropic engineer's rule for escaping model taste convergence — rubenhassid · 2026-10-16
- Brain teaser: strip all attention, MLP and embedding matrices from a Llama 3 — how many trainable params remain? — Sauers_ · 2026-10-16
- Lean v4.35.0 ships verified kernels — one written and proven consistent by Claude — geoffreyirving · 2026-10-16
- One flagged seat froze an entire Claude team org — founders share backup plans — RexDouglass · 2026-10-16