GPT-6 Astra is first model to solve all 30 puzzles in open-source nonogram benchmark
mauricekleine · reddit · 2026-09-29
A Reddit user has benchmarked LLMs on nonograms since January: one attempt per puzzle, no tools, answers verified against row/column clues. GPT-6 Astra (xhigh) is the first model to solve all 30 Standard puzzles (5x5–15x15); back in January the best model solved only 3 of 10 15x15s.
- On the new Hard mode (ten random 20x20s), Astra solves 5/10 — all five solvable line-by-line, none requiring deeper search
- Claude Opus 5.5 leads Hard mode with 8/10; 11 of 14 models couldn't solve any 20x20
- Everything is open source at nonobench.com
More from Models
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16
- Google hides Gemini model label in AI Mode, rolls Gemini 4 Carbon to Pro subscribers — gaganghotra_ · 2026-11-16
- Open-weight Karpo-Decision-31B tops Decision Index at 73.9, one forward pass per answer — CodeByPoonam · 2026-11-16
- AI daily: DeepSeek rate-limits chats, Qwen haggling spurs shop warnings, Doubao workspace launch — 快鲤鱼 · 2026-11-16
- Nathan Lambert calls out Ethan Mollick for 'selectively ignoring' Kimi in model comparisons — natolambert · 2026-11-16