GPT-6 Astra posts first perfect 30/30 on Nonobench; open models score 0/10 on 20×20 Hard mode
mauricekleine · reddit · 2026-09-27
Nonobench v1.2 tests 43 LLMs on nonogram logic puzzles, with all prompts and outputs public.
- GPT-6 Astra scores 30/30 on 15×15 puzzles — the first perfect run on the benchmark.
- Best open weights: DeepSeek V4 Pro at 83% (tied 4th); DeepSeek V4.1 Flash hits 77% for $0.84 total.
- New 20×20 Hard mode (10 unique-solution puzzles, answered row by row after a community finding that most models miscount 400-character strings): Opus 5.5 takes 8/10; every open-weight model scores 0/10.
OpenRouter-only for now; code, raw data, and API on GitHub.
More from Models
- Sarvam Token Factory goes GA, offering open models for enterprise workflows — itsOmSarraf_ · 2026-11-16
- Pangram's 750-word false-positive bounty went unclaimed for 5 days — nobody wants to gamble $1,000 — ctjlewis · 2026-11-16
- Fable 5.2 Tops MazeBench With 21% After 90 Hours and $6,000 in Credits — patience_cave · 2026-11-16
- Tencent Hy4 flash and InternLM Sage-S2.1-Flash both released, tool-calling tests requested — MajesticPuzzler · 2026-11-16
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16