DiG-bench: Frontier AI Models Still Stumped by Simple Text-Based Discovery Games
jcrwhittington · x · 2026-08-12
A research team introduced DiG-bench, a new benchmark of 70 text-based interactive games designed to evaluate LLMs' scientific discovery and rule-exploration capabilities.
Results show that while frontier models have improved significantly in recent months, they are still stumped by surprisingly simple text-based discovery problems. A substantial bottleneck remains in native text-domain exploration.
Related event: DiG-bench: 70 Text Games Expose Frontier AI's Discovery Gaps(14 posts)→
More from Research
- DIRECT: retrieval-based next-question suggestions for conversational agents — burkov · 2026-10-16
- AI-Driven Timing-Aware Power Optimization Uses Learned Ranking With Baseline-Preserving Repair — Amit Sharma · 2026-10-16
- Waypoint-OPD: Alibaba Gates On-Policy Distillation via Early-Late Teacher Shift Agreement — Bingxi Hou · 2026-10-16
- MJev-Spatial: Single-Pass Classification Beats Autoregressive VLMs on Spatial Reasoning — mindlab-research · 2026-10-16
- MLExpert: 35B MoE Agent Trained to Autonomously Handle Machine Learning Engineering — Shangheng Du · 2026-10-16
- VLA-Δ: Zhejiang University Adds Physical State Transition Supervision to VLA Models — OmniAI-ZJU · 2026-10-16