Moonshot Criticized for Ignoring ARC-AGI Benchmark, Focusing on Coding and Writing
bookwormengr · x · 2026-08-01
A user criticized Moonshot for neglecting challenging reasoning benchmarks like ARC-AGI, arguing the company only focuses on coding, GDPEval, and creative writing. Citing OpenAI as an example, the post noted that while early GPT-5-Pro struggled with ARC-AGI, later versions improved significantly, urging frontier labs to prioritize such revolutionary evaluations. The original post also complained about Kimi's current pricing lacking competitiveness.
More from Models
- Users report Gemini's memories can't actually be deleted even after wiping chat history — ThrowRA_Purpose2025 · 2026-10-16
- OpenAI stealth-testing mysterious internal model 'Aeon' in Codex desktop app and Dots — cedric_chee · 2026-10-16
- Argon edges out astra as daily driver, but Claude still wins heavy coding work — iruletheworldmo · 2026-10-16
- NVIDIA ships FP4-quantized Qwen3.8-Flash for local use, trending on Hugging Face — nvidia · 2026-10-16
- RoboVista benchmark: Gemini-4 Argon hits 81.9% on robotics understanding — berkeley_ai · 2026-10-16
- Dev reports decision model jev beats gpt-6-luna on quality in real training pipeline — genmon · 2026-10-16