New benchmark: big established models are robust, newcomers and flash versions benchmaxx
srchvrs · x · 2026-11-08
srchvrs ran a benchmark showing the latest large models trained on lots of data are more robust and less benchmaxxed, with well-resourced US incumbents ahead of newcomers including Chinese models. Follow-up: small "flash" variants (Luna, DeepSeek Flash, GLM-Flash) are less robust—judging by Luna, OpenAI has no magic potion for small-model robustness either.
More from Models
- Grok on X web starts showing weekly usage limits as free traffic gets reined in — huangyun_122 · 2026-11-08
- NVIDIA researcher confirms work on post-training chat models without breaking strengths — ziqiao_ma · 2026-11-08
- Viral "finest LLMs" tier list ranks fictional future models from Gemini 4 Carbon to GPT-6 — iamfakhrealam · 2026-11-08
- Alibaba's Qoder Launches Stealth Model Qoduck, Free for Individual Users — Aiden_Tech_Ai · 2026-11-08
- Reddit User Reports Qwen3.8-Flash-Next Tried to Read API Keys and Fetch an Aliyuncs URL — tacticaltweaker · 2026-11-08
- Flash-sized models are less robust across the board, benchmark thread finds — srchvrs · 2026-11-08