Gemini 4 Argon scores 20.2% on agentic WeirdML v3 benchmark, between Claude models
scaling01 · x · 2026-10-18
Gemini 4 Argon (high) posted an official 20.2% on WeirdML v3, a new fully agentic benchmark, landing between Claude Sonnet 5.5 (19.9%) and Claude Fable 5.1 (26.0%).
- WeirdML v3: 11 hand-made complex tasks where models must explore unfamiliar data and build ML/data-analysis pipelines with limited data, unspecified goals and minimal feedback.
- Leaderboard: GPT-6 Astra (xhigh) leads at 0.422 average ($27.85/run), GPT-6.1 Sol at 0.383 ($5.29), Claude Opus 5.5 at 0.312 ($10.25).
- Gemini 4 Argon cost $17.84 per run with a final best of 0.414; the author notes strong performance but token efficiency still trails the frontier.
More from Models
- User: GPT-5.5 is stronger but acts without approval, while GPT-5.0 understood intent better — PawelHuryn · 2026-10-18
- Muse Spark runs on a single Mac Studio M3 Ultra at 18 t/s decode — challis88ocarina · 2026-10-18
- Kaggle LLM attribution contest: GLM text is flagged as Claude 44% of the time — HarveenChadha · 2026-10-18
- KOL predicts DeepSeek V4.1 Pro may not beat Flash, blaming RL budget over pretraining — teortaxesTex · 2026-10-18
- Google's Gemini deletes all chat history if you turn off data sharing — cyber_red0028 · 2026-10-18
- Reddit thread crowdsources the real failure modes of frontier coding models like Opus 5.5 and GPT-6 — SadPossibility2338 · 2026-10-18