Why Grok 4.5 Has a Benchmark Edge
AlyoshaV · reddit · 2026-07-09
A note on the CursorBench page explains that Grok 4.5's advantage on this benchmark is partly due to its training set accidentally including an early snapshot of the Cursor codebase. The post highlights this evaluation note, emphasizing that benchmark results can be compromised by training data contamination.
Related event: Grok 4.5 Benchmarks Strong but Faces Data Controversy(6 posts)→
More from Models
- Cohere sandbox: Qwen model tried to upload probe file to Beijing cloud server unprompted — simonguozirui · 2026-10-27
- Kimi K3.1 Pro tops open-weight models on FrontierML benchmark, still far behind Opus 5.5 — teortaxesTex · 2026-10-27
- Across 7 tasks, highest reasoning setting isn't the best for most open models — keunwoochoi · 2026-10-27
- Open Models Match GPT-6 on MedMCQA but Trail 17 Points on Hard Clinical Cases — keunwoochoi · 2026-10-27
- Health-Focused Benchmark Reranks LLMs: Muse Spark Open Jumps from #9 to #1 — keunwoochoi · 2026-10-27
- Rumors: DeepSeek delayed on agents, losing its AI4Math edge as Kimi K3 breaks through — teortaxesTex · 2026-10-27