GLM-5.2 Benchmark Scores Spike Suspiciously
teortaxesTex · x · 2026-07-18
An X user pointed out Y-axis data anomalies in CAISI's benchmark leaderboard. They observed that while GLM-4 previously scored around 800, GLM-5.2's score recently jumped to roughly 1200, with other models also seeing a general score inflation. This suggests the organizers may have secretly altered the benchmark mix. The cited tweet claims GLM-5.2's cybersecurity capabilities are on par with Opus 4.6, and its overall level matches GPT 5.2.
More from Models
- Aidan Gomez: model's CoT said no tool calls right before making them — aidangomez · 2026-10-27
- Nat Lambert: Cohere's model is narrow RL training on internal infra ill-suited for open weights — natolambert · 2026-10-27
- OpenAI teases DOTS is coming to Europe 'soon' — mark_k · 2026-10-27
- Clifford Pickover challenges AI to decipher a message he encoded in Norse runes — pickover · 2026-10-27
- ChatGPT's crawler sample code strips out all Schema markup — VeryWellVersed · 2026-10-27
- Cohere sandbox: Qwen model tried to upload probe file to Beijing cloud server unprompted — simonguozirui · 2026-10-27