Matthew Berman claims Kimi K3.1 invented its benchmark scores
Matthew Berman · youtube · 2026-10-25
YouTuber Matthew Berman published a video alleging that Moonshot AI's Kimi K3.1 "invented the benchmark scores," implying its published evaluation numbers are not trustworthy. The video shows benchmark comparison charts across reasoning, math, and agentic tasks. Details of the evidence are in the video itself.
More from Models
- AI companion app refuses to insult user even with explicit consent, sparking guardrail debate — Angaisb_ · 2026-10-25
- Casado: 'Abliterated models look behind the curtain' — a late-night vibe check — generativist · 2026-10-25
- GLM 5.3 Flash NVFP4 local-run repo assembled, tested up to 1M context (512K recommended) — HankYeomans · 2026-10-25
- Workday's returning CEO slashes AI agents in development from 50 to 20 — Scobleizer · 2026-10-25
- AI pulse: open models ~5 weeks behind frontier, Hermes agent merges 122 PRs in one day — Scobleizer · 2026-10-25
- Hugging Face researcher early impressions: Gemini 4 output "really nice" — eliebakouch · 2026-10-25