Deep Dive: Real-world Performance and Controversies of Grok 4.5, Kimi K3 and More
eyishazyer · x · 2026-07-30
The author evaluated four recently hyped AI coding models, concluding that none of them fully lived up to the expectations:
- GPT-5.6 Sol: Reviews are polarized. Some praise its ability to generate web apps in one shot as a massive upgrade, while others experienced extreme latency on basic prompts.
- Kimi K3: The r/LocalLLaMA community sees it as proof that China is rapidly closing the gap. A major highlight is that it doesn't refuse basic cybersecurity or low-level programming tasks like Codex does, though its 2.8 trillion parameters make it nearly impossible to run locally.
- Grok 4.5: The first model jointly trained by xAI and Cursor using real developer-agent sessions. Cursor honestly admitted that its benchmark edge might partly stem from an old codebase snapshot leaking into the training data.
Related event: Users Find GPT-5.6 Outperforms Opus 5 in Practical Tests(4 posts)→
More from coding & agent
- 'LLM code is sloppy' rebutted with real ffmpeg code: identical if/else branches in a top library — kingslyj · 2026-10-16
- Agent actions need checks outside the model: NVIDIA demos lean on guardrails amid wave of real agent incidents — Creamy-And-Crowded · 2026-10-16
- Vitalik builds "paranoid mode" agent wrapper with Tor, zkAPI and local prompt rewriting — DavideCrapis · 2026-10-16
- Agent fine-tunes Qwen3.5-0.8B with synthetic data: 4.7%→76.3% accuracy, 11.9× faster — ben_burtenshaw · 2026-10-16
- Beam-501B agent demo: solo beats 5-agent team on ProgramBench rebuild task — ben_burtenshaw · 2026-10-16
- Beam agent builds BeamSpeak, a local Parakeet dictation app for macOS — ben_burtenshaw · 2026-10-16