Sonnet 5.5 now beating Asta and Sol on coding evals, notes Lenny Rachitsky
lennysan · x · 2026-10-10
Lenny Rachitsky notes it's "wild" that Sonnet 5.5 is beating both Asta and Sol on coding benchmarks. No specific scores are given, but the comparison suggests Anthropic's latest model holds the lead in coding performance.
More from Models
- ChatGPT web can actually listen to audio, but the same model can't via API or Codex — Possible_Statement84 · 2026-10-23
- MiniMax M3.1 Flash free for 3 days on 0G, with 1M context and 512K output — MiniMax_AI · 2026-10-23
- TLA+ expert corrects Grok: TLC only exhausts finite state spaces, not all behaviors — tianyin_xu · 2026-10-23
- Open LLM cost calculator shows Arabic tokenization and 6x price gaps across models — Moham-saed · 2026-10-23
- OpenAI blocks manual reset with 13% usage left: 'no reset needed right now' — AccomplishedSugar490 · 2026-10-23
- Meta's 816B Muse Spark Open scores 39, losing to 180B Qwen3.8-Flash-Next at 40 — BTA_Labs · 2026-10-23