Full Leaderboard Released for LLM Backend Coding Benchmark (Vector DB from Scratch)
karminski3 · x · 2026-09-14
The author shares the full leaderboard and charts for the earlier LLM backend-coding benchmark (building a vector database from scratch, scored by DB performance).
Key conclusions as before: Fable-5.1 peaks highest (21191.51) but swings over 50% across three runs, GPT6-Astra is the most stable (12985.28 / 12134.83 / 10676.74), and DeepSeek-V4.1-Flash is the best value, nearly matching Kimi-K3 with <20% variance.
More from Models
- Users report GPT quality drop; an old-school prompt warm-up trick to regain compliance — NickPassig · 2026-10-31
- Gemini 4 Carbon vs Opus 5.5 hands-on: 3x cheaper at $4.10 and twice as fast — vitaliychiley · 2026-10-31
- 4B model Spark-X2.6 scores 94.6/100 on community benchmark, beating 27B-35B models — mesolimbic-bliss · 2026-10-31
- opencode: $100 of usage gets you DeepSeek V4.1 Flash — intellectronica · 2026-10-31
- Researcher Finds 600+ Bugs in LLM Kernel Code; Claude Blocks Safety Analysis — pmddomingos · 2026-10-31
- Signal65: Snowflake's CoCo agent finishes workflow 4.6x faster than manual — ryanshrout · 2026-10-31