37 benchmarks, 130K decisions per model: local LLMs tested on one RTX 6000 PRO
multimodalart · x · 2026-09-22
multimodalart ran a large local-model benchmark: 37 benchmarks across 5 categories with 130K decisions per model, all on a single RTX 6000 PRO. Top results include one-pass inference techniques for Qwen3.8-27B and diffusion gemma without fine-tuning, and third-place Decider 35B-A3B, a strong fine-tune of Qwen3.5 35B base.
More from Models
- ChatGPT now links to brand homepages far more, reshaping brand-mention tracking — lilyraynyc · 2026-11-12
- YC-backed Monte launches post-training platform to build proprietary models from your agents' real work — ycombinator · 2026-11-12
- Leak Claims OpenAI Will Launch Entire GPT-6.2 Family Tomorrow to Counter Opus 5.5 and Fable 5.2 — heypearlai · 2026-11-12
- ARC-AGI-3 leaderboard: models score 90%+ but at $10K+ per task — haider1 · 2026-11-12
- LMArena Launches Agent Arena for Head-to-Head Agent Evaluation — arena · 2026-11-12
- LLMs lack hyperlocal municipal data, explains disputed Texas power outage debate — csuwildcat · 2026-11-12