DeepSeek V4 Flash Local Quantization Benchmark on SlopCodeBench
corruptbytes · reddit · 2026-08-09
A developer shared local quantization benchmark results for DeepSeek V4 Flash on SlopCodeBench. Running with antirez q2-q4 imatrix quantization on a MacBook M5 Max, it is much slower than the hosted API, but switching the harness to pi 0.84.0 helped recover some of the intelligence lost to quantization.
Key Results (Strict category):
- Local quant (run B): 5/17 (29.4%)
- Opus 5 (API): 4/17 (23.5%)
- DeepSeek V4 Flash (API): 3/17 (17.6%)
The test indicates that proper harness configuration is crucial for maximizing the performance of locally quantized models.
More from Infra
- MLCommons launches MLPerf Endpoints, a benchmark that measures inference endpoints the way buyers actually purchase them — TheKanter · 2026-10-16
- Neocloud M&A decoded: CoreWeave, Nebius, Crusoe, Nscale all bet margins vanish beyond GPU scarcity — AccBalanced · 2026-10-16
- AI-Driven Timing-Aware Power Optimization Uses Learned Ranking With Baseline-Preserving Repair — Amit Sharma · 2026-10-16
- Nscale AI datacenter plagued by coolant leaks, transformer fire, 10 safety violations — saranormous · 2026-10-16
- WSL 3.0 ships with native containers and Linux 6.18 kernel, syscall overhead down ~16% — solyarisoftware · 2026-10-16
- Are 22 GB modded RTX 2080 Ti cards a viable budget local LLM option? — Dave86ch · 2026-10-16