Dual RTX 4060 Ti local LLM benchmarks: 35B MoE decodes at 122.5 tok/s
Rooneybuk · reddit · 2026-10-30
A Reddit user shared prefill/decode benchmarks for a dual RTX 4060 Ti 16GB (32GB total) setup and asked whether a Mac Studio M5 Max (40-core GPU, 64GB) would compare favorably for local LLMs.
Current numbers on the 2x 4060 Ti:
- Qwen3.6-35B-A3B (UD-Q4KXL, 262k ctx): 76.7 t/s prefill, 122.5 t/s decode
- Qwen3.8-27B dense (UD-Q4KXL, 200k ctx): 55.5 t/s prefill, 34.3 t/s decode
The thread solicits Mac prefill/decode speeds on similar models, offering practical reference data for local deployment hardware choices.
More from Infra
- 10 coding agents tested on local Qwen 3.8 27B: Pi wins on efficiency at 9.2k tokens per task — latent_lurker8587 · 2026-10-30
- Banks Shelve $5-7B Junk-Bond Sale for Anthropic-Leased Texas Data Center on Grid Audit — rohanpaul_ai · 2026-10-30
- Weight compression on the GPU: researcher proves his own instinct wrong — realDanFu · 2026-10-30
- Cached tokens explained: agent loops overpay for the same prefix, 50x savings — Arindam_1729 · 2026-10-30
- GB300 NVL72 runs DeepSeek Flash at ~1000 tok/s/user, ~$0.07 per 1M tokens TCO — bookwormengr · 2026-10-30
- Sam Altman: self-replicating AI-built data centers are 'within grasp' — Eliv_nurotic · 2026-10-30