Redditor finds Tiel-Coder-35B MoE runs faster than Qwen 3.8 locally with 256K context
zxspectrun · reddit · 2026-11-05
A Reddit user shares a local-deployment find: after Qwen 3.8 27B proved too heavy for their hardware, they switched to the community model IsValorum/Tiel-Coder-35B-A3B-APEX-I-MiniPlus-V2.1-GGUF, matching Qwen's capabilities for their needs while being noticeably faster.
- Hardware: Ryzen 5 3600, 40GB DDR4, RX 7900 XT (20GB VRAM)
- Setup: BeeLLama.cpp + Llama Swap, model fully in VRAM, 256K context, Kvarn8 cache level
- Generation speed screenshot included; author offers to share full config
More from Infra
- PyTorch Day Japan agenda: backpropagation for real-time robot inference with ExecuTorch — PyTorch · 2026-11-05
- VibeSys uses agents to auto-generate Qwen3.8 serving engines for AWS Trainium2 — bariskasikci · 2026-11-05
- YC-backed OpenLakeHQ launches: continuously trains and serves open models on your data — ycombinator · 2026-11-05
- Stanford's ParallelKernelBench: best LLM solves only 32% of multi-GPU kernel tasks — burny_tech · 2026-11-05
- The AI Industry Risks Becoming the WeWork of AI: Long-Term Liabilities, Short-Term Revenue — bookwormengr · 2026-11-05
- SK Hynix says memory supply won't catch up with demand until 2030 — Beth_Kindig · 2026-11-05