Desktop iGPU beats dual 3090s due to a Jinja template
TrifleHopeful5418 · reddit · 2026-08-25
A comparison on LiveCodeBench v6 shows Ornith-1.5-35B-A3B running on a Strix Halo iGPU nearly matches Qwen3.8-27B on dual 3090s. The key finding is that adding a LoRA and switching to a Sharp Chat Template improved scores by 15 problems, a gain larger than adding a second GPU. The author also warns that the default thinking-mode profile in GGUF failed all tests, recommending the Instruct profile instead.
More from Models
- Reasonable post-trains Nemotron 3.5 on 3,000 Verus proofs, lifting pass@1 ~30 points to 73.3% — fhuszar · 2026-10-16
- NVIDIA's Nemotron 3.5 Super VL hits CoreWeave: 12B-active multimodal MoE at $0.25/M input tokens — wandb · 2026-10-16
- Opus 5 might be a very deep model or use looping, commentator speculates — scaling01 · 2026-10-16
- GPT-6.1 Sol audit finds 6% of arXiv papers had false main theorems, down to 1.5% recently — nitarshan · 2026-10-16
- Nvidia-backed post-training pushes Nemotron 3.5 VL past frontier on dermatology diagnosis — LoganGrasby · 2026-10-16
- Gemini 4 Argon scores 97.5% on ARC-AGI-3, second lab above 95% — patience_cave · 2026-10-16