Local LLM Review: Qwen-27B Replaces Cloud, Ornith-9B Handles Coding Tasks
Barni275 · reddit · 2026-08-31
A developer shared hands-on experience running open-source models locally for coding:
- Qwen-2.5-72B (labeled 27B/3.8 in post): Runs on an RTX 3090 (Q80 KV, 180k context) with 1000-1500 tps prefill and 45-60 tps generation. The experience is excellent, replacing cloud subscriptions from 5-6 months ago for major coding tasks.
- Ornith-1.5-9B: Runs on a home server with 8GB VRAM. Without benchmarks, it successfully handled simple Python refactoring tasks. The author seeks more real-world coding feedback on this model.
More from coding & agent
- Fintech HR built a sourcing agent on 60,000 past applicants — 30 qualified candidates in a month — G0NZ0BOY · 2026-10-16
- Orchestrating a 100-image portrait of humanity for aliens with ChatGPT, Argon and p5.brush — dx8xb · 2026-10-16
- 3x DGX Spark cluster runs GLM-5.3-Flash locally behind a proxy, 1.75M tokens/day at 119W — Teknium · 2026-10-16
- Builder's one rule for trusted desktop agents: read freely, but sending, deleting, buying always ask first — No_Fan5310 · 2026-10-16
- GPT-built unifi-simulator makes MikroTik switches appear inside UniFi Network — Pytlicek · 2026-10-16
- Stanford drops 45-min SpaceX lecture on how Grok Bot's always-on agent harness works — Hesamation · 2026-10-16