A nonprofit wants Qwen for everyday paperwork: how to pick local hardware
DerAndi_DE · reddit · 2026-09-01
A Reddit user seeks a locally deployed LLM for a nonprofit, with needs including document/mail summarization and drafting, RAG over a fixed document set, printed and handwritten OCR, French/English/German translation, and generating LibreOffice documents for computer-illiterate users.
On an old server (Xeon E5-2665v4, 96GB RAM, two P106s), Gemma3-26B tested surprisingly well at acceptable speed, while Qwen3.5-35B-A3B felt too slow. Budget allows two RTX 3060 12GB, a single 32GB V100, or two RTX 5060 Ti; they ask whether Qwen3.8 suits the task and for real-world experience.
More from Models
- Fable 5.1 spotted staged on Bedrock, launch may be days away — haider1 · 2026-09-01
- Do Models Get Dumber Before a New Release? User Speculation on Reliability Drops — Salmaaboukarr · 2026-09-01
- Spending $60k on Macs for Local LLMs Still Beats by $10 Cloud Subscription — leebase65 · 2026-09-01
- NVIDIA reportedly buys Hugging Face for $12.9B; GLM-5.3-Flash and Qwen4 preview land — altryne · 2026-09-01
- METR + Redwood GPT agent swarm probe could only analyze GPT variants, not Claude — geoffreyirving · 2026-09-01
- Thomson Reuters builds $40M legal LLM rivaling Claude Opus on Qwen — josh_wills · 2026-09-01