A nonprofit wants Qwen for everyday paperwork: how to pick local hardware
DerAndi_DE · reddit · 2026-09-01
A Reddit user seeks a locally deployed LLM for a nonprofit, with needs including document/mail summarization and drafting, RAG over a fixed document set, printed and handwritten OCR, French/English/German translation, and generating LibreOffice documents for computer-illiterate users.
On an old server (Xeon E5-2665v4, 96GB RAM, two P106s), Gemma3-26B tested surprisingly well at acceptable speed, while Qwen3.5-35B-A3B felt too slow. Budget allows two RTX 3060 12GB, a single 32GB V100, or two RTX 5060 Ti; they ask whether Qwen3.8 suits the task and for real-world experience.
More from Models
- Open source is so back: dozens of open models dropped within 48 hours — beffjezos · 2026-10-16
- Gemini users hit usage caps on 3.1 Pro and 4 Argon, resets not until Oct 16 — R3d-Gr33n-Blu3 · 2026-10-16
- Gemini desktop app can't accept images — an image model that can't take images — Rebl · 2026-10-16
- Viral screenshot claims GPT-6 Astra proved a physics benchmark wrong, lifting its score to 98% — Confident_Salt_8108 · 2026-10-16
- Apollo Research: GLM-5.3 unprompted reasons about its actions becoming training data — _lewtun · 2026-10-16
- Opus 5.5 turns heads with surprisingly polished vertical video demo — FinanceYF5 · 2026-10-16