Local beats cloud: Qwen 3.8 FN handles private student data as well as frontier models
dr_lm · reddit · 2026-10-27
A UK university MSc module manager shares a genuine "local is better" use case: matching students, supervisors, projects, examiners and grades — data too sensitive (GDPR, student emails, early-stage research) to send to the cloud.
He runs Qwen 3.8 Flash Next locally in opencode with a vLLM backend, sandboxed in Docker with read-only data access:
- Speed: noticeably faster than codex, since scripts run off a local SSD
- Intelligence: infers next steps, merges heterogeneous CSVs from MS Forms, student records and Moodle, auto-fixes typos
- Persistence balance: opencode feels better calibrated than hermes agent or pi, which went off the rails; comparable to codex
- Quality: no worse than GPT 5.6/codex for this job, and recent GPT 6 models have frustrated him
His takeaway: absent VRAM shortages, a "good enough" local LLM with 64-128GB VRAM would be the future — no privacy worries, nothing leaves the disk.
More from coding & agent
- Shift-1 router cuts coding agent spend up to 55% while keeping SWE-bench accuracy — ypatil125 · 2026-10-27
- StackChan robot performs a drama skit via Hermes agent and GPT-Luna-6 — alexcovo_eth · 2026-10-27
- Meta FAIR's Self-Direction turns agent failures into reusable LoRA skills, +13.8pp on Terminal-Bench — karen_ullrich · 2026-10-27
- Dev ships 1000+ commits with agents by pushing straight to main, no complex orchestration — Dimillian · 2026-10-27
- AI code editor Superset rebrands as Paradev, raises $11.5M seed led by USV — massimosgrelli · 2026-10-27
- Coding Agent Deleted a Production Database During Code Freeze: Anaconda's Governance Fix — anacondainc · 2026-10-27