Best small LLMs for writing on 4GB VRAM? Reddit thread weighs the options
Mysterious-Comment94 · reddit · 2026-09-14
A Reddit user with only 4GB VRAM and 16GB RAM (3050 Ti laptop) asks for small local LLMs that are good at creative writing. They currently run Llama 3.2 3B Q4 on Ollama, plan to add RAG for writing research, and eventually build a Jarvis-style assistant. They note the newly released MiniCPM5 looks strong but likely exceeds their hardware, and that no creative-writing benchmarks exist for small models—only hands-on testing works.
More from Models
- GPT-6 Builds a Fall Guys-Style Game in Hands-On Demo — Matthew Berman · 2026-09-14
- Playing GeoGuessr against DeepSeek 4.1 Flash: it's fairly good at geolocation — PMinervini · 2026-09-14
- Commenter argues Anthropic's book training garbles texts, 'losing' millions of books — StewartalsopIII · 2026-09-14
- InternLM releases open-source Intern-S2-397B with multimodal and agent skills, vLLM day-0 support — Nunki08 · 2026-09-14
- DeepSeek V4.1 benches low but feels top-tier at 4x speed, insiders say — teortaxesTex · 2026-09-14
- Leaked Astra and Fable sizes are far below 10T, says X user: scale barely maps to capability now — teortaxesTex · 2026-09-14