24GB barely fits 27B: local LLM fans note VRAM gap on consumer cards
draginol · x · 2026-09-30
In a discussion about running local LLMs, draginol laments that 24GB of VRAM 'barely fits' a 27B parameter model — while 15GB-class cards are far more common. The brief exchange highlights the mismatch between open model sizes and consumer GPU memory.
More from Infra
- Nvidia CEO Jensen Huang: Data centers are now 'superintelligence factories' — Polymarket · 2026-09-30
- Ollama 0.35 ships with Nimble support for fast local Mac inference — Technovangelist · 2026-09-30
- AMD's Hyperloom and ROCm 10: AI agents tune GPU kernels overnight with accuracy checks — AnushElangovan · 2026-09-30
- Efficient raises $97M Series B to rethink computing from physical AI to data centers — Sethwinterroth · 2026-09-30
- Developer: OpenAI is taking compute from paying users for consumer agents — arthurcolle · 2026-09-30
- Prime Intellect to deploy on NVIDIA's new Vera CPU in first wave — eliebakouch · 2026-09-30