'You Can Run Sophisticated AI Locally? Quantized LLMs Have Done It for Years'
mattwbaker · x · 2026-10-24
Reacting to the buzz around Dessa's full-duplex speech model running on laptops, Matt Baker notes that running quantized LLMs locally has been possible for years, expressing surprise at how many people are just discovering on-device AI.
More from Fun
- Vercel's 'ship to earn your patch' swag: first embroidered patches arrive — evilrabbit_ · 2026-10-24
- Claude Max user burns through 99% of weekly limits before Monday reset — iamsahaj_xyz · 2026-10-24
- Nvidia CEO plays with adorable Microduck robots as 20,000 units sell for Christmas — TechCrunch AI · 2026-10-24
- Husband pranks wife with phishing link: 'You failed the family phishing test' — ZeroStateReflex · 2026-10-24
- AI creator shares cinematic Star Wars and Harry Potter-style generations — miilesus · 2026-10-24
- Watching His Own AI Voice Clone Get Scarily Close, This Creator Is Pre-Inoculating Himself — ZeroStateReflex · 2026-10-24