LFM2.5-24B-A2B praised for local agent use: 37 tok/s on an AMD 780M iGPU
jeremyckahn · reddit · 2026-11-15
A Reddit user champions LiquidAI's LFM2.5-24B-A2B (GGUF) as the rare model that balances speed and capability on commodity hardware. Key points: it's a task executor, not a coding model, ideal for handing low-to-mid complexity subtasks in agent setups like Hermes; it hits 37 tok/s at zero context on the author's AMD 780M iGPU, faster than any other model they've tried that actually completes tasks; and its A2B sparse architecture (24B total, 2B active) suggests it could also run on CPU. Recommended for GPU-poor users, with a caveat not to expect coding ability.
More from Models
- Gemini math lead reveals inside story: evals, post-training recipes, scaled runs — thtrieu_ · 2026-11-15
- Blogger saves $53 in 43 hours after switching from Claude Code to Gemini 4 Carbon — mazzaTalk · 2026-11-15
- SatBench: 63% of lab-cited AI benchmarks already saturated, and solving is speeding up — emollick · 2026-11-15
- Will Depue's Blackwell 'forensic evidence' claim on DeepSeek hits snag: V4.1-Flash not cracked — teortaxesTex · 2026-11-15
- nanoGPT Speedrun Gains Mostly From Environment Design; Newer Models Beat Human Record — eliebakouch · 2026-11-15
- Scott Reed: robotaxi is amazing, but pedestrian detection still needs work — scott_e_reed · 2026-11-15