LFM2.5-24B-A2B Tested and Found Lacking: Looping Outputs, Broken Code, Full Configs Posted
tracagnotto · reddit · 2026-10-22
A r/LocalLLaMA user ran a second, fully documented test of the hyped LFM2.5-24B-A2B and still found it failing. On an Ampere-optimized llama.cpp build it looped endlessly and stumbled on trivial tasks despite hitting 130 tk/s on an RTX A4500; LM Studio stabilized it somewhat for basic chat. Following the model's agentic-training claims, the author linked it to Hermes Desktop and asked it to write a simple plugin for Microsoft Garnet (a Redis clone). ChatGPT's evaluation: "broken code, omitted required functionality, and claimed verification without end-to-end tests." Applying the community Sharp chat template fix (jinja link provided) changed little. Full configs included; suggestions requested.
More from Models
- Carbon-X: Open 14B DNA Language Model Beats Open Rivals, Runs Locally via llama.cpp — loubnabnl · 2026-10-22
- Bayesian take: LLM benchmark noise means all models are probably tied — remilouf · 2026-10-22
- OpenAI's New Pricing Slammed for Zero Transparency as $500 Tier Reveals No Usage Numbers — Effective_Tap_9786 · 2026-10-22
- OpenAI's pricing pages never state actual usage limits, power users cry foul — Monstermage · 2026-10-22
- Nemotron 3.5 Super VL: NVFP4 on one Blackwell GPU beats BF16 on two, ~2.2x per-GPU throughput — TheZachMueller · 2026-10-22
- Decision Index 0.4: 224 models scored on private benchmarks only to curb benchmaxxing — multimodalart · 2026-10-22