Laguna-S-2.1 Local Test: Fastest 100B+ Model but Fails Grounding Under Pressure
klinec · reddit · 2026-07-22
A developer put the newly released Laguna-S-2.1 through a deep private agentic eval on a single RTX Pro 6000 (96GB), comparing it against Qwen3.5-122B and others.
Strengths:
- Top-tier tool calling & speed: Best tool-arg selection (0.89 pass rate) and handles tool chains up to 6 levels deep (Qwen manages 4).
- Fastest 100B+: Hits 109 tok/s at 256k ctx, the fastest 100B+ model tested on this card.
- Rock-solid formatting: Zero JSON/streaming errors; recovers from validation errors on the first retry.
Critical Flaws:
- Hallucinations under pressure: Disqualifying grounding behavior with 3 hand-confirmed hard fabrications (invented P&L and named nonexistent horses), whereas Qwen had zero inventions across 240 runs.
- Lacks breadth: Sports knowledge and odds math score significantly lower than Qwen (0.80 vs 1.00).
Deployment Gotchas:
- Requires maxtokens 8k+; otherwise, it burns the entire budget thinking and returns empty.
- dflash speculative decoding boosts single-stream speed massively (up to 271 tok/s) but causes a net loss under concurrent streams and lacks bitwise stability at temp 0.
Verdict: An excellent agentic coding specialist with superb mechanics, but its tendency to confidently invent facts when data runs out makes it unsuitable for fully autonomous general use.
More from coding & agent
- NVIDIA says Nemotron 3 Ultra hit 97.1% on agentic RTL chip-design tasks — NVIDIAAI · 2026-07-27
- Tokyo Agent Forge hackathon shipped production-ready AI agents in one day — DavidBennett__ · 2026-07-27
- Long-running agents will need immutable event logs, this thread argues — sebpaquet · 2026-07-27
- Agentic Data Science in Practice: Agents Write Code but Answer Wrong Questions — hugobowne · 2026-07-27
- A VS Code extension adds Markdown-style highlighting to Alchemy string templates — samgoodwin89 · 2026-07-27
- Claude’s Stripe MCP connector is being called unusable after repeated disconnects — evielync · 2026-07-27