How a Solo Dev Stopped Local 7B Models from Hallucinating Bank Balances: Code Calculates, Model Summarizes
Revibed69 · reddit · 2026-10-06
Building Burrow, a private local-first budgeting app running Llama 3.2/Qwen 2.5 via Ollama, a developer hit the classic problem: small models confidently produce wrong arithmetic. His fix is one hard rule—code calculates, the model summarizes. All numbers are precomputed in SQL/JS so the model only sees aggregates; prompts explicitly forbid calculation; and a CI script fails the build if any system prompt contains words like 'calculate' or 'average of'. The result is trustworthy, fast responses even on GPU-less laptops.
More from coding & agent
- What a Jumping Spider With 600,000 Neurons Teaches Us About AI Agent Orchestration — uxmag · 2026-10-06
- AI Estimates 5-8 Weeks of Engineering; Developer Has Sub-Agents Finish It in Two Days — Dan_Jeffries1 · 2026-10-06
- AI formal verification hits reality: the halting problem blocks existing codebases — danbri · 2026-10-06
- Developer Builds SEO/AEO Feedback Loop with Grok Bot and Claude Code — doooyle · 2026-10-06
- Next experiment: running most daily todos entirely through voice-driven Grok Bot — FinanceYF5 · 2026-10-06
- Voice-controlled Grok Bot handles Notion, Slack, email and even payments — FinanceYF5 · 2026-10-06