Local LLM works fine in chat but falls apart as an agent: state tracking and error handling matter as much as the model

Fun_Vast_1469 · reddit · 2026-11-19

A user running local models on an acemagic f5a mini PC reports that the model handles chat and document summaries fine, but fails at real agent tasks like sorting folders, extracting info from documents, and making API calls: after one failed API call, the agent continues with incomplete data, sometimes claiming the job is done while half the files remain untouched.

The takeaway: the bottleneck isn't just model intelligence — tool setup, state tracking, and error handling matter just as much. If the agent doesn't know a step failed, even a good model produces garbage.

Original post →

More from coding & agent

coding & agent channel →