llama.cpp merges token-aware parsing PR for more reliable tool calling and higher t/s
jacek2023 · reddit · 2026-11-23
llama.cpp merged PR #29307 'chat: implement token aware parsing' by aldehir — 62 commits, +1988/-502 lines, 21 comments and 5 reviews. The change makes chat-side parsing token-boundary aware, aiming for more reliable tool calling and higher tokens/second. A substantive improvement for anyone running local LLMs with function calling / agent workflows.
More from coding & agent
- Microsoft Foundry Toolkit for VS Code unifies AI app and agent development — adnan_hashmi · 2026-11-23
- Jeremy Howard: coding agents invent absurd workarounds instead of asking permission — jeremyphoward · 2026-11-23
- 5 AI-built games people kept playing instead of GTA VI — thisiskp_ · 2026-11-23
- Photographer ships an iOS portfolio app built from sketches with ChatGPT and Codex — justmojr · 2026-11-23
- Dev: Gemini 4 Neon rewrote my training kernels and supervised runs; rumors point to bigger models — xennygrimmato_ · 2026-11-23
- Researcher argues file systems are the wrong abstraction for LLM context layers — sh_reya · 2026-11-23