48M param model achieves tool calling via grammar-constrained design
Turbulent-Sky5396 · reddit · 2026-08-25
Researchers achieved tool calling in a 48M parameter model by designing the tokenizer, loss, and decoder around five specific decisions.
Mechanism & Results:
- The model only handles tool calls; JSON syntax (braces, quotes, keys) is enforced by the grammar, not generated by the model.
- Reliability: Guarantees parseable JSON and prevents undeclared tool calls, eliminating worst-case failures.
- Accuracy: 86.3% on mobile actions and 52.5% on droidcall (in-domain). Unseen catalogs drop to 28 due to function selection errors.
Details:
- Includes a $56 synthetic data script for adapting to custom catalogs.
- Weaknesses: Optional arguments, parallel instances, Java/JS dialects, and 768-token context limit.
- The repo also documents 11 negative results, valuable for similar research.
Related event: 48M-Parameter Model Handles Agent Tool Calls(2 posts)→
More from coding & agent
- Supabase MCP server now supports enterprise-managed auth via Okta — dshukertjr · 2026-08-25
- My AI Development Workflow: From Requirement to Implementation — dotey · 2026-08-25
- Freshworks CPO demos the 12-step AI-driven Product Builder workflow — aakashgupta · 2026-08-25
- Disabling Qwen 3.8 27B's chain of thought improves coding efficiency — N34257 · 2026-08-25
- Seeking non-coding agent harness for document analysis workflows — cuoreesitante · 2026-08-25
- Warp shares config format for managing cloud agents, environments, and security as code — vikvang1 · 2026-08-25