BotPsy-0.8B: on-device agent model beats 2.5x larger Qwen3.5-2B on tool-use benchmarks
pmttyji · reddit · 2026-11-12
qvac (Tether) released BotPsy-0.8B on Hugging Face, a function-calling/agentic model fine-tuned from Qwen3.5-0.8B for on-device personal assistance spanning search, travel, commerce, device control, files, calendar, and messaging.
- Doubles its base: BFCL v4 23.4→44.0, ACEBench 30.1→58.7, τ-bench 23.2→51.5 vs Qwen3.5-0.8B-Think.
- Best in its weight class: leads all ≤1.2B models tested on all six agentic benchmarks, and beats 2.5x-larger Qwen3.5-2B-Think on five of six (e.g. ToolSandbox 64.6 vs 41.2, BrowseComp-Plus 4.5 vs 2.8).
- More reliable multi-turn: τ²-bench telecom 82.5 vs 69.3; BFCL v4 multi-turn 7.5→46.1.
- Knows when not to act: tops BFCL v4 hallucination tests at 86.1; ACEBench special cases 13.7→51.3.
- Keeps general skills: IFEval 59.7→90.8, IFBench 22.0→55.9 (best tested); GPQA Diamond and MMLU-Pro also improve.
GGUF quants, a blog post, and a project page are available.
Related event: Tether Releases BotPsy, a 0.8B On-Device Agent Model(2 posts)→
More from coding & agent
- NVIDIA exec: blind AI use wreck codebases, but one-shot coding from scratch is the exception — JFPuget · 2026-11-12
- Engineers Using LLMs Should Understand Tokens, Context Windows and Hallucinations — _jaydeepkarale · 2026-11-12
- Building a Remote MCP Server for Real SaaS: OAuth 2.1, 70 Task-Shaped Tools — djskrilled · 2026-11-12
- Dev shows e-ink desk display tracking 20 Codex agent threads in real time — Dimillian · 2026-11-12
- Building a verifiable local-AI software factory on a single GPU: the judge can't be the defendant — d3nnyvg3org3 · 2026-11-12
- GraphRAG for CTOs: three retrieval patterns and a four-week test to decide — JeremyCMorgan · 2026-11-12