Worst inference provider breaks 19x more tool calls: dottxt launches provider quality index
remilouf · x · 2026-11-20
dottxt's new Tool-call Index shows the inference provider matters as much as the model: on the same model, the worst provider breaks up to 19x more tool calls than the best (e.g. gpt-oss-120b ranges from 0.01% to 71.96% broken calls; GLM 5.3 from 0.01% to 17.81%). The index covers 64 models, 66 providers and 15 model labs, with weekly reports.
remilouf also shipped an agent skill that lets your agent pick the provider itself:
npx skills add https://providers.dottxt.ai --skill choose-provider
Related event: dottxt Tool-call Index: Worst Providers Show 19x More Broken Tool Calls(3 posts)→
More from coding & agent
- Redditor argues AI agents need decision expiration dates, not just bigger context windows — Elvantime · 2026-11-22
- ianand's 20-min AI Engineer World's Fair talk covers a paper and how it can go wrong — js_craft_hq · 2026-11-22
- Agent pipeline silently skipped a midnight run due to a UTC vs local time mismatch — fantomkoenig · 2026-11-22
- llms.txt Protocol Goes Mainstream as Google Antigravity Adopts It Two Years On — jeremyphoward · 2026-11-22
- He built a feed only agents can read: no UI, semantic matching, agent-rated posts — imdogefather · 2026-11-22
- DeepMind paper: without direct image viewing, Gemini's defect-spotting falls from 86.7% to 14.3% — nukebuddy · 2026-11-22