New Analysis on MCP Tool Selection Bottlenecks
Inevitable_Fee1895 · reddit · 2026-07-13
This discussion focuses on why MCP tool selection degrades as the number of tools increases. The core conclusion is that retrieval-based pre-filtering only fixes part of the problem; the real bottleneck likely lies in the model's readout phase.
Key Points:
- Industry experience shows agent tool selection accuracy drops significantly when the tool count exceeds 20.
- A common fix uses RAG to retrieve a tool catalog shortlist for the model, which papers confirm significantly boosts accuracy and cuts prompt tokens.
- However, new research indicates that input-side fixes hit an early ceiling:
- In real BFCL failure cases, models mostly focus on the correct tool anyway.
- Input-side interventions like reordering or repeating tools fix only about 23% of failures.
- Readout-side interventions like attention bias or residual steering fix 59%–91% of failures.
- The author also introduces a label-free, gold tool-free selector using segmented attention as a confidence gate, improving function name accuracy on both BFCL and Seal-Tools.
The original post concludes that retrieval remains worthwhile for reducing costs and latency, but relying solely on retrieval and prompt optimization likely caps out here. The next step is exploring the readout layer, logit processors, constrained decoding, or external rescoring.
More from coding & agent
- General agents burn ~140M tokens/month on LinkedIn outreach; scripts do it 60x cheaper — ChrisHarpon2 · 2026-10-26
- NLI alone rejects 5/6 new agent memories; a 0.45 similarity gate fixes it all — Alternative_Pin9598 · 2026-10-26
- LangChain ships Managed Deep Agents 0.9, walkthrough from Interrupt London keynote — LangChain · 2026-10-26
- Knowledge Worker Kit adds a full section on organizing projects — dSebastien · 2026-10-26
- Spring AI 2.1.0-RC1 adds tool-call confirmation, pausing agent loops before real-data access — therealdanvega · 2026-10-26
- METR red-teams OpenAI's agent monitoring, finds bypasses and gaps — thione · 2026-10-26