sPTC: Speculative Tool Calling Overlaps Execution With Token Generation
CShorten30 · x · 2026-08-25
Alex Zhang introduces Speculative Programmatic Tool Calling (sPTC): a general technique that speculates on upcoming tool calls during code generation in a harness and queues them early, overlapping them with token generation and REPL execution time. The name is precise: like CPU speculative execution, work is done optimistically and only rarely discarded when necessary. He came up with the idea, built a version, and wrote the solo blog post all within 72 hours.
More from coding & agent
- How OpenAI's Codex went from failed side project to 40M weekly users in under a year — danshipper · 2026-10-16
- Photon 2.0 launches unified messaging API for AI agents across iMessage and more — Scobleizer · 2026-10-16
- Open Nshipyard cleans Canada's messy civic data, exposing $15.1B phantom spend, with MCP tools for agents — RichardsonDx · 2026-10-16
- Claude Opus 5.5 effort levels tested: low reasoning iterates 9x faster than max — tom_doerr · 2026-10-16
- Figma launches Guidelines and Code Sources so AI agents can follow your design system — JaynitMakwana · 2026-10-16
- Ex-DeepMind Eng Lead's AI Calling Agent Fo Cut Hang-Up Rate from 80% to 20-30% — julianweisser · 2026-10-16