inferock-bench: a local proxy that keeps independent per-call receipts for AI API bills
aftahi_ai · x · 2026-08-19
A developer points out the fundamental asymmetry of AI API billing: when your bill looks wrong you can't prove it, because the provider decides what counts as a failure, what gets credited, and keeps the only detailed records — you get a monthly total and a shrug. inferock-bench is the missing receipt: a local proxy sitting between your app and OpenAI/Anthropic/Gemini/OpenRouter. You change two settings (API key and base URL) and point your existing SDK at it — no code rewrite. Every call is then logged as an independent per-call record on your own machine, with keys never leaving your box. It catches what hides inside a monthly total, like responses that died mid-stream yet were still billed.
More from coding & agent
- DeepSeek paper on spatiotemporal composability for self-evolving agents — kevinlu310 · 2026-08-19
- Weaviate Query Agent now explores your data's stats and filter values before searching — CShorten30 · 2026-08-19
- Artificial Analysis Launches Search API Index: Parallel, Exa Lead — ArtificialAnlys · 2026-08-19
- ICML Paper: Measuring LLM conceptual consistency to reduce contradictions in agents — soumitrashukla9 · 2026-08-19
- DataSmith auto agent outperforms model architecture tweaks using 200x fewer tokens via data interventions — josh_wills · 2026-08-19
- AI agent platforms fail due to poor infrastructure, not prompts; OpenClaw blueprint reveals production architecture — aftahi_ai · 2026-08-19