How to Attribute LLM Inference Costs by Team
Extreme_Tangelo8336 · reddit · 2026-07-18
The author notes that as LLMs scale from isolated features to internal tools, agents, customer service workflows, and evaluations, inference cost attribution becomes tricky:
- Vendor consoles typically show only token usage, while finance needs to know exactly which team or project incurred the cost.
- Infra teams see raw usage, and finance sees a single total bill, but middle-tier attribution capabilities remain immature.
- The author suggests combining application-layer tagging with internal reporting, asking the community how they currently manage this formally versus treating it as shared infrastructure overhead.
More from Infra
- Alchemy adds effect/Workflow support across Durable Objects, Workflows and Lambda Durable Functions — samgoodwin89 · 2026-10-27
- Alchemy's Lambda Web Functions run plain Node web servers on Lambda, no OpenNext needed — samgoodwin89 · 2026-10-27
- Foldkit Adds SSR Support With a Few Lines of Config on Cloudflare and AWS — samgoodwin89 · 2026-10-27
- Alchemy Cuts Cloudflare Bindings CPU Time by Up to 166× Via Profiling — samgoodwin89 · 2026-10-27
- Importing all 438 AWS services now takes 13.9 MB and 0.14s, down from 227 MB and 1.61s — samgoodwin89 · 2026-10-27
- Alchemy makes all ~2,850 AWS bindings work from any cloud, not just S3/Lambda/DynamoDB — samgoodwin89 · 2026-10-27