FinOps for AI Agents: Who Spent All the Tokens? — Tisha Chawla & Susheem Koul, Microsoft

Market Trends and Challenges - Industry shifts focus from token maxing (spending maximum tokens for exploration) to value maxing [2] - Unbounded AI consumption leads to runaway loops and massive cost increases, such as Uber's AI budget exhausting within 4 months [4] - Existing infrastructure tools operate only at the request layer or model layer rather than the agent run layer [12] Cost Governance and Platform Architecture - Token Ops provides a runaway token governance platform featuring an out-of-band architecture with instrumentation, accounting, and enforcement layers [13][14] - The bridge layer utilizes boundary annotations to track inputs and outputs without modifying core agent code [18][29] - The governor node applies non-destructive actions pushed from the control plane to manage agent execution paths [23][24] Performance and Benchmark Results - Token Ops reduces average spending by 78% across stress tests and benchmarks on open-source repositories like browser use and MetaGPT [39] - Completion rates increase from 67% to 96% when comparing steering mechanisms against traditional hard throttling [40]