Workflow
Inference Costs
icon
Search documents
Everything's gonna get more expensive...
Everything's going to get more expensive because as soon as we figure out how to do this stuff, we're going to burn even more tokens. We will actually burn an infinite amount of tokens if we can. It even happened to anthropic, right. It happened to everybody.And a lot of folks, especially folks that aren't quite growing it at the open evidence levels today, are thinking, "God, what am I going to do with these inference costs?" And I got to tell you, the idea that you can use cheap models and cut back on you ...