How Braintrust Tackles the Hard Infrastructure Problems Behind Evals

There are a lot of really hard infrastructure problems that go into supporting EVELs in the first place. Some of the problems that we solve are things like um how to ingest megabytes per second of data that you know systems generate and guess what agents just generate more data. Another problem that we solve is um running evals that might take a really really long period of time um sometimes days and accumulating the data in a way that's easy to visualize. And again, um, being able to run and orchestrate so ...