Greg Brockman's career and advice for AI Engineers Recorded at the AI Engineer World's Fair in San Francisco. Stay up to date on our upcoming events and content by joining our newsletter here: https://www.ai.engineer/newsletter ...

[Music] [Applause] Awesome. Uh so today we're going to talk a little bit about evals to date and where we think eval are going to be going in the future. Also for those of you who saw my brother earlier um I'm going to do my best to live up to his energy and uh and charisma.But um yeah, you know, it's been an amazing almost two-year journey for us at Brain Trust. We have had the opportunity to work with some of the most amazing companies building um I think the best AI products in the world. Uh I'm blown aw ...

All [Music] right, welcome everybody. Um, I'm Jeff Huber, the co-founder and CEO of Chroma, and I'm joined by Jason. We're going to do a two-parter here. We're really going to pack in the content.It's the last session of the day, and so we thought I'd give you a lot. Um everything in this presentation today is open source and code available. So we're also not selling you any tools.Um and so there'll be QR codes and stuff throughout to grab the code. So let's talk about how to look at your data. Um all of yo ...

[Music] My name is Ido. I'm an engineer at Verscell working on Vzero. If you don't know, Vzero is a full stack Vibe coding platform.It's the easiest and fastest way to prototype, build on the web, and express new ideas. Uh, here are some examples of cool things people have built and shared on Twitter. And to catch you up, we recently just launched GitHub sync, so you can now push generated code to GitHub directly from VZO.You can also uh automatically pull changes from GitHub into your chat, and furthermore ...

[Music] I'm going to be giving a quick presentation about the state of the union regarding AI vision. Um, so I'm Peter Robisho. I'm the ML lead at Rooflow, which is a platform for building and deploying vision models.Um, so a lot of people are really interested in LLMs these days. So I'm trying to pitch why computer vision matters. Uh so if you think about systems that interact with the real world, they have to use vision as one of their primary inputs because the the built world is sort of built around vis ...

[Music] Welcome everyone. I'm going to talk about practical tactics to build uh reliable AI applications and why nobody does it this way yet. Uh a little bit about myself or why you should trust me.Uh I have allowed 15 years as a startup co-founder and CTO. Uh I held executive positions for the last five years at uh several enterprises. uh but most importantly I spent last couple of years developing a lot of gen projects ranging from PC's to uh many production level uh solutions and helped some companies to ...

[Music] My name is Ian. Um I'm the CEO of Bismouth. Uh we're an endto-end agentic coding solution kind of like Codeex.Um we've been working on evals for how good agents are at finding and fixing bugs for the last several months. uh and we dropped a benchmark yesterday uh discussing our results. Um so one thing to point out about agents currently is that they have a pretty low overall find rate for bugs.They actually generate a significant amount of false positives. Um you can see something like Devon and Cu ...

[Music] Thanks for coming, by the way, and uh for sticking around for a little while. Um, if you aren't prepared, I hate to break it to you, but this time next year, half of us won't even be here anymore. That's basically if you listen to whatever the hype is about AI and AI coding.You know, there's lots of fanfare, no disrespect, very intelligent people um that made these quotes. Um but I think they're probably wrong. Not because I don't think AI coding is going somewhere important, but probably because th ...

Let's explore practical strategies for building and scaling agents in production. Discover how to move from local MCP implementations to cloud-scale architectures and how engineering teams leverage these patterns to develop sophisticated agent systems. Expect a mix of demos, use case discussions, and a glimpse into the future of agentic services! About Antje Barth Antje Barth is a Principal Developer Advocate at AWS, based in San Francisco. She frequently speaks at AI engineering conferences, events, and me ...

Recorded at the AI Engineer World's Fair in San Francisco. Stay up to date on our upcoming events and content by joining our newsletter here: https://www.ai.engineer/newsletter ...