Sharing recent progress from Physical Intelligence and why it is an exciting time to push the frontier in general purpose robotics About Quan Vuong Quan Vuong is co-founder at Physical Intelligence. His research focuses on generalist robotics and algorithms that enable intelligent behaviors through large scale learning. About Jost Tobias Springenberg Tobias is currently a research scientist at Physical Intelligence where he works on bringing AI into the real world and understanding the fundamentals of seque ...

Autonomous Driving History and Challenges - Autonomous driving research started in the 1980s with simple neural networks and evolved to end-to-end driving models by 2020 [2] - Scaling autonomous driving presents challenges, requiring solutions for long-tail events and rare scenarios [5][7] - Foundation models, like Gemini, show promise in generalizing to rare driving events and providing appropriate responses [8][9][10][11] Emma: A Multimodal Large Language Model for Autonomous Driving - The company is exploring Emma, a driving system leveraging Gemini, which uses routing text and camera input to predict future waypoints [11][12][13][14] - Emma is self-supervised, camera-only, and high-dimension map-free, achieving state-of-the-art quality on the nuScenes benchmark [15][16][17] - Channel reasoning is incorporated into Emma, allowing the model to explain its driving decisions and improve performance on a 100k dataset [17] Evaluation and Validation - Evaluation is crucial for the success of autonomous driving models, including open loop evaluation, simulations, and real-world testing [25] - Generative models are being explored for sensor simulation to evaluate the planner under various conditions like rain and different times of day [26][27][28] Future Directions - The company aims to improve generalization and scale autonomous driving by leveraging foundation models [30] - Training on larger datasets improves the quality of the planner [19][20] - The company is exploring training on various tasks, such as 3D detection and rograph estimation, to create a more generalizable model [21][22][23][24]

[Music] Hi everybody, my name is Eno. I really appreciate that introduction. Um, and maybe I can start with a bit of background.Uh, I started working on LLMs about two and a half years ago. uh when uh GBT3.5% was coming out and it became increasingly clear that agentic systems were going to be possible with the help of LLMs. . At factory we believe that the way that we use agents in particular to build software is going to radically change the field of software development. We're transitioning from the era ...

[Music] It's great to be here. So, I'm Josh Albertch. I'm the CTO of Imbue.Uh, and our focus is on making more robust, useful AI agents. In particular, we're focusing on software agents right now. And the main product that we're working on today is called Sculptor. So, the purpose of Sculptor is to kind of help us with something that we've all experienced.You know, we've all tried these vibe coding tools and you, you know, tell it to go off and do something. It goes off and creates a bunch of code for you. ...

[Music] Hi everyone. I'm Rustin. I'm a product manager with Google Labs and really thrilled to be here and get to speak to you today. This is really like a a dream come true. So I'm an engineer at heart. This is my first compiler, Borland C++ 3.1%. It came in the mail on 10 5 and a half inch floppy discs. I ordered it from AOL classifides. It was amazing. This is my bulletin board. Yeah. That I hosted out of my parents' closet and salvage computers. And I just think it's ironic that when I saw AI come out, ...

In this talk I'll introduce the concept of Human-seeded Evals, explain the principle and demo them with Pydantic Logfire. ---related links--- https://x.com/samuel_colvin https://www.linkedin.com/in/samuel-colvin/ https://github.com/samuelcolvin https://pydantic.dev/ ...

[Music] Uh my name is Ben Hilac and uh also just feeling really grateful to be with all of you guys today. Uh it's pretty exciting and we're here to talk about building AI products that actually work. Um I'll introduce this guy in a second.Sorry, it wasn't the right word. Uh, so I tweeted last night. I was kind of like, what should we uh what should we talk about today.Uh, and the overwhelming response I got was like, please no more evals. Uh, apparently there's a lot of eval tracks. We'll touch on eval sti ...

As the amount of consumer facing AI products grows, the most forward leaning enterprises have created a new role: the AI Architect. These leaders are responsible for helping define, manage, and evolve their company's AI agent experiences over time. In this session, Clay Bavor (Cofounder of Sierra) will join Alessio Fanelli (co-host of Latent Space) in a fireside chat to share what it means to be an AI Architect, success stories from the market, and the future of the role. ---related links--- https://x.com/f ...

[Music] So great to be here today. U excited to talk to you about a little bit of the healthare system that often gets overlooked. It's part of the healthare system.A system that actually continues to grow in multiple dimensions. Over the past couple of decades, its size, cost, and complexity outpace many other benchmarks. That's because right now 40% of hospitals operate at a negative margin.Let me put it another way. Almost half the hospitals in the country are losing money. It's uh and it's not because o ...

All [Music] right, thanks everybody for joining today. My name is Dennis Linkov. I lead the machine learning team at Wisdocs and I'll be talking about hiring a modern AI team. So, who's heard this message before? We are now an AI first company. We've seen companies like Shopify, Dolingo, Zapier all make these announcements saying that they're AI first companies and they're saying that there are new expectations that before you hire a person, you need to make the the claim that you can't hire an AI agent or ...