[Music] [Applause] [Music] Show of hands. How many of you understand and can speak some amount of English. I see all hands going up.I I there was a point in time when I would not have quite raised my hand. I remember as a kid uh I mean uh uh was privileged enough but went to this school called Sardar Patel Vidyal uh in New Delhi which made us very consciously it had Hindi medium in the early stages and I remember it used to be hard for me to strike a conversation in English and in fact uh if I was going to ...

Autonomous Driving History and Challenges - Autonomous driving research started in the 1980s with simple neural networks and evolved to end-to-end driving models by 2020 [2] - Scaling autonomous driving presents challenges, requiring solutions for long-tail events and rare scenarios [5][7] - Foundation models, like Gemini, show promise in generalizing to rare driving events and providing appropriate responses [8][9][10][11] Emma: A Multimodal Large Language Model for Autonomous Driving - The company is exploring Emma, a driving system leveraging Gemini, which uses routing text and camera input to predict future waypoints [11][12][13][14] - Emma is self-supervised, camera-only, and high-dimension map-free, achieving state-of-the-art quality on the nuScenes benchmark [15][16][17] - Channel reasoning is incorporated into Emma, allowing the model to explain its driving decisions and improve performance on a 100k dataset [17] Evaluation and Validation - Evaluation is crucial for the success of autonomous driving models, including open loop evaluation, simulations, and real-world testing [25] - Generative models are being explored for sensor simulation to evaluate the planner under various conditions like rain and different times of day [26][27][28] Future Directions - The company aims to improve generalization and scale autonomous driving by leveraging foundation models [30] - Training on larger datasets improves the quality of the planner [19][20] - The company is exploring training on various tasks, such as 3D detection and rograph estimation, to create a more generalizable model [21][22][23][24]

[Music] It's a pleasure to be with you today. My name is Michael Alba and I'm a principal applied scientist at Microsoft and today I'm going to be presenting on building applications with AI agents. So just as a brief bio, I've been at Microsoft for about two years.So why I've been one of the key contributors to security copilot and the recently announced security copilot agents specifically working in the cyber security division. Before that I spent four years working on machine learning at Uber lots of bi ...

Robotics hasn't had its Jad GPT moment yet, but we think it is almost here. Everyone has known that robots are the future, but that proved elusive because previous generations of robots were expensive, brittle, and only worked in control conditions. With the rapid improvements in foundation models, it is finally possible to make robots that have human level perception and judgment.That has been the missing piece. While consumer use case feature heavily in science fiction, some of the overlooked and most imm ...