AI Engineer

Search documents
Foundry Local: Cutting-Edge AI experiences on device with ONNX Runtime/Olive — Emma Ning, Microsoft
AI Engineer· 2025-06-27 10:21
[Music] Hello everybody. Uh my name is Ima. I'm a program man uh product manager at Microsoft.It's a pleasure to talk to you today about Foundry local which enables developers to easily build up crossplatform applications powered by local AI. So let's get started. Uh the first question is if the cloud AI is so powerful why do we need local AI.So here are four key reasons based on our conversations and observations with our customers. So first of all, how does cloud AI work in environments with low network b ...
[Full Workshop] Vibe Coding at Scale: Customizing AI Assistants for Enterprise Environments
AI Engineer· 2025-06-27 10:19
"Vibe coding" often falters in complex enterprise environments. Drawing from real implementations, this talk demonstrates systematic approaches to customizing AI assistants for challenging codebases. We'll explore specialized techniques for navigating complex architectures, evidence-based strategies for undocumented legacy systems, methodologies for maintaining context across polyglot environments, and frameworks for standardizing AI usage while preserving developer autonomy. Through case studies from finan ...
Vibe Coding at Scale: Customizing AI Assistants for Enterprise Environments - Harald Kirshner,
AI Engineer· 2025-06-27 10:15
[Music] Uh going to dive right in. No introductions. Um if you want to follow along, get out your VS Code.Uh some of the things I'm showing are VS Code insiders. Who's an Insiders user. Anybody.Oh, I got to explain that. So, insiders is our pre-release that's built basically by whatever the bu the team landed the day before. It's going to release actually twice a day.Um, and it has all the latest things we're working on. VS Code otherwise released on a monthly basis. The next release is coming up next week ...
AI Red Teaming Agent: Azure AI Foundry — Nagkumar Arkalgud & Keiji Kanazawa, Microsoft
AI Engineer· 2025-06-27 10:07
In the age of autonomous AI agents, ensuring their safety and reliability is paramount. But how can we proactively uncover vulnerabilities before they impact real-world scenarios? Enter Azure AI Evaluation SDK’s Red Teaming Agent—a cutting-edge tool designed to rigorously challenge your AI agents, exposing hidden risks and unexpected behaviors. This session will guide you through the powerful capabilities of Azure’s Red Teaming Agent, demonstrating how it simulates adversarial scenarios, stress-tests agenti ...
Collaborating with Agents in your Software Dev Workflow - Jon Peck & Christopher Harrison, Microsoft
AI Engineer· 2025-06-27 10:05
GitHub Copilot's agentic capabilities enhance its ability to act as a peer programmer. From the IDE to the repository, Copilot can generate code, run tests, and perform tasks like creating pull requests using Model Context Protocol (MCP). This instructor-led lab will guide you through using agent capabilities on both the client and the server: Key takeaways include: Understanding how to bring agents into your software development workflow Identifying scenarios where agents can be most impactful, as well as ...
Agentic Excellence: Mastering AI Agent Evals w/ Azure AI Evaluation SDK — Cedric Vidal, Microsoft
AI Engineer· 2025-06-27 10:04
As AI agents transition from experimental assistants to critical components of enterprise workflows, reliably evaluating their performance becomes essential. But how do you systematically measure an AI agent’s capabilities, contextual understanding, and accuracy across diverse scenarios? In this talk, we'll dive deep into the Azure AI Evaluation SDK, an innovative tool designed to rigorously assess agentic applications. Learn how to create powerful evaluations using structured test plans, scenarios, and adv ...
How fast are LLM inference engines anyway? — Charles Frye, Modal
AI Engineer· 2025-06-27 10:01
[Music] Thanks everybody for coming. Um, yeah, I wanted to talk about some work I've done recently on trying to figure out uh just how fast these inference engines are when you run open models on them. Uh so the kind of been talking at AI engineer since it was AI engineer summit two years ago. Um and the for a long time it's basically been the like OpenAI rapper conference, right? It's like because just because yeah, what am I going to do? Am I going to run an agent with BERT? Probably not. Um, and that was ...
RAG in 2025: State of the Art and the Road Forward — Tengyu Ma, MongoDB (Voyage AI)
AI Engineer· 2025-06-27 09:59
[Music] Thanks for coming. Thanks for having me here. Um I'm Tongima. I'm um I was uh the CEO and co-founder for HAI.We just recently got acquired by MongoDB. I'm also teaching at Stanford as well. So um this is about rag which is the main focus of forage AI uh the startup who is focusing on how to make retrieval better.So um um but I will just generally talk about you know rag and and we'll touch on some of the products we make as well very quickly. So I guess why we are uh doing rag or anything like that ...
The State of AI Powered Search and Retrieval — Frank Liu, MongoDB (prev Voyage AI)
AI Engineer· 2025-06-27 09:57
[Music] Welcome everybody. Uh I want to thank you for coming to this session today. Um today I want to talk about AI powered search and retrieval.Uh and for those of you who don't know me, my name is Frank. Uh I am actually a part of the Voyage AI team and we recently joined MongoDB. I want to say probably about three to four months ago.Uh just a quick introduction to Voyage AI. You know, we build the most accurate, cost-effective embedding models and rerankers for rag and semantic search. Uh a lot of the a ...
Architecting Agent Memory: Principles, Patterns, and Best Practices — Richmond Alake, MongoDB
AI Engineer· 2025-06-27 09:56
[Music] [Music] In the next 10 to 15 minutes, here's uh I guess my promise to you. I'm going to give you some information that will be high level. There will be some practical component to it.But this information I'll give you within the next 6 months will be very relevant and it will put you in the best position to build the best AI applications to build the best agents that are believable, capable, and reliable. I know we we going to get there. You know what. Just for you.There we go. You're welcome. So, ...