[Music] Um, yeah. So, my name is Mike Chambers. I'm going to pick you up a little bit there. So, I'm from Queensland in the eastern part of Australia, but that's okay. Um, yeah, very happy to be here. So, I'm a developer advocate for Amazon Web Services. Um, and I completely and utterly and only and totally spe specialize in generative AI. Used to be machine learning. Now it's generative AI. Um, I'll be talking about why this slide is up here in a moment. Any tabletop RPG players in the room? There's got to ...

[Music] Um well hello everyone um thanks for coming to the session here today. My name is Jonathan Larson and uh I run the graph uh team at Microsoft Research. Um, some of you may have seen our paper that we actually released last year uh the graphite paper or you might have seen our GitHub repo uh that was out there and uh has a lot of stars on it. Um when we released this last year to our surprise it got a lot of attention and also it inspired many other offerings that we saw that were out there as well t ...

[Music] I'm going to go over today graph rag particularly dealing with multiple data sources. Uh so both unstructured and structured data sources and kind of why you would want to ever do that in the first place even. So I prepared uh some notebooks here.I was going to make slides, but then I thought it would just be easier to walk through some of what this looks like in practice. Um, so there's a link here, and I can share it with you at the booth later, um, if you have follow-up questions. But basically, ...

If you found it insightful, reshare it with your network.Find me → @_avichawlaEvery day, I share tutorials and insights on DS, ML, LLMs, and RAGs.Avi Chawla (@_avichawla):How Agents test Agents, clearly explained (with code): ...

To recap:Traditional testing relies on fixed inputs and exact outputs. But agents speak in language, and there’s no single “correct” response.That’s why we test Agents with Agents by simulating Users and Judges.Here's the process again for your reference👇 https://t.co/BFuBQxVPwF ...

How Agents test Agents, clearly explained (with code): ...

[Music] right. Hello everyone. Who's excited to chat about MCP today.Okay, we can we can work on that. We can get it a little bit better by the end of this talk. Uh but I'm Theo.I am a product manager at Anthropic work on MCP. Uh prior to this was also a startup founder uh working in the AI space. Um couple fun facts about me because everyone says make yourself a little bit more personable.Uh is that I like playing poker mostly losing money at poker, not uh making money at poker. Uh and I also really like c ...

LangChain Agent Evaluation - LangChain 降低了 Agent 评估的门槛，使得非开发者也能轻松进行 [1] - Langraph Studio 新增了快速评估 Langraph Agent 的功能 [3] - 用户可以在 Langraph Studio 中选择数据集并启动评估实验 [3][4] - 评估结果可在 Langsmith 中查看，包括模型输出和评估分数 [5] Evaluation Importance and Accessibility - 评估对于构建有效的 Agent 至关重要 [7] - 传统评估对开发者有较高要求，需要掌握 SDK、Piest 和 Evaluate API 等 [7] - LangChain 旨在提供一种无需代码的方式，让任何人都能评估 Langraph Agent [8] - 非技术用户可以基于直觉评估模型选择和提示词等 [9] Configuration and Customization - 用户可以在 Studio 界面中轻松切换 graph 配置，并以此为基础启动评估 [9] - 开发者可以预先设置包含输入主题和参考输出的数据集 [10] - 可以将评估器（Evaluator）绑定到数据集，并自定义评估标准和评分规则 [11][12][13] - 用户可以在 Studio 中修改 graph 配置（如模型、提示词），并启动新的评估实验 [15][16][17] - Studio 提供了无代码配置方式，方便快速迭代 [18]

Alpha Evolve AI that can discover new knowledge. It really feels like we're at this inflection point of the intelligence explosion. Are we at that inflection point given it seems like this is self-improving artificial intelligence.You're spot on to the potential for something like Alpha Evolve. It's amazing. We launch in this lowkey way.Yeah, it's one of the most groundbreaking work we are doing. The fact that you know you can have these agents which can go improve code, make discoveries. What an extraordin ...

My name is Sarmad and today I want to talk about building effective agents with model context protocol or MCP. So a lot has changed in the last year. Um especially as far as agent development is concerned.I think 2025 is the year of agents and uh things like MCP make agent design simpler and more robust than ever before. So I want to talk about what the agent tech stack looks like in 2025. The second thing is a lot of uh MCP servers today are just you know onetoone mappings of existing REST API uh uh servic ...