Model Optimization
Search documents
Playground in Prod - Optimising Agents in Production Environments — Samuel Colvin, Pydantic
AI Engineer· 2026-05-07 17:00
Deploying an agent is only the start. In this workshop, Samuel Colvin shows how to improve agents after they are already live, using Pydantic AI and Logfire to change prompts, models, and other parameters in production without redeploying or restarting services. The session covers managed variables for live prompt and model updates, how to run evals and compare prompt variants against real datasets, and how GEPA can be used to evolve better prompts from production traces and feedback signals. If you're buil ...