Getting Started with LangSmith (5/6): Automations & Online Evaluation

Hi, today we're going to talk about automations and online evaluations in Langmith. Automations are powerful rules you can configure to run over every trace sent to your production application. Online evaluations are a type of automation that help you measure metrics on your application's output.Unlike offline evaluations which we covered in a previous video, online evaluations are run on live production user interactions, not on a curated data set. So let's see how to set up automations. We'll start by ret ...