Preferences Over Benchmarks: Model Routing — Archana Kamath & Tyler Gillam, DigitalOcean

[music] Hello everyone. So preferences over benchmarks. The talk today is about model routing and specifically why the way most people think about picking a model which usually is chasing you know to the top of a benchmark is actually the wrong instinct.I'm Archa VP of engineering for inference engine and AI infrastructure at Digital Ocean and I'll be joined by Tyler who built parts of the router and will actually do a live demo for us today. We both work on the managed agent orchestration and inference eng ...