Building Next-Gen AI Infrastructure: Scaling Enterprise LLM Serving with RadixArk

Thank you, everyone, for joining this session. I'm very excited to talk about the SGLN Miles, two open source frameworks that we have spent time building on this that aim to help you build frontier AI infrastructure. Let's start with, I mean, what is SGLN.Some of you might already heard of and maybe are using it. It's an open source framework for inference and has been widely adopted in production. People use it to serve open source models in many companies across all the categories.It aims for a target for ...