Feeding the Future of AI | James Coomer

Who in the audience here have come across the term KV cache. Yeah, I know you have. Oh, sorry.What was those hands. Go and put them up again. There's like 5% maybe.Okay. We're going to talk about probably what is the most important thing you can do over the next five years to get more productivity out of GPU infrastructure. Does that sound good.Yes. So, first we're talking about inference and many of you probably know that the spend on inference this coming year is going to outpace the spend on training. An ...