X @Avi Chawla

LLM Serving Engine - LMCache is an open-source LLM serving engine designed to reduce time-to-first-token and increase throughput, especially under long-context scenarios [1] - LMCache boosts vLLM with 7x faster access to 100x more KV caches [1] Open Source - LMCache is 100% open-source [1]