X @Avi Chawla

I built a RAG system that queries 36M+ vectors in <0.03 seconds.The technique used makes RAG 32x memory efficient!Check the detailed breakdown with code below: https://t.co/5AYmUa2hJUAvi Chawla (@_avichawla):A simple technique makes RAG ~32x memory efficient!- Perplexity uses it in its search index- Azure uses it in its search pipeline- HubSpot uses it in its AI assistantLet's understand how to use it in RAG systems (with code): ...