RAG systems
Search documents
X @Avi Chawla
Avi Chawla· 2026-02-10 01:13
RT Avi Chawla (@_avichawla)Vector search is not always the answer.A 30-year-old algorithm with zero training, zero embeddings, and zero fine-tuning still powers Elasticsearch, OpenSearch, and most production search systems today.It's called BM25, and it's worth understanding why it refuses to die.Let's say you're searching for "transformer attention mechanism" in a library of ML papers.BM25 scores documents using three core ideas:1) Word rarity matters more than word frequencyEvery paper contains "the" and ...
X @Avi Chawla
Avi Chawla· 2025-08-20 19:16
RT Avi Chawla (@_avichawla)DeepMind built a simple RAG technique that:- reduces hallucinations by 40%- improves answer relevancy by 50%Let's understand how to use it in RAG systems (with code): ...
X @Avi Chawla
Avi Chawla· 2025-08-20 06:31
RAG技术提升 - DeepMind 开发了一种简单的 RAG 技术,将幻觉减少 40% [1] - 该技术将答案相关性提高了 50% [1] RAG系统应用 - 行业正在探索如何在 RAG 系统中使用该技术(附带代码)[1]
X @Avi Chawla
Avi Chawla· 2025-08-04 06:33
A simple technique makes RAG ~32x memory efficient!- Perplexity uses it in its search index- Azure uses it in its search pipeline- HubSpot uses it in its AI assistantLet's understand how to use it in RAG systems (with code): ...