Workflow
Token Costs
icon
Search documents
X @Avi Chawla
Avi Chawlaยท 2025-08-14 06:33
In RAG:- No chunking drives up token costs- Large chunks lose fine-grained context- Small chunks lose global/neighbourhood contextIn fact, chunking also involves determining chunk overlap, generating summaries, etc., which are tedious.There's another problem! https://t.co/MxXaSqHOK1 ...