X @Avi Chawla
Avi Chawla·2025-08-23 06:30
The growth of LLM context length with time:- GPT-3.5-turbo → 4k tokens- OpenAI GPT4 → 8k tokens- Claude 2 → 100k tokens- Llama 3 → 128k tokens- Gemini → 1M tokensLet's understand how they extend the context length of LLMs: ...