X @Avi Chawla

LLM Context Length Growth - The industry has witnessed a significant expansion in LLM context length over time [1] - GPT-3.5-turbo initially supported 4k tokens [1] - OpenAI GPT4 extended the limit to 8k tokens [1] - Claude 2 further increased the context length to 100k tokens [1] - Llama 3 achieved a context length of 128k tokens [1] - Gemini reached an impressive 1M tokens [1]