Context rot
Search documents
MIT Researchers DESTROY the Context Window Limit
Matthew Berman· 2026-01-17 19:44
MIT basically solved unlimited context windows and you can apply this to any model. This is called recursive language models and it's just another example of how scaffolding building out infrastructure around the core intelligence of the model still has so much room to grow. Let me tell you about this paper because it is kind of incredible.We study allowing large language models to process arbitrarily long prompts through the lens of inference time scaling. And let me just show you the highle results and th ...