Environment code
Search documents
Context windows are over
Matthew Berman· 2026-01-21 17:04
MIT basically solved unlimited context windows. And when I tell you the technique, it's going to be so obvious and you're going to ask yourself, okay, how did we not think of this before. They're creating an environment code.And they're putting a giant prompt bigger than what is allowed in the physical context limit of the model into a file, like a text file, and then they give the model tools to go search through that prompt. When the model finds a piece of the context that it thinks is relevant, it can ac ...