X @Avi Chawla

Karpathy warned about this months ago:"If agents had less knowledge or less memory, maybe they would be better."His point was that everything already inside the model's input competes with the task for attention.A standard ReAct loop is built that way, since everything that goes into the prompt is never removed from it.For more context, the ReAct pattern runs one model in a single loop.The model generates a thought about what to do next, takes one action, reads the observation that comes back, appends all t ...