RT Valuetainment (@valuetainment)JUST IN: OpenAI caught an AI agent secretly writing instructions for future versions of itself explaining how to bypass internal safety constraints. https://t.co/yp7rn3Vv5v ...

Nubank serves 135 million customers, so an AI agent that mishandles a support conversation fails at scale. The talk opens with the result: five agents in production, higher customer satisfaction, and roughly 20 times faster shipping. Shreya Rajpal, CEO of Snowglobe, argues the thing that unlocked that pace was evals, and specifically simulated data standing in for real conversations. Good agent evals are hard because the data is multi turn and stateful, not single turn question and answer, and hand curating ...