Coding Evals: From Code Snippets to Codebases – Naman Jain, Cursor

[music] Hi everyone. So I'll be talking about uh like some work on evaluations particularly evaluations across like I guess I've done in the last four years. So let's get started.So uh I'll be talking about coding evaluations across varying time horizons. So I've been uh working on like in the code space for about four years now like it was right before like early copilot came out and my first project was actually working on generating like single line panda snippets and my last project was generating an en ...