GPT5 has been the most polarizing model launch I have ever seen. From people saying it's the greatest model they've ever used to saying they're sticking with Claude 3.5% to GraphGate to saying the evals don't even matter anymore. So, I'm going to break down all of the reactions from the industry right now.All right, first from the man himself, Sam Alman, he gives some updates post launch after collecting some of the feedback. Listen to what he has to say. We for sure underestimated how much some of the thin ...

RT CoinDesk Indices (@CoinDeskMarkets)“Implementing reliable benchmarks could unlock the next evolution of DeFi — one that is not driven by speculation, but by structure, scalability, and institutional-grade infrastructure,” says @juny0x of @TreehouseFihttps://t.co/m85HChkVzX ...

Benchmarks as Memes in AI - Benchmarks are presented as memes that shape AI development, influencing what models are trained and tested on [1][3][8] - The AI industry faces a problem of benchmark saturation, as models become too good at existing benchmarks, diminishing their value [5][6] - There's an opportunity for individuals to create new benchmarks that define what AI models should excel at, shaping the future of AI capabilities [7][13] The Lifecycle and Impact of Benchmarks - The typical benchmark lifecycle involves an idea spreading, becoming a meme, and eventually being saturated as models train on it [8] - Benchmarks can have unintended consequences, such as reinforcing biases if not designed thoughtfully, as seen with the Chat-GPT thumbs-up/thumbs-down benchmarking [14] - The industry should focus on creating benchmarks that empower people and promote agency, rather than treating them as mere data points [16] Qualities of Effective Benchmarks - Great benchmarks should be multifaceted, rewarding creativity, accessible to both small and large models, generative, evolutionary, and experiential [17][18][19] - The industry needs more "squishy," non-static benchmarks for areas like ethics, society, and art, requiring subject matter expertise [34][35] - Benchmarks can be used to build trust in AI by allowing people to define goals, provide feedback, and see AI improve, fostering a sense of importance and control [37] AI Diplomacy Benchmark - AI Diplomacy is presented as an example of a benchmark that mimics real-world situations, testing models' abilities to negotiate, form alliances, and betray each other [20][22][23] - The AI Diplomacy benchmark revealed interesting personality traits in different models, such as 03 being a schemer and Claude models being naively optimistic [24][25][30] - The AI Diplomacy benchmark highlighted the importance of social aspects and convincing others, with models like Llama performing well due to their social skills [31]

How many times have you gotten to the accomplishment of your perhaps only to realize I think it's okay only to realize that you still felt empty or unfulfilled? It could be a job position, a degree, certain number on social media, or maybe a material acquisition or possession. And granted, for a few days or weeks, the excitement might still be high, but then after that, you ask yourself, is that it? Was that all I was striving for? I mean, you expected that he was going to be the game changer for your life. ...

Great. Thank you for the introduction and thanks to the International Advanced Natural Language Processing Conference for organizing this and uh thanks as well for allowing this this talk to start and kick off the the conference. I appreciate it.You guys have done a great job. Um in terms of the um the topic, I do have to uh make sure that we understand the contextual uh background behind this this this topic uh today and recent events over the last few weeks and months. Uh so I'm going to take a few minute ...