Core Viewpoint - The article discusses the differences in performance among AI large models, questioning whether their rankings truly reflect their capabilities in complex interactive scenarios, such as social deduction games like "Werewolf" [4][5]. Group 1: AI Model Competition - Taobao organized an "AI Werewolf World Cup," bringing together 12 top AI models to compete under a unified framework, emphasizing direct competition [7][12]. - The competition involved 150 rounds of gameplay, focusing on the models' reasoning abilities in a complex social deduction environment [10][17]. - The models included notable names like GPT, Gemini, and Qwen, showcasing the latest versions from various companies [9][19]. Group 2: Evaluation Metrics - The evaluation criteria for the competition included vote accuracy, divine skill efficiency, kill precision, and overall scores, providing a detailed profile of each model's capabilities [24][25]. - Vote accuracy measures the model's ability to identify the "werewolf" amidst misinformation, while divine skill efficiency assesses decision-making during critical game moments [28][29]. - Kill precision reflects the model's ability to collaborate and deduce the location of opponents, while werewolf win rates indicate the model's effectiveness in deception and social strategy [31][32]. Group 3: Insights from Gameplay - The competition revealed that some models struggled with advanced strategies, highlighting the limitations of even the most advanced AI in high-stakes scenarios [35]. - AI models exhibited a more polite and measured approach in conflict situations compared to human players, indicating a unique strategic style [36][40]. - The ongoing matches and results are available on the WhoisSpy.ai platform, which aims to evaluate AI performance in social reasoning and gaming contexts [41]. Group 4: Future Developments - The article mentions an upcoming international competition that invites global developers to participate, expanding the scope of AI model testing [46][47]. - The competition will allow developers to utilize provided templates to create agents, making participation accessible even for those without extensive experience [55][56]. - Incentives for the competition include cash prizes, with the first place receiving $5,000, encouraging innovation and continuous improvement among participants [63][64].