「我受够了Transformer」：其作者Llion Jones称AI领域已僵化，正错失下一个突破

Core Viewpoint - The AI field is experiencing a paradox where increased resources and funding are leading to decreased creativity and innovation, as researchers focus on safe, publishable projects rather than high-risk, transformative ideas [3][11][29]. Group 1: Current State of AI Research - Llion Jones, CTO of Sakana AI and co-author of the influential paper "Attention is All You Need," expressed frustration with the current focus on the Transformer architecture, suggesting it may hinder the search for the next major breakthrough [2][5][24]. - Despite unprecedented investment and talent influx into AI, the field has become narrow-minded, with researchers feeling pressured to compete rather than explore new ideas [3][11][16]. - Jones highlighted that the current environment leads to rushed publications and a lack of true scientific exploration, as researchers are concerned about being "scooped" by competitors [11][16]. Group 2: Historical Context and Comparison - Jones recalled the organic and pressure-free environment that led to the creation of the Transformer, contrasting it with today's competitive atmosphere where researchers feel compelled to deliver quick results [19][30]. - He emphasized that the freedom to explore ideas without pressure from management was crucial for the development of the Transformer, a condition that is now largely absent [19][22]. Group 3: Proposed Solutions and Future Directions - To foster innovation, Jones proposed increasing the "exploration dial" and encouraging researchers to share their findings openly, even at the cost of competition [21][26]. - At Sakana AI, efforts are being made to recreate a research environment that prioritizes exploration over competition, aiming to reduce the pressure to publish [22][30]. - Jones believes that the next significant breakthrough in AI may be overlooked if the current focus on incremental improvements continues, urging a shift towards collaborative exploration [26][31].