Group 1 - The article discusses suitable research directions for publishing papers, particularly in the fields of embodied intelligence, including vln, vla, reinforcement learning, and real2sim2real [1] - For researchers currently engaged in SLAM, vln and vla are recommended as good entry points, especially for those with robotic arms [1] - The article emphasizes the importance of having a good idea for research, noting that new researchers may need to navigate various challenges to develop innovative concepts [1] Group 2 - A new paper guidance service has been launched, offering customized one-on-one mentoring in various advanced topics such as multimodal large models, VLA, reinforcement learning, and more [2] - The mentoring team consists of PhD holders and researchers from top universities and companies, providing comprehensive support from topic selection to publication strategy [2] - The service aims to bridge the gap between academia and industry, focusing not only on paper publication but also on practical application value [3] Group 3 - The article promotes a free matching service for the first ten inquiries, allowing students to have in-depth meetings with mentors based on their research direction and academic background [5]

Core Points - The ICML 2026 conference will take place from July 7 to July 12, 2026, in Seoul, South Korea, with a double-blind review process for all submitted papers [4] - Authors of accepted papers can choose whether to attend the conference in person or only have their papers included in the proceedings [7] - The original submission versions of accepted papers will be made publicly available, and authors of rejected papers can also choose to make their original submissions public [10] Submission Requirements - Papers must be submitted as a single file, with a maximum of 8 pages for the main text, while references, impact statements, and appendices have no page limit [5] - There will be no separate submission deadline for supplementary materials, and authors can add one extra page to the final version of accepted papers [6] - Papers that do not comply with the submission requirements will be rejected without review [11] Important Dates - The submission website will open on January 8, 2026, with the abstract submission deadline on January 23, 2026, and the full paper submission deadline on January 28, 2026 [14][15] Review Process - Authors are required to participate in the review process, with specific mutual review requirements for both papers and authors [17] - The double-blind review policy prohibits simultaneous submissions to multiple conferences or journals [18] - All submissions must be anonymized and should not contain any information that could reveal the authors' identities [21] Ethical Guidelines - Each paper must include a potential societal impact statement, which should be placed at the end of the paper and will not count towards the page limit [23] - Authors must submit a plain language summary to communicate the significance of their research to the public [24] - Violations of the review process or ethical guidelines may result in sanctions or rejection of the submission [22][23]

Core Insights - The article discusses how Replit, an AI programming platform, is transforming the coding experience by allowing users to interact with AI agents that can write code based on simple prompts, effectively making AI the new "programmer" [4][7][18]. Group 1: AI Programming Experience - Replit aims to eliminate the complexities of setting up development environments, allowing users to focus on their ideas and projects [6][10]. - Users can input their project ideas in plain English, and the AI agent will interpret these inputs to create a task list and execute the necessary coding tasks [16][18]. - The platform supports multiple programming languages and automatically selects the most suitable technology stack based on user input [8][9]. Group 2: AI Agent Capabilities - The AI agents are designed to perform tasks autonomously, effectively taking on the role of the programmer [18][19]. - The agents can run for extended periods, with improvements in their ability to maintain coherence and complete complex tasks over time [22][26]. - Innovations such as "context compression" and the introduction of verification loops have enhanced the agents' long-term reasoning capabilities [24][28]. Group 3: Future of AI in Programming - The next iteration, Agent4, aims to allow users to deploy multiple agents simultaneously, enhancing collaborative coding efforts [45]. - The article suggests that the programming field is on the verge of explosive growth, with AI enabling individuals without technical backgrounds to achieve advanced coding capabilities [45][46]. - There is a discussion on the potential of AI to reach a level of general intelligence (AGI), but concerns remain about the current limitations in transferring learning across different domains [47][50].

Core Insights - The article discusses the evolution of AI, particularly focusing on the development of agent systems and the challenges they face in achieving true intelligence [4][5][6][7][8][9][10]. Group 1: Future of AI Agents - Andrej Karpathy emphasizes that the next decade will be crucial for the development of AI agents, suggesting that current systems are not yet mature enough to be fully utilized in practical applications [5][6][7]. - The concept of a "cognitive core" is introduced, which refers to a stripped-down version of knowledge that retains intelligent algorithms and problem-solving strategies, highlighting the need for better data quality in training models [5][16]. - Karpathy expresses concern that society may lose understanding and control over AI systems as they become more integrated into daily life, leading to a disconnect between users and the underlying mechanisms of these systems [5][6]. Group 2: Historical Context and Learning Mechanisms - The article outlines significant milestones in AI development, such as the introduction of AlexNet and the Atari reinforcement learning era, which shaped the current landscape of AI research [8][9][10]. - Karpathy argues that human learning differs fundamentally from reinforcement learning, suggesting that humans build rich world models through experience rather than relying solely on reward signals [40]. - The discussion includes the limitations of current AI models in terms of continuous learning and the need for a more sophisticated understanding of context and memory [22][23]. Group 3: AI's Current Limitations - Karpathy critiques the current state of AI, stating that many generated code outputs are of mediocre quality and that the industry is experiencing a phase of over-optimism regarding AI capabilities [5][6][37]. - The article highlights the challenges AI faces in understanding complex code structures and the limitations of code generation models in producing original, contextually appropriate code [30][31][36]. - The need for a more nuanced approach to AI development is emphasized, suggesting that improvements must occur across multiple dimensions, including algorithms, data, and computational power [24][25][27].

Core Viewpoint - The article discusses the future of Li Auto's VLA technology, emphasizing the importance of a reinforced learning loop and the potential for significant advancements in autonomous driving capabilities by 2027 [1][2]. Short-term Outlook - Li Auto aims to establish a reinforced learning loop by the end of 2025, which is expected to enhance user experience significantly, making the vehicle feel more "alive" and responsive [1]. Mid-term Outlook - With the reinforced learning loop in place, Li Auto anticipates surpassing Tesla in the Chinese market due to its advantageous environment for iterative improvements [1]. Long-term Outlook - The VLA technology is projected to achieve Level 4 autonomy, with the expectation of new technologies emerging beyond this milestone [1]. Business Process Transformation - The transition to reinforced learning is not just a technical change but a fundamental business transformation that will create a competitive moat for the company [1][3]. Team Dynamics and Leadership - The restructuring of the autonomous driving team focuses on building a robust business system rather than relying on individual talents, with an emphasis on internal talent development [7][8]. AI and Computational Needs - The current intelligence requirements for driving are considered low, and after the business process reform, clearer insights into computational needs will emerge [3][4]. Competitive Landscape - The article suggests that multiple players will exist in the autonomous driving space, and the narrative of having unique capabilities may not constitute a strict competitive moat [2][8]. Data and Model Development - The importance of data quality and distribution in training models is highlighted, with a focus on addressing corner cases to enhance system performance [9]. Strategic Insights - Li Auto's strategy emphasizes the need for substantial resource allocation and continuous investment in AI technology, akin to the role of Elon Musk at Tesla [8][12]. Organizational Structure - The restructuring of the autonomous driving department includes the formation of various specialized teams to enhance operational efficiency and employee engagement [7][11]. Future Projections - By 2027, the industry may shift away from traditional metrics like MPI, indicating a potential evolution in performance evaluation standards [11].

Core Insights - Reinforcement Learning (RL) is a crucial and complex component in enhancing the intelligence of large language models (LLMs) [1][2] - The presentation by Alibaba's algorithm expert, Cao Yu, at AICon 2025 discusses the current state and future directions of RL systems, particularly in the context of LLMs [1][2] Group 1: RL Theory and Engineering - The engineering demands of RL algorithms are multifaceted, focusing on the integration of LLMs as agents within RL systems [3][4] - The interaction between agents and their environments is essential, with the environment defined as how LLMs interact with users or tools [6] - Key components include the reward function, which evaluates the quality of actions taken by the agent, and various algorithms like PPO, GRPO, and DPO that guide policy updates [7][8] Group 2: Algorithm Development and Challenges - The evolution of RL applications has seen a shift from human feedback to more complex reward modeling, addressing issues like reward hacking [9][12] - The traditional PPO algorithm is discussed, highlighting its complexity and the need for a robust evaluation process to assess model capabilities [12][13] - Newer algorithms like GRPO have emerged, focusing on improving the efficiency of the critic model and addressing challenges in training and inference [20][22] Group 3: Large-Scale RL Systems - The rapid advancements in RL have led to a shift from simple human-aligned metrics to more sophisticated models capable of higher reasoning [25][28] - Future RL systems will require enhanced capabilities for dynamic weight updates and efficient resource allocation in distributed environments [36][38] - The integration of various frameworks, such as Ray and DeepSpeed, is crucial for optimizing the performance of large-scale RL systems [49][57] Group 4: Open Source and Community Collaboration - The development of open-source frameworks like Open RLHF and VeRL reflects the industry's commitment to collaborative innovation in RL [53][55] - Companies are encouraged to participate in the design and improvement of RL systems, focusing on efficiency, evaluation, and training balance [58]

Core Insights - The article discusses the emergence of MAI, an AI-driven marketing platform designed to simplify digital advertising for small and medium-sized enterprises (SMEs) by automating complex decision-making processes [3][4][7]. Group 1: Industry Challenges - The digital advertising landscape has become increasingly complex, with numerous platforms and parameters, making it difficult for SMEs to manage their advertising effectively [3][4]. - The rising customer acquisition costs and inefficiencies in manual optimization have created a structural problem in the industry, where optimization still heavily relies on human input [4][7]. Group 2: MAI's Solution - MAI utilizes reinforcement learning technology to automate and optimize advertising strategies across multiple platforms, aiming to provide SMEs with advertising capabilities comparable to larger companies [7][9]. - The platform allows users to set business goals using natural language, enabling automatic and transparent decision-making without needing to understand complex parameters [7][15][16]. - MAI connects directly to various data sources, dynamically optimizing bidding, budgeting, and creative selection in real-time, which has resulted in an average sales increase of 40% for clients [7][9][19]. Group 3: Product Features - MAI's system automatically integrates with advertising platforms and e-commerce backends, creating a comprehensive marketing ecosystem that continuously monitors and adjusts advertising performance [9][15]. - The platform generates weekly reports summarizing advertising performance and key changes, allowing users to focus on business outcomes rather than the intricacies of advertising [15][16]. Group 4: Business Model - MAI operates on a straightforward fee structure, charging a service fee based on a percentage of the client's advertising spend, typically around 10% [21][22]. - The revenue model includes subscription/management fees and customized service fees, catering to both standard monthly services for smaller clients and bespoke solutions for larger enterprises [22][21]. Group 5: Founders and Team - MAI was co-founded by Yuchen Wu and Jian Wang, both of whom have extensive experience in advertising technology and e-commerce, having previously worked at Google Ads and Instacart [29][34]. - The team comprises professionals with backgrounds in engineering and product management from leading tech companies, emphasizing their commitment to leveraging AI for advertising automation [34][29]. Group 6: Funding and Growth - MAI secured $25 million in funding led by Kleiner Perkins in September 2025, which will be used to expand its engineering team and support global market growth, particularly in Europe and Asia [36][37]. - The investment reflects venture capital interest in AI-driven solutions for paid search management and automated digital advertising platforms, indicating a significant market opportunity [36].

Group 1 - The article introduces a new research guidance service focused on embodied intelligence, addressing common challenges faced by newcomers in selecting research topics and methodologies [1][2] - The guidance covers various advanced topics such as multimodal large models, reinforcement learning, and robot simulation, providing tailored one-on-one support [2][3] - The service is backed by a team of experienced mentors from prestigious institutions and leading companies, ensuring high-quality assistance throughout the research process [2][3] Group 2 - The program emphasizes a dual perspective from both industry and academia, aiming not only for publication but also for practical application and value [3] - An introductory offer is available for the first ten inquiries, allowing students to receive personalized mentorship and tailored advice on suitable conferences and journals [4]

Group 1 - The core viewpoint of the article highlights the successful implementation of real machine reinforcement learning technology by Zhiyuan Robotics in collaboration with Longqi Technology, which enhances the efficiency of robotic deployment on production lines [1][3] - Traditional reinforcement learning typically occurs in simulated environments, leading to challenges in transferring learned strategies to real machines, which often requires extensive adjustments and resources [1][2] - The deployment of humanoid robots in actual production lines is currently labor-intensive, with a significant number of personnel required for tuning, calibration, and safety monitoring [2] Group 2 - Directly embedding reinforcement learning into real production lines optimizes training objectives for robots, potentially reducing the need for human and material resources [3] - Despite the efficiency gains, there are risks associated with material loss and safety during the deployment of real machine reinforcement learning, necessitating pre-training and robust control mechanisms [3] - The next challenge for Zhiyuan Robotics is to replicate the success of real machine reinforcement learning across multiple production processes, leveraging local private cloud and OTA mechanisms for sharing learning experiences and model updates [3]

Core Insights - The article discusses the rapid growth and significance of the Vision-Language-Action (VLA) field, highlighting its potential to enable robots to understand human language, perceive the world, and perform tasks effectively [2][7]. Summary by Sections VLA Overview - VLA models have seen a dramatic increase in submissions, rising from single digits to 164 papers, an 18-fold increase [6]. - A model qualifies as VLA if it uses a pre-trained backbone on large-scale visual-language data, emphasizing its capabilities in language understanding, visual generalization, and task transfer [8][9]. Trends in VLA - **Trend 1: Efficient Architecture** Discrete diffusion models are emerging as a new paradigm, allowing for parallel generation of action sequences, enhancing efficiency [15][17]. - **Trend 2: Embodied Chain-of-Thought (ECoT)** ECoT enables robots to generate intermediate reasoning steps before actions, improving planning and interpretability [18][19]. - **Trend 3: Action Tokenizer** This trend focuses on converting continuous robot actions into discrete tokens that VLMs can understand, enhancing efficiency and integration of reasoning and action [22]. - **Trend 4: Reinforcement Learning (RL)** RL is re-emerging as a crucial tool for fine-tuning VLA strategies, particularly in extreme scenarios [26][27]. - **Trend 5: Efficiency Optimization** Efforts are being made to reduce the cost and complexity of VLA models, making them more accessible to smaller labs [28][29]. - **Trend 6: Video Prediction** Video generation models are being utilized to provide VLA with an understanding of temporal dynamics and physical laws [30]. - **Trend 7: Realistic Evaluation Benchmarks** New evaluation methods are being developed to address the saturation of existing benchmarks, focusing on future frame prediction tasks [37][39]. - **Trend 8: Cross-Body Learning** Innovations in architecture are essential for creating universal robot strategies that can operate across different structures [41][43]. Challenges and Future Directions - The article highlights the "performance ceiling" issue in mainstream simulation evaluations, where high scores do not necessarily translate to real-world capabilities [44]. - Two critical areas needing more attention are data quality and the potential for in-context learning to enhance VLA systems [49][50].