字节发布GR-3大模型，开启通用机器人“大脑”新纪元

Core Insights - ByteDance's Seed team launched a new Vision-Language-Action Model (VLA) named GR-3, which boasts strong generalization capabilities, understanding of abstract concepts, and the ability to manipulate flexible objects [2][3] Model Features - GR-3's key advantage lies in its exceptional generalization ability and understanding of abstract concepts, allowing for efficient fine-tuning with minimal human data [3] - The model utilizes a Mixture-of-Transformers (MoT) architecture, integrating visual-language and action generation modules into an end-to-end model with 4 billion parameters [3] - GR-3 can perform a series of actions based on verbal commands, such as "clean the table," executing tasks like packing leftovers and disposing of trash [3] Training Methodology - GR-3 employs a three-in-one data training method, combining teleoperated robot data, human VR trajectory data, and publicly available image-text data to enhance model performance [4] - The inclusion of teleoperated robot data ensures stability and accuracy in basic tasks, while human VR trajectory data allows for rapid learning of new tasks at nearly double the efficiency of traditional methods [4] Application and Performance - In practical applications, GR-3 demonstrates outstanding performance in general pick-and-place tasks, maintaining high command adherence and success rates even in unfamiliar environments [6] - For long-range table cleaning tasks, GR-3 achieves an average completion rate exceeding 95% based solely on the command "clean the table" [6] - The model exhibits remarkable flexibility and robustness in delicate operations, successfully completing tasks like hanging clothes regardless of the garment type [6] Future Developments - The Seed team plans to expand the model's scale and training data to further enhance GR-3's generalization capabilities for unknown objects [7] - Future enhancements will include the introduction of reinforcement learning (RL) methods to allow the robot to learn from trial and error during actual operations [7] - The release of GR-3 is seen as a significant step towards developing a general-purpose robotic "brain," with aspirations for robots to assist in daily human tasks [7]