更懂国内APP的开源智能体！感知/定位/推理/中文能力全面提升，还能自己学会操作

Core Viewpoint - The article discusses the development and capabilities of the open-source multimodal intelligent agent UItron, which can autonomously operate mobile and computer applications, particularly excelling in Chinese app interactions [1][4][20]. Group 1: Technology and Methodology - UItron is designed for complex multi-step tasks on mobile and computer platforms, showcasing superior performance in real interactions within Chinese app environments [3][4]. - The development of UItron involves a systematic data engineering approach to address the scarcity of operational trajectories and enhance the interactive infrastructure for intelligent agents [6][8]. - UItron employs a three-stage training strategy, including two supervised fine-tuning (SFT) phases for perception and planning tasks, followed by a reinforcement learning (RL) phase [12][14]. Group 2: Performance and Evaluation - UItron achieved an average score of 92.0 on the ScreenspotV2 benchmark, indicating strong GUI content understanding and task localization capabilities [16]. - In offline planning benchmarks like Android-Control and GUI-Odyssey, UItron reached a maximum average score of 92.9, demonstrating robust task planning and execution abilities [18]. - The agent's performance in the OSWorld benchmark was notable, with a score of 24.9, positioning it as one of the top performers among GUI agents [19]. Group 3: Data Engineering and Infrastructure - UItron's data engineering includes perception data, planning data, and distilled data, which collectively enhance the training dataset's quality and quantity [8][10]. - The interactive infrastructure established by UItron facilitates the collection of trajectory data and supports online evaluation and reinforcement learning training [10]. - The integration of mobile and PC environments allows for automatic recording of screenshots and coordinates, significantly improving the efficiency of collecting operational trajectories in Chinese contexts [10]. Group 4: Future Implications - UItron aims to provide a stronger foundational model for the field of multimodal intelligent agents, with an emphasis on usability and reliability, particularly in real-world applications involving Chinese app interactions [20].