Core Viewpoint - The article discusses the transition of autonomous driving technology from Level 2/3 (assisted driving) to Level 4/5 (fully autonomous driving), highlighting the challenges and opportunities in the industry as well as the evolving skill requirements for professionals in the field [2]. Industry Trends - The shift towards high-level autonomous driving is creating a competitive landscape where traditional sensor-based approaches, such as LiDAR, are being challenged by cost-effective vision-based solutions like those from Tesla [2]. - The demand for skills in reinforcement learning and advanced perception algorithms is increasing, leading to a sense of urgency among professionals to upgrade their capabilities [2]. Talent Market Dynamics - The article notes a growing anxiety among seasoned professionals as they face the need to adapt to new technologies and methodologies, while newcomers struggle with the overwhelming number of career paths available in the autonomous driving sector [2]. - The reduction in costs for LiDAR technology, exemplified by Hesai Technology's price drop to $200 and BYD's 70% price reduction, indicates a shift in the market that requires continuous learning and adaptation from industry professionals [2]. Community and Learning Resources - The establishment of the "Autonomous Driving Heart Knowledge Planet" aims to create a comprehensive learning community for professionals, offering resources and networking opportunities to help individuals navigate the rapidly changing landscape of autonomous driving technology [7]. - The community has attracted nearly 4,000 members and over 100 industry experts, providing a platform for knowledge sharing and career advancement [7]. Technical Focus Areas - The article outlines several key technical areas within autonomous driving, including end-to-end driving systems, perception algorithms, and the integration of AI models for improved performance [10][11]. - It emphasizes the importance of understanding various subfields such as multi-sensor fusion, high-definition mapping, and AI model deployment, which are critical for the development of autonomous driving technologies [7].

Core Viewpoint - The article introduces a new job coaching service focused on helping individuals transition into the intelligent driving sector, particularly targeting recent graduates and professionals without specific job experience in this field [2]. Summary by Sections Coaching Scope - Basic services include personalized 1-on-1 coaching sessions, analysis of the learner's profile, and the creation of a detailed learning plan to bridge the gap between current skills and job requirements [5][6]. - The service also offers resume optimization and job referral opportunities based on the learner's situation [6]. Pricing Structure - The coaching service is priced at 8000 per person, which includes a minimum of 10 online meetings, each lasting at least one hour [4]. Advanced Services - Additional services include project practice opportunities that can be added to resumes and simulated interviews that encompass both HR and business interviews, available for an extra fee [5][6]. Instructor Background - Instructors are industry experts with over 8 years of experience in intelligent driving, having worked with leading companies in the sector [7][9].

Core Insights - The article highlights the key research directions in computer vision and autonomous driving as presented at major conferences CVPR and ICCV, focusing on four main areas: general computer vision, autonomous driving, embodied intelligence, and 3D vision [2][3]. Group 1: Research Directions - In the field of computer vision and image processing, the main research topics include diffusion models, image quality assessment, semi-supervised learning, zero-shot learning, and open-world detection [3]. - Autonomous driving research is concentrated on end-to-end systems, closed-loop simulation, 3D ground segmentation (3DGS), multimodal large models, diffusion models, world models, and trajectory prediction [3]. - Embodied intelligence focuses on visual language navigation (VLA), zero-shot learning, robotic manipulation, end-to-end systems, sim-to-real transfer, and dexterous grasping [3]. - The 3D vision domain emphasizes point cloud completion, single-view reconstruction, 3D ground segmentation (3DGS), 3D matching, video compression, and Neural Radiance Fields (NeRF) [3]. Group 2: Research Support and Collaboration - The article offers support for various research needs in autonomous driving, including large models, VLA, end-to-end autonomous driving, 3DGS, BEV perception, target tracking, and multi-sensor fusion [4]. - In the embodied intelligence area, support is provided for VLA, visual language navigation, end-to-end systems, reinforcement learning, diffusion policy, sim-to-real, embodied interaction, and robotic decision-making [4]. - For 3D vision, the focus is on point cloud processing, 3DGS, and SLAM [4]. - General computer vision support includes diffusion models, image quality assessment, semi-supervised learning, and zero-shot learning [4].

Core Insights - The article discusses the advancements and applications of visual language models (VLMs) and large language models (LLMs) in the field of autonomous driving and intelligent transportation systems [1][4][19]. Summary by Sections Overview of Visual Language Models - Visual language models are becoming increasingly important in the context of autonomous driving, enabling better understanding and interaction between visual data and language [4][10]. Recent Research and Developments - Several recent papers presented at conferences like CVPR and NeurIPS focus on enhancing the capabilities of VLMs and LLMs, including methods for improving object detection, scene understanding, and generative capabilities in driving scenarios [5][7][10][12]. Applications in Autonomous Driving - The integration of world models with VLMs is highlighted as a significant advancement, allowing for improved scene representation and predictive capabilities in autonomous driving systems [10][13][19]. Knowledge Distillation and Transfer Learning - Knowledge distillation techniques are being explored to enhance the performance of vision-language models, particularly in tasks related to detection and segmentation [8][9]. Future Directions - The article emphasizes the potential of foundation models in advancing autonomous vehicle technologies, suggesting a trend towards more scalable and efficient models that can handle complex driving environments [10][19].

Core Viewpoint - The article discusses the evolution of DeepSeek in the context of Mixture-of-Experts (MoE) models, highlighting innovations and improvements from DeepSeekMoE (V1) to DeepSeek V3, while maintaining a focus on the MoE technology route [1]. Summary by Sections 1. Development History of MoE - MoE was first introduced in 1991 with the paper "Adaptive Mixtures of Local Experts," and its framework has remained consistent over the years [2]. - Google has been a key player in the development of MoE, particularly with the release of "GShard" in 2020, which scaled models to 600 billion parameters [5]. 2. DeepSeek's Work 2.1. DeepSeek-MoE (V1) - DeepSeek V1 was released in January 2024, addressing two main issues: knowledge mixing and redundancy among experts [15]. - The architecture introduced fine-grained expert segmentation and shared expert isolation to enhance specialization and reduce redundancy [16]. 2.2. DeepSeek V2 MoE Upgrade - V2 introduced a device-limited routing mechanism to control communication costs by ensuring that activated experts are distributed across a limited number of devices [28]. - A communication balance loss was added to address potential congestion issues at the receiving end of the communication [29]. 2.3. DeepSeek V3 MoE Upgrade - V3 maintained the fine-grained expert and shared expert designs while upgrading the gating network from Softmax to Sigmoid to improve scoring differentiation among experts [36][38]. - The auxiliary loss for load balancing was eliminated to reduce its negative impact on the main model, replaced by a dynamic bias for load balancing [40]. - A sequence-wise auxiliary loss was introduced to balance token distribution among experts at the sequence level [42]. 3. Summary of DeepSeek's Innovations - The evolution of DeepSeek MoE has focused on balancing general knowledge and specialized knowledge through shared and fine-grained experts, while also addressing load balancing through various auxiliary losses [44].

点击下方 卡片 ，关注" 具身智能 之心 "公众号 具身智能无疑是这两年最火的技术关键词。从沉寂到疯狂，再到冷静。今年上半年很多家公司都在尝试具身量 产交卷。未来行业不再是 随便哪家发出来的 demo 和 pr 稿就可以引起轰动，业内技术人才很快就可以破案， 讲的好不如真可靠。最近像地瓜机器人演示了宇树Go2四足机器狗，效果已经可圈可点，相信未来会有更多的 量产产品问世！ 可以说感知能力升级与多模态融合是具身技术路线发展的重要一环，在视觉感知之外，触觉感知则是这两年发 力的重点，特别是灵巧手领域，力控能大幅提升操作的精细度及结果反馈能力。多模态传感器融合技术使机器 人能够同时处理视觉、听觉、触觉等多种信息，这种融合不仅体现在硬件层面，更在于算法层面的深度整合。 大幅提升了环境感知的准确性和全面性。 大模型驱动的大脑算法正在不断地提升机器人对世界的经验认知与理解。特别是在人形机器人领域，大模型基 于多模态数据提升机器人的感知能力，推动机器人的自主学习、决策规划能力，并结合动作训练、行为交互训 练，有望提升动作的泛化能力。同时，轻量化的模型设计也成为行业落地的迫切需求，我们更需要低算力、多 模态、跨平台的轻量化模 ...

Core Viewpoint - The research introduces a novel method called "Shape of Motion" that combines 3D Gaussian point technology with SE(3) motion representation, achieving a 73% improvement in 3D tracking accuracy compared to existing methods, with significant applications in AR/VR and autonomous driving [2][4]. Summary by Sections Introduction - The challenge of dynamic scene reconstruction from monocular video is likened to feeling an elephant in the dark due to the lack of information [7]. - Traditional methods rely on multi-view videos or depth sensors, making them less effective for dynamic scenes [7]. Core Contribution - The "Shape of Motion" technique enables the reconstruction of complete 4D scenes (3D space + time) from a single video, allowing for the tracking of object motion and rendering from any viewpoint [9][10]. - Two main innovations include low-dimensional motion representation using SE(3) motion bases and the integration of data-driven priors for a globally consistent dynamic scene representation [9][12]. Technical Analysis - The method employs 3D Gaussian points as the basic unit for scene representation, allowing for real-time rendering [10]. - Various data-driven priors, such as monocular depth estimation and long-range 2D trajectories, are utilized to overcome the under-constrained nature of monocular video reconstruction [11][12]. Experimental Results - The method outperforms existing techniques on the iPhone dataset, achieving a 73.3% accuracy in 3D tracking and a PSNR of 16.72 for new view synthesis [17][18]. - The 3D tracking error (EPE) is reported as low as 0.16 on the Kubric synthetic dataset, showing a 21% improvement over baseline methods [20]. Discussion and Future Outlook - The current method faces challenges such as training time and reliance on accurate camera pose estimation [25]. - Future directions include optimizing training time, enhancing view generation capabilities, and developing fully automated segmentation methods [25]. Conclusion - The "Shape of Motion" research marks a significant advancement in monocular dynamic reconstruction, with potential applications in real-time tracking for AR glasses and autonomous systems [26].

Core Viewpoint - The article emphasizes the importance of high-quality 4D automatic annotation in the development of intelligent driving, highlighting that while model algorithms are crucial for initial capabilities, the future lies in efficiently obtaining vast amounts of automatically annotated data [2][3]. Summary by Sections 4D Data Annotation Process - The article outlines the complexity of automatically annotating dynamic obstacles, which involves multiple modules and requires advanced engineering skills to effectively utilize large models and systems [2][3]. - The process includes offline 3D target detection, tracking, post-processing optimization, and sensor occlusion optimization [4][5]. Challenges in Automatic Annotation - High requirements for spatiotemporal consistency, necessitating precise tracking of dynamic targets across frames [7]. - Complexity in multi-modal data fusion, requiring synchronization of data from various sensors [7]. - Difficulty in generalizing dynamic scenes due to unpredictable behaviors of traffic participants and environmental interferences [7]. - The contradiction between annotation efficiency and cost, where high-precision annotation relies on manual verification, leading to long cycles and high costs [7]. - High requirements for scene generalization in mass production, with challenges in data extraction across different cities, roads, and weather conditions [8]. Educational Course on 4D Annotation - The article promotes a course designed to address the challenges of entering the field of 4D automatic annotation, covering the entire process and core algorithms [8][9]. - The course includes practical exercises and focuses on dynamic obstacle detection, tracking, optimization, and data quality inspection [11][12]. - It also covers SLAM reconstruction, static element annotation, and OCC marking, providing a comprehensive understanding of the field [13][15][16]. Instructor and Course Structure - The course is taught by an industry expert with extensive experience in data closure algorithms and has participated in multiple mass production projects [20]. - The course is suitable for researchers, students, and professionals looking to enhance their skills in 4D automatic annotation [23][24].

Core Viewpoint - The article focuses on the advancements in embodied intelligence within robotics, emphasizing the integration of physical simulators and world models as crucial for developing robust embodied intelligence [3][5]. Group 1: Embodied Intelligence and Robotics - Embodied intelligence is highlighted as a key area of research, emphasizing the importance of physical interaction with the environment for perception, action, and cognition [5]. - The article discusses the necessity for a scientific and reasonable grading system for robotic intelligence, especially in dynamic and uncertain environments [5][6]. - A proposed grading model for intelligent robots includes five progressive levels (IR-L0 to IR-L4), covering autonomy and task handling capabilities [6][10]. Group 2: Grading System for Intelligent Robots - The grading system categorizes robots based on their task execution capabilities, decision-making depth, interaction complexity, and ethical cognition [7][10]. - Key dimensions for grading include autonomy, task processing ability, environmental adaptability, and social cognition [11]. Group 3: Physical Simulators and World Models - The article reviews the complementary roles of physical simulators and world models in enhancing robot autonomy, adaptability, and generalization capabilities [3][72]. - A resource repository is maintained to provide comprehensive insights into the development of embodied AI systems and future challenges [3]. Group 4: Key Technologies and Trends - The advancements in robotics include the integration of various technologies such as model predictive control, reinforcement learning, and imitation learning to enhance robot capabilities [24][25]. - The article discusses the evolution of world models, which simulate real-world dynamics and improve the robustness of robotic systems [45][60]. Group 5: Future Directions and Challenges - Future directions include the development of structured world models, multi-modal integration, and lightweight models for efficient inference [73][72]. - The challenges faced by the industry include high-dimensional perception, causal reasoning, and real-time processing requirements [71][73].

Core Viewpoint - The article announces the launch of the "Black Warrior Series 001," a lightweight autonomous driving solution aimed at research and education, with a promotional price of 34,999 yuan and a deposit scheme for early orders [1]. Group 1: Product Overview - The Black Warrior 001 is developed by the Autonomous Driving Heart team, featuring a comprehensive solution that supports perception, localization, fusion, navigation, and planning, built on an Ackermann chassis [2]. - The product is designed for various educational and research applications, including undergraduate learning, graduate research, and as teaching tools in laboratories and vocational schools [5]. Group 2: Performance Demonstration - The product has been tested in multiple environments, including indoor, outdoor, and underground scenarios, showcasing its capabilities in perception, localization, fusion, navigation, and planning [3]. Group 3: Hardware Specifications - Key sensors include: - 3D LiDAR: Mid 360 - 2D LiDAR: Lidar Intelligent - Depth Camera: Orbbec, with built-in IMU - Main Control Chip: Nvidia Orin NX 16G - Display: 1080p [19] - The vehicle's weight is 30 kg, with a battery power of 50W and a voltage supply of 24V, providing a runtime of over 4 hours [21]. Group 4: Functional Capabilities - The system supports various functionalities such as 2D and 3D SLAM, point cloud processing, vehicle navigation, and obstacle avoidance [24]. Group 5: Software Framework - The software framework includes ROS, C++, and Python, allowing for one-click startup and providing a development environment for users [23]. Group 6: After-Sales and Maintenance - The company offers one year of after-sales support (excluding human damage), with free repairs for damages caused by operational errors or code modifications during the warranty period [46].