Core Viewpoint - The article emphasizes the significance of "multimodal intelligence" as a key trend in the development of large models, particularly highlighted during the WAIC 2025 conference, where SenseTime introduced its commercial-grade multimodal model, "Riri Xin 6.5" [1][2]. Group 1: Importance of Multimodal Intelligence - Multimodal intelligence is deemed essential for achieving Artificial General Intelligence (AGI) as it allows AI to interact with the world in a more human-like manner, processing various forms of information such as images, sounds, and text [7][8]. - The article discusses the limitations of traditional language models that rely solely on text data, arguing that true AGI requires the ability to understand and integrate multiple modalities [8]. Group 2: Technical Pathways to Multimodal Models - SenseTime has identified two primary technical pathways for developing multimodal models: Adapter-based Training and Native Training. The latter is preferred as it allows for a more integrated understanding of different modalities from the outset [11][12]. - The company has committed significant computational resources to establish a "native multimodal" approach, moving away from a dual-track system of language and image models [10][12]. Group 3: Evolutionary Path of Multimodal Intelligence - SenseTime outlines a "four-breakthrough" framework for the evolution of AI capabilities, which includes advancements in sequence modeling, multimodal understanding, multimodal reasoning, and interaction with the physical world [13][22]. - The introduction of "image-text intertwined reasoning" is a key innovation that allows models to generate and manipulate images during the reasoning process, enhancing their cognitive capabilities [16][18]. Group 4: Data Challenges and Solutions - The article highlights the challenges of acquiring high-quality image-text pairs for training multimodal models, noting that SenseTime has developed automated pipelines to generate these pairs at scale [26][27]. - SenseTime employs a rigorous "continuation validation" mechanism to ensure data quality, only allowing data that demonstrates performance improvement to be used in training [28][29]. Group 5: Model Architecture and Efficiency - The focus on efficiency over sheer size in model architecture is emphasized, with SenseTime optimizing its model to achieve over three times the efficiency while maintaining performance [38][39]. - The company believes that future model development will prioritize performance-cost ratios rather than simply increasing parameter sizes [39]. Group 6: Organizational and Strategic Insights - SenseTime's success is attributed to its strong technical foundation in computer vision, which has provided deep insights into the value of multimodal capabilities [40]. - The company has restructured its research organization to enhance resource allocation and foster innovation, ensuring a focus on high-impact projects [41]. Group 7: Long-term Vision and Integration of Technology and Business - The article concludes that the path to AGI is a long-term endeavor that requires a symbiotic relationship between technological ideals and commercial viability [42][43]. - SenseTime aims to create a virtuous cycle between foundational infrastructure, model development, and application, ensuring that real-world challenges inform research directions [43].
商汤林达华万字长文回答AGI：4层破壁，3大挑战