“DeepSeek-V3基于我们的架构打造”，欧版OpenAI CEO逆天发言被喷了

Core Viewpoint - The article discusses the competitive landscape between Mistral and DeepSeek in the AI field, particularly focusing on the architecture of their models and the implications of their recent statements and research papers [1][2][3]. Group 1: Mistral's Position and Statements - Mistral's CEO, Arthur Mensch, acknowledges China's strong development in AI and claims that open-source models are a successful strategy [2]. - Mensch expresses confidence in Mistral's contributions to the field, stating that their models are built on a foundation of open architecture [3][5]. - The recent statements from Mistral have sparked skepticism among the online community, with some questioning the validity of their claims [5][26]. Group 2: Comparison of DeepSeek and Mistral Models - Both DeepSeek and Mistral's models are based on sparse mixture of experts (SMoE) systems, aiming to reduce computational costs while enhancing model capabilities [13]. - The Mixtral model focuses on engineering aspects, emphasizing the combination of a strong base model with mature MoE technology, while DeepSeek prioritizes algorithmic innovation to address issues in traditional MoE architectures [14][15]. - DeepSeek introduces a fine-grained expert segmentation approach, allowing for more flexible combinations of smaller experts, which contrasts with Mixtral's standard MoE design [20]. Group 3: Technical Differences - The routing mechanisms differ significantly: Mixtral employs a flat knowledge distribution among experts, while DeepSeek utilizes shared experts for general knowledge and routing experts for specific knowledge [22]. - DeepSeek's architecture modifies the gating mechanism and expert structure compared to traditional MoE, leading to a more decoupled knowledge distribution [19][22]. - The mathematical formulations of both models highlight their differences, with DeepSeek's approach allowing for more precise knowledge acquisition [18][19]. Group 4: Community Reactions and Future Outlook - The online community has reacted critically to Mistral's claims, suggesting that they have borrowed heavily from DeepSeek's architecture [24][26]. - There is a sentiment that Mistral, once a pioneer in the open-source model space, is now facing challenges in maintaining its innovative edge [28]. - The competition between foundational models is expected to intensify, with DeepSeek already targeting upcoming releases [30][31].