Workflow
中金公司电子掘金 大模型如何下沉终端?一体机及AI SoC重构智能范式
601995CICC(601995) 中金·2025-03-10 06:49

Investment Rating - The report indicates a positive investment outlook for the integrated machine and AI SoC sectors, particularly in the context of AI model deployment and local data security needs [3][11]. Core Insights - The demand for integrated machines has surged following the release of the Deep Seek AI model, with significant interest from government and enterprise sectors due to their data security requirements [3]. - The integrated machine is designed for AI model applications, effectively shortening deployment cycles and lowering barriers to entry, with a projected demand of 70,000 units in the government and enterprise sectors by 2025, translating to a market size of 54 billion yuan [3][11]. - The Deep Seek distilled small parameter models demonstrate excellent performance on terminal devices, achieving real-time question answering with a 1.5B model and suitable for text summarization and image description with 7B/8B models, requiring a minimum of 4-5GB of memory under INT4 quantization [3][5]. - Domestic computing power is expected to play a crucial role in the integrated machine sector, aligning well with mainstream downstream demands, although challenges in software-hardware collaboration remain [3][7]. - Quantization techniques are highlighted as a means to reduce AI hardware costs by converting model parameters from 16-bit floating-point to 8-bit integers, thus decreasing model size and computational complexity [3][8][9]. - The report notes a significant reduction in AI inference costs, which is driving the trend towards edge computing, with lightweight AI hardware gaining advantages in both edge and cloud environments [3][15]. - In the smart automotive sector, companies are integrating AI technologies to enhance smart cockpit functionalities, with BYD leading the way in adopting new AI chips in its vehicles [3][17]. - The domestic automotive chip sector is making strides, with companies like Yikatong collaborating with Volkswagen to export new SOC chips, indicating a growing acceptance of domestic chips in international markets [3][20]. Summary by Sections Integrated Machines - Integrated machines are tailored for AI model applications, providing a plug-and-play computing solution that meets high data security requirements for sectors like government and finance [4][10]. - The projected demand for integrated machines in the Chinese server market is expected to reach approximately 70,000 units by 2025, with a market potential of 54 billion yuan [11]. AI Model Performance - The Deep Seek distilled models are effective in reducing hardware resource requirements while maintaining performance, making them suitable for various applications [5][16]. Domestic Computing Power - The report emphasizes the importance of domestic computing power in the integrated machine sector, with a need to overcome challenges related to precision support in AI chips [7]. Cost Reduction Techniques - Techniques such as fixed-point quantization are crucial for lowering AI hardware costs and improving overall efficiency [8][9]. Smart Automotive Sector - The integration of AI in smart vehicles is on the rise, with significant advancements in automotive chip technology and collaborations with international partners [17][20].