华为AI推理领域突破性成果前瞻：以存代算

Summary of Huawei's AI Inference Breakthroughs and Storage Innovations Industry and Company Involved - The document focuses on Huawei and its advancements in the AI inference field, particularly in the context of storage technology and its implications for the financial sector [1][2][4]. Core Points and Arguments - Huawei has introduced a fully flash storage server that utilizes SSD and NAND technology to enhance operational efficiency in the financial sector, aiming to reduce reliance on HBM (High Bandwidth Memory) while complementing it [1][2][3]. - The concept of "storage instead of computing" (以存代算) is highlighted as a trend in the industry, with companies like Kioxia and Micron also pursuing similar technologies to enhance AI model inference by moving vector data from DRAM to SSD [1][6]. - Huawei's innovations in SSD storage include the DOB (Die on Board) stacking packaging technology, which allows for ultra-high density and capacity hard drives, with a projected single disk capacity of nearly 256TB by 2025 [1][7]. - The self-developed HiSilicon SSD controller chips, Hi 1,812 and Hi 1,822, are crucial for managing data read/write processes, improving long-term read/write speeds, and extending hard drive lifespan, which is vital for AI development [1][7]. Additional Important Content - The development of AI necessitates higher data storage requirements, with SSD being essential due to its ability to retain data integrity after power loss, making it a critical component of AI systems [4][8][9]. - The "storage instead of computing" approach enhances AI model inference by pre-storing intermediate computation results on SSDs, thus reducing real-time computation demands and improving system memory capabilities [5][12]. - Huawei's position in the storage industry is significant, as it not only develops its technology but also promotes it through agents like Tianyuan Dike and Jinhua Wei [10]. - Key technologies and companies to watch in the hardware space include ACG controller chips and high-density SSD control chips, with companies like Hongrida benefiting from cooling solutions for these technologies [11]. Future Directions - The future of storage technology is moving towards "storage instead of computing," emphasizing memory capabilities to enhance computational efficiency, a direction that is being pursued globally by various enterprises [12][13].