华为，AI突破将发布

Core Insights - Huawei is set to release a groundbreaking technology in the AI field on November 21, which aims to address the efficiency challenges in computing resource utilization [2] - The upcoming technology is expected to enhance the utilization rate of GPU and NPU resources from the industry average of 30%-40% to 70%, significantly unlocking the potential of computing hardware [2] - The technology will enable unified resource management and utilization of computing power from Nvidia, Ascend, and other third-party sources through software innovation, thereby providing more efficient support for AI training and inference [2] - Huawei's technology shares commonalities with the core technology of Israeli AI startup Run:ai, which was acquired by Nvidia for $700 million at the end of 2024 [2] - Run:ai has focused on GPU scheduling technology since its establishment in 2018, aiming to create a platform that allows AI models to run in parallel, regardless of whether the hardware is on-premises, in the cloud, or at the edge [2] Technical Insights - Managing workloads for generative AI, recommendation systems, and search engines requires complex scheduling to optimize system and underlying hardware performance [3] - Run:ai's core product is a software platform built on Kubernetes, designed for scheduling GPU computing resources. It employs dynamic scheduling, pooling, and sharding techniques to optimize GPU resource utilization, enabling efficient execution of deep learning training and inference tasks in enterprise environments [3]