模型推理

Search documents
联想申请一种模型推理方法及电子设备专利,可基于第三向量和目标向量确定推理结果
Jin Rong Jie· 2025-08-06 12:32
Group 1 - Lenovo (Beijing) Co., Ltd. has applied for a patent titled "A Model Inference Method and Electronic Device," with publication number CN120430411A, and the application date is April 2025 [1] - The patent abstract reveals a method for model inference that includes determining first and second vectors based on the acquired text, processing the first vector to determine a third vector with a smaller dimension and a greater head count than the first vector [1] - The company was established in 1992 and is primarily engaged in the manufacturing of computers, communications, and other electronic devices, with a registered capital of 565 million Hong Kong dollars [1] Group 2 - Lenovo (Beijing) Co., Ltd. has made investments in 107 companies and participated in 5,000 bidding projects [1] - The company holds 1,751 trademark records and 5,000 patent records, along with 238 administrative licenses [1]
周鸿祎:360最近都采购华为芯片,国产性价比高
Nan Fang Du Shi Bao· 2025-07-23 14:03
Group 1 - The gap between domestic chips and Nvidia is acknowledged, but the necessity to use domestic products is emphasized for improvement [1] - 360 Group has recently procured Huawei's chip products, indicating a shift towards domestic technology [1] - Nvidia's H20 chip has been approved for sale to China, which is more suitable for model inference, providing opportunities for domestic AI chips [2] Group 2 - DeepSeek has contributed significantly to the popularity of inference models, although it recently experienced a decline in monthly active users [2] - The decline in DeepSeek's application traffic is not solely negative, as many cloud vendors still rely on DeepSeek's model services [2] - The performance enhancement of open-source models has laid the foundation for the booming AI agents this year, which are seen as key to AI implementation [3] Group 3 - AI coding has emerged as a hot vertical direction for AI agents, with a focus on engineering capabilities like context and prompt engineering [3] - The development of specialized AI agents tailored to different industries is recommended to create unique technical barriers [3] - The potential disruptive future of AI agents has led to significant changes in operational strategies within companies, with a push for efficiency through AI utilization [3]
AI算力需求涌向模型推理,国产芯片站上竞技台了
Di Yi Cai Jing· 2025-05-28 07:22
Core Insights - The Chinese data center accelerator card market is experiencing a significant shift, with domestic computing power expected to exceed 40% in the first half of 2024, up from approximately 30% last year [1][2] - NVIDIA's CEO highlighted the ongoing AI investment trend, indicating that the demand for AI computing power is evolving, particularly with the rise of inference chips [1][8] - The introduction of DeepSeek has led to a notable increase in the demand for inference chips, which are expected to constitute over 57.6% of the market by 2024 [8][11] Market Dynamics - The construction of data centers is accelerating, with a projected 97.3% year-on-year growth in China's accelerated computing server market in 2024 [4] - The number of successful bids for intelligent computing centers in China has increased significantly, indicating a robust demand for computing resources [4] - Universities and enterprises are increasingly seeking computing power, with many opting for cloud solutions or purchasing their own computing cards [5][6] Technological Shifts - The demand for inference capabilities is reshaping the chip composition in the market, allowing domestic chips to gain traction as they are suitable for inference tasks [11][12] - The performance requirements for inference chips are lower, enabling a broader range of domestic chips to compete effectively against NVIDIA [10][11] - Companies like Tencent are adapting to the changing landscape by increasing their focus on inference needs, indicating a shift in AI application strategies [9][13] Competitive Landscape - NVIDIA's market share in China's data center accelerator card market has decreased from 95% to around 65.2%, while domestic chip manufacturers are gaining ground [11][13] - The introduction of export controls on NVIDIA's chips has prompted the company to consider launching a new AI chip tailored for the Chinese market [13] - Domestic AI chip manufacturers, such as Cambricon, are beginning to report profitability, reflecting a positive trend in the domestic chip market [12]