商用终端设备和系统

Search documents
70B模型能当零售业区域经理!小模型加速端侧落地,芯片不一定要GPU
Di Yi Cai Jing· 2025-06-04 08:47
Core Insights - The retail industry is increasingly adopting AI applications, with smaller models being utilized for various tasks such as customer flow prediction and product inspection [2][3][5] - The cost of implementing AI models in retail can be significantly reduced, with 14B models costing around 10,000 yuan when using GPUs, and even lower costs achievable with CPUs [1][8][9] - The trend towards model miniaturization allows for effective AI deployment in edge scenarios, where high-performance GPUs are not always necessary [2][8] Group 1: AI Model Applications in Retail - Smaller AI models (8B to 70B parameters) are being used for tasks like customer flow prediction, product inspection, and simple report analysis [2][3] - AI applications in retail have evolved from basic functions like automatic product recognition to more complex tasks such as self-service loss prevention [3][5] - The introduction of AI in retail is driven by the redundancy of computing power in existing systems, allowing for the integration of AI without significant hardware upgrades [3][5] Group 2: Cost and Efficiency of AI Implementation - The cost of deploying AI models in retail is becoming more manageable, with 14B models costing around 10,000 yuan and 32B models offering a good balance of cost, efficiency, and accuracy [8][9] - Retailers are exploring the use of consumer-grade GPUs and CPUs for running smaller models, reducing the need for expensive hardware [8][9] - The implementation of AI in retail can lead to significant cost savings, with estimates suggesting that using AI can reduce operational costs for staff [8][9] Group 3: Future Trends in AI and Chip Technology - The development of edge computing capabilities is expected to enhance the performance of AI applications in retail, with ongoing advancements in CPU technology [9][10] - The market for AI in retail is anticipated to grow, with different CPU manufacturers competing for market share, particularly in the context of energy efficiency and performance [10] - The integration of AI into retail operations is seen as a transformative trend, with potential for new functionalities and improved customer experiences [7][10]