Workflow
雷峰网
icon
Search documents
昇腾杀手锏FlashComm,让模型推理单车道变多车道
雷峰网· 2025-05-22 11:29
Core Viewpoint - The article discusses the communication challenges faced by MoE (Mixture of Experts) models in large-scale inference and how Huawei has addressed these issues through innovative solutions to optimize performance. Group 1: Communication Challenges - The rapid growth of MoE model parameters, often exceeding hundreds of billions, poses significant storage and scheduling challenges, leading to increased communication bandwidth demands that can cause network congestion [6][10]. - Traditional communication strategies like AllReduce have limitations, particularly in high concurrency scenarios, where they contribute significantly to end-to-end inference latency [7][11]. - The tensor parallelism (TP) approach, while effective in reducing model weight size, faces challenges with AllReduce operations that exacerbate overall network latency in multi-node deployments [7][12]. Group 2: Huawei's Solutions - Huawei introduced a multi-stream parallel technology that allows for simultaneous processing of different data streams, significantly reducing key path latency and improving performance metrics such as a 10% speedup in the Prefill phase and a 25-30% increase in Decode throughput for the DeepSeek model [12][14]. - The AllReduce operation has been restructured to first sort data intelligently (ReduceScatter) and then broadcast the essential information (AllGather), resulting in a 35% reduction in communication volume and a performance boost of 22-26% in the DeepSeek model's Prefill inference [14][15]. - By adjusting the parallel dimensions of matrix multiplication, Huawei achieved an 86% reduction in communication volume during the attention mechanism transition phase, leading to a 33% overall speedup in inference [15][19]. Group 3: Future Directions - Huawei plans to continue innovating in areas such as multi-stream parallelism, automatic weight prefetching, and model parallelism to further enhance the performance of large-scale MoE model inference systems [19][20].
追觅跨界大家电:以技术复利+无界生态改写行业规则
雷峰网· 2025-05-22 11:29
Core Viewpoint - The article discusses the strategic entry of Chasing Technology into the traditional home appliance market, emphasizing its reliance on technological compounding and ecological synergy to disrupt a market dominated by established players like Midea, Haier, and Gree [2][17]. Market Dynamics and Opportunities - The Chinese home appliance market is experiencing a significant shift, with an expected release of over 1 trillion yuan in market space over the next three years due to a wave of replacements driven by the aging of existing appliances and government policies promoting trade-ins [3][18]. - Chasing Technology aims to leverage its core technological capabilities, such as high-speed digital motors and intelligent algorithms, to tap into the overlooked 99% of market potential, contrasting with competitors focused on narrow segments [3][4]. Technological Leverage - Chasing Technology is applying its existing technologies from the cleaning appliance sector to new categories like refrigerators, air conditioners, and kitchen appliances, aiming for a "technology leverage effect" [3][4]. - The company is also working on overcoming technical barriers in key components of home appliances, such as compressors in air conditioners, which account for 30% to 40% of the total cost [4][10]. Ecological Collaboration and Scale Barriers - The company has adopted an "ecological" approach, reusing core technologies and supply chain capabilities across various product lines, which helps reduce costs and accelerate market entry [6][8]. - The home appliance industry is characterized by high capital requirements and long cycles, necessitating continuous investment in both funding and research and development [7][9]. Competitive Strategy - Chasing Technology is diversifying its product offerings while maintaining competitiveness across multiple fronts, including supply chain collaboration and the establishment of "lighthouse factories" to enhance production capacity [8][10]. - The company is focusing on a balanced investment strategy across short, medium, and long-term projects to ensure steady growth and maintain a competitive edge in research and development [10][17]. User Co-Creation - Unlike traditional home appliance companies, Chasing Technology employs a user co-creation model in product development, allowing customers to vote on features, which ensures alignment with market demands [12][13]. - This approach reduces market misjudgments and enhances feedback loops, particularly important for high-involvement purchases like air conditioners and refrigerators [13][14]. Brand and Market Positioning - Chasing Technology is building brand recognition and consumer trust through its established presence in the smart cleaning sector, which can be leveraged as it enters the home appliance market [15][18]. - The company is also developing a comprehensive service system that includes marketing, distribution, installation, and after-sales support, crucial for competing in the home appliance sector [15][18]. Conclusion - The journey of Chasing Technology into the home appliance market represents an exploration of "corporate boundaries," combining rational calculations of technological compounding with ambitious ecological visions [17][18]. - The success of Chasing Technology will depend on its ability to navigate supply chain restructuring, overcome scale and channel barriers, and reshape consumer perceptions in a highly competitive landscape [17][18].
B站2025年Q1财报:手游大增76%,净利润扭亏为盈
雷峰网· 2025-05-22 00:23
Core Viewpoint - Bilibili (B站) has exceeded profit expectations in Q1 2025, showcasing strong revenue growth driven by its gaming and advertising sectors, indicating significant potential for further commercialization [2][4][5]. Financial Performance - Bilibili's Q1 2025 revenue reached 7.0 billion RMB, a 24% year-on-year increase [2]. - Advertising revenue was 2.0 billion RMB, up 20% year-on-year, while mobile game revenue surged to 1.73 billion RMB, marking a 76% increase [2]. - The gross profit for the quarter was 2.54 billion RMB, reflecting a 58% year-on-year growth, with a gross margin of 36.3%, an improvement from 28.3% in the same quarter of the previous year [4]. Gaming Sector - The game "Three Kingdoms: Strategize the World" significantly contributed to the mobile game revenue, being well-received for its user-friendly features [8][10]. - Bilibili's CEO emphasized a long-term operational strategy for games, focusing on user engagement and feedback to enhance game quality [11][12]. - The company is preparing to launch four to five new games, awaiting approval for their licenses [14]. Advertising Growth - Bilibili's daily active users (DAU) reached 107 million, while monthly active users (MAU) hit a record 368 million, with users spending an average of 108 minutes daily on the platform [16]. - The advertising sector saw a significant boost, with AI-related advertising revenue increasing by nearly 400% year-on-year, driven by a growing user interest in AI content [17]. - The top five industries contributing to advertising revenue included gaming, online services, e-commerce, home appliances, and automotive [16]. Content Strategy - Bilibili is committed to maintaining a focus on high-quality content, which is seen as essential for user retention and engagement [18]. - The platform has evolved from a niche community to a diverse content hub, enhancing user experience while preserving its unique cultural identity [19][20].
快手被曝要求员工每日刷1小时短视频,未达标将影响绩效;曝一汽南京公司全员解散:赔偿N+4;余承东称自己发烧38度仍坚持上班;
雷峰网· 2025-05-22 00:23
要闻提示 NEWS REMIND 1. 众泰汽车亏损10亿元销量仅14辆,高管薪酬却高达954.91万元,一众高管被警示 2. 曝一汽南京公司全员解散:赔偿N+4或回总部调岗不赔偿 3. 曝快手鼓励员工带薪刷短视频,每天须刷一小时,未达标将影响绩效 4. 余承东称自己发烧38度仍坚持上班:自嘲意志力过强也是有问题 众泰汽车亏损10亿元销量仅14辆,高管薪酬却高达954.91万元,一众高管被警示 5月21日消息,据报道,日前,浙江证监局发布关于对众泰汽车及公司董事长胡泽宇等7人采取出具警示函 措施的决定。浙江证监局披露显示,1月15日,众泰汽车披露《关于前期会计差错更正及追溯调整的公 告》,对披露的2021年—2024年半年度相关定期报告财务数据进行更正。上述事项反映出公司此前披露 的相关报告财务信息不准确。 而在4月份,众泰汽车发布的2024年业绩报告显示,2024年,众泰汽车营业收入为5.58亿元,同比下滑 23.96%;归属于上市公司股东净利润为-10亿元,同比增亏6.82%;归属于上市公司股东的扣非净利润 为-14.69亿元,同比增亏49.28%。高管薪酬方面,2024年众泰汽车董监高薪酬总额达954. ...
百度Q1财报:总营收325亿元,智能云同比增速达42%
雷峰网· 2025-05-21 13:08
无人驾驶方面,截至2025年5月,萝卜快跑在全球累计提供超1100万次的出行服务。今年一季度,萝卜 快跑在全球提供超140万次出行服务,同比增长75%。 一季度,萝卜快跑全球化加速,进入迪拜和阿布扎比。目前,萝卜快跑已在迪拜开启公开道路验证测试; 在香港的测试区域也得到进一步扩大。此外, Apollo与神州租车达成战略合作,将共同打造全球首个 自 动驾驶汽车 租赁服务。 财报显示,3月,百度APP月活用户达7.24亿,同比增长7%。4月28日,百度发布年度ESG报告,详细介 绍了百度最新的ESG政策和可持续发展举措。 年度ESG报告可点击下方链接 查看: https://esgs.cdn.bcebos.com/2025/04/28/a2/39a2aaa4f728f4e2d0aebaff346c045e.pdf " 百度Q1智能云增速达42%,萝卜快跑全球出行服务次数超1100 万 " 作者丨李希 5月21日晚,百度发布2025年第一季度财报,显示一季度总营收达325亿元,百度核心 营收 255亿元, 同比增长7%,均超市场预期。一季度,百度核心净利润同比增48%至76.3 亿元,智能云持续强劲增长, 同比增速 ...
小米中央空调:「真格」搅局还是「虚招」试水?
雷峰网· 2025-05-21 13:08
" 或许无法登顶,但足以改变游戏规则。 " 作者丨徐陟 编辑丨刘伟 这一消息不仅意味着小米在空调领域的战略升级,更折射出其从"性价比标签"向"高端化生态"转型的深层 逻辑。 因为就在两个月前,米家中央空调Pro开售之际,卢伟冰就曾在社交平台上表示,米家空调今年销量会保 持50%以上的增长速度,全面发力高端,ASP会持续上升。同时他还透露了小米的目标:全年公开市场销 量目标第3,未来5年成为数一数二的空调品牌。 从手机到空调,再到汽车,小米的每一次跨界都伴随着争议与期待。而这一次,在传统巨头盘踞、行业壁 垒森严的中央空调市场,小米的野心究竟是品牌高端化的"面子工程",还是真刀真枪的市场争夺?答案或 藏于其战略逻辑、能力禀赋与行业壁垒的复杂交织中。(小米中央空调是"阳谋"入高端局,还是"虚招"试 探市场水温?欢迎添加微信 Angiee0620 交流不同观点) 01 品牌升级的阳谋 小米进军中央空调的动机,始终与品牌调性重塑深度绑定。 自2013年以"价格屠夫"形象切入家电市场以来,小米长期被贴上了"性价比"标签。然而,于小米而 言,"性价比"标签既是其快速扩张的利器,也是高端化转型的桎梏。 据奥维云网数据,202 ...
网易将至未至的「大DAU」野望,藏在520的夜幕里
雷峰网· 2025-05-21 13:08
Core Viewpoint - The article discusses the recent game announcements by NetEase, highlighting the company's strategy to diversify its game offerings and seek opportunities in the global market, particularly through platforms like Steam, while navigating the competitive landscape dominated by Tencent [2][7]. Group 1: Game Announcements and Strategy - On May 20, NetEase announced over 40 new games, including 9 that are not yet officially launched in China, following a strong Q1 performance that exceeded industry expectations, resulting in a 14% increase in its US stock [2]. - The release strategy appears to focus on a mix of self-developed and IP collaboration projects, with a significant emphasis on global distribution through Steam, indicating a shift towards international markets [2][7]. - The game "SUPERVIVE," a pure import, has received over 17,000 positive reviews since its release, showcasing the potential for successful game adaptations [3]. Group 2: Market Opportunities and Challenges - The article notes a potential market opportunity for NetEase with the game "无主星渊," which could attract players looking for alternatives to Tencent's offerings in the "search and destroy" genre, especially given the current fatigue with existing popular games [5]. - There is a suggestion that the IP "命运:群星" may be overvalued in terms of its commercial potential, as its appeal in China is limited compared to its performance on platforms like PS and Steam [6]. - The article emphasizes that despite the industry's innovation fatigue, NetEase's approach of embracing global markets through Steam could allow it to connect with a more discerning player base, thus avoiding direct competition with Tencent [7][8].
昇腾超大规模MoE模型推理优化技术揭秘:MTP调度10倍提速,INT打平FP8
雷峰网· 2025-05-21 13:08
" 华为最新的两个重要推理技术结合,还会激发出哪些AI创新? " 作者丨李希 大模型推理来到加速时代 随着以DeepSeek V3/R1 为代表的超大规模M oE 模型走向主流,如果对如此超高参数量的模型进行推理 优化成了业界普遍关注的议题。作为目前普遍采用的大模型推理加速技术之一,投机推理为大模型生成推 理草稿,一次生成多个token,但面临调度时延过高,算力浪费的问题,就此华为团队提出投机推理框架 FusionSpec,持续提升 MTP 投机在昇腾上的推理性能,使其调度耗时从10ms降为1ms;而作为另一加 速推理的技术,量化技术是DeepSeek模型采用FP8进行训练的核心,而推理时采用Int8部署,亟需突破 FP8到int8的无损量化,为此华为团队也提出了O pti Quant量化框架和算法,让INT 8 性能可以打平FP 8 。下面就分别介绍华为团队的这两个创新技术 高吞吐推理投机,昇腾超大规模MoE模型推理的加速利器 1、何为投机推理技术? 在大语言模型(LLMs)的应用中,推理速度是影响用户体验和应用效率的关键因素。传统的自回归解码 方式,每次仅能生成一个输出 token,且需将历史输出作为输入 ...
独家丨东风华为首款越野车将上市,预计售价50万元内
雷峰网· 2025-05-21 07:36
Core Viewpoint - The article discusses the launch of the Mengshi M817, the first model built on Huawei's "Tianyuan Architecture," positioning it as the "smart off-road first car" in the market [1]. Group 1: Product Overview - The Mengshi M817 is set to be launched around the Chengdu Auto Show, targeting the off-road market with an expected price range of 400,000 to 500,000 yuan [2]. - The vehicle is a result of a strategic partnership between Mengshi Technology and Huawei, marking Mengshi as the fourth company to adopt Huawei's HI model after BAIC, Changan, and Dongfeng [2]. - The M817 will feature a high level of integration with Huawei's technologies, including the latest intelligent driving system "Kunlun Intelligent Driving ADS 4.0," HarmonyOS smart cockpit, and Huawei Cloud [3]. Group 2: Strategic Significance - The collaboration aims to combine Dongfeng's military-grade quality with Huawei's smart capabilities, expanding the Mengshi brand from high-end off-road vehicles to urban intelligent driving scenarios [3]. - The M817 is designed to cater not only to outdoor off-roading but also to urban commuting and long-distance travel, indicating a versatile market approach [3]. - The success of the M817 in the market will depend on whether its high technological integration can translate into sales [3].
苹果渠道收缩,是战略远见还是无奈妥协?
雷峰网· 2025-05-21 07:36
" 渠道「对内开刀」,以退为进能否守得住战线。 " 作者丨雪银 编辑丨相辉 618将近,苹果今年动作频频。 据媒体报道,5月10日,苹果向渠道商下发了调价通知,除iPhone 16 Pro的128GB版本降价176美元, 折合人民币1445.27元,iPhone 16 Pro 其他版本和iPhone 16 Pro Max所有容量版本均降价160美元。 今年的"6·18"活动将于5月13日开始,有渠道商认为苹果此次调价就是在为即将到来的"6·18"大促做准 备。 iPhone前所未有的降价力度和京东、拼多多等电商平台"斗法"有很大关系,近年拼多多正在追求品牌化和 高端化,苹果品牌无疑是其实现转型的优质抓手。很长一段时间,3C业务有口皆碑的京东被当做苹果手机 的进货平台,大量黄牛从京东低价进货,再抬价出售给拼多多和各大分销商,一石三鸟之下受伤的只有苹 果自己和老实巴交的经销商们。 全渠道时代下的电商平台是苹果未来在中国走向零售化的过程中不可忽视的重要阵地,也是进一步优化渠 道布局、规范价格体系不可绕过的一环。 苹果这两年在线下渠道管理方面的动作也不小,线下作为目前手机销售的主阵地,各大手机厂商都在持 续"扩店洗商 ...