语义信息论
Search documents
大模型的第一性原理:(一)统计物理篇
机器之心· 2025-12-11 10:00
机器之心发布 作者: 白铂 博士 白铂 博士,华为 2012 实验室理论研究部主任 信息论首席科学家 2022 年底,ChatGPT 横空出世,其能力震惊了整个世界。2024 年底,DeepSeek 以极低的训练成本和极高的性能再次震惊了世界。短短几年间,大模型疯狂迭代, 能力不断提升,仅在美国,AI 领域的投资规模便超过了许多国家全年的 GDP!2025 年底,Google 强势推出 Gemini 3,模型能力突飞猛进,TPU 训练范式也对英 伟达的生态发起了颠覆式挑战。 业界普遍认为 Gemini 3 是迈向通用人工智能(Artificial General Intelligence,AGI) 和超级人工智能(ASI,Artificial Super Intelligence,ASI)的关键突破,是人类 和机器合作的惊人之作。然而,正如 Ilya Sutskever 于 11 月 26 日的访谈中指出:大模型 Scaling Law 和摩尔定律一样,迟早会因为物理限制而失效。因此,如何打 开大模型训练的炼丹炉,看清黑盒子背后的基本原理,回答大模型是否已逼近其能力极限就成为迫在眉睫的问题了。但是,前人对大模 ...
研发6G技术,赋能智慧转型
Ren Min Ri Bao· 2025-11-04 07:40
Core Insights - The article emphasizes the urgent need for a paradigm shift in communication technology to meet the demands of the AI era, particularly through the introduction of "6G Intelligent Simplification" [1][3] - The development of a new theoretical framework, "Semantic Information Theory," is crucial for advancing 6G technology and moving away from traditional Western theories [2] - The "6G Intelligent Simplification" network is expected to drive significant advancements across various industries, enabling smart transformations and breaking down data silos [3][4] Summary by Sections Section 1: Technological Breakthroughs - The integration of AI into communication systems is proposed to enhance efficiency and reduce bandwidth and energy consumption [1] - The traditional communication model is becoming inefficient in handling massive data generated by smart devices [1] Section 2: Theoretical Foundations - A new semantic information theory framework has been established, differentiating it from classical information theory and addressing scientific issues related to both [2] - The team has successfully implemented practical applications, including a long-distance semantic communication test and the development of semantic communication chips [2] Section 3: Future Prospects - The "6G Intelligent Simplification" network is anticipated to facilitate intelligent collaboration across various sectors, including smart transportation and remote healthcare [3] - The team aims to continue advancing the theory and technology of intelligent communication, transitioning from passive information transmission to active intent understanding and resource collaboration [4]
迈向“十五五”的创新图景|研发6G技术,赋能智慧转型
Ren Min Ri Bao· 2025-11-04 05:45
Core Insights - The article emphasizes the rapid breakthroughs in key core technologies and the increasing number of leading innovations in the field, highlighting the deep integration of technological and industrial innovation, which significantly enhances the role of innovation [1] Group 1: 6G Technology Development - The traditional communication technology paths are reaching physical limits, necessitating a shift to meet the bandwidth demands of the AI era, with the proposed solution being "6G Intelligent Simplification" [2] - The "6G Intelligent Simplification" aims to transform communication from merely transporting bits to accurately understanding task intentions through the integration of AI, significantly improving communication efficiency while reducing bandwidth and energy consumption [2][3] - A new theoretical framework for semantic information theory has been established, differentiating it from classical information theory, which allows for independent research and development of China's 6G technology [3] Group 2: Practical Applications and Collaborations - The team has successfully built the world's first 6G intelligent communication test network, achieving long-distance semantic communication over 1200 kilometers, and has developed semantic communication chips that are now widely used [3] - The "6G Intelligent Simplification" concept has gained consensus among multiple operators, equipment manufacturers, and academic institutions, contributing to the international standardization of 6G technology [3][4] Group 3: Future Prospects - The mature "6G Intelligent Simplification" network is expected to be a crucial engine for unleashing the multiplier effect of data elements, breaking down data silos, and enabling intelligent collaboration across various sectors, thus driving a positive cycle of technological breakthroughs, data circulation, and industrial upgrades [4] - The team plans to continue advancing the theory and technology of intelligent communication, transitioning 6G systems from passive information transmission to active intent understanding and resource collaboration [5]
研发6G技术 赋能智慧转型(迈向“十五五”的创新图景)
Ren Min Ri Bao· 2025-11-03 22:47
Core Insights - The article emphasizes the urgent need for a paradigm shift in communication technology to meet the demands of the AI era, particularly through the introduction of "6G Intelligent Simplification" [1][4] - The development of a new theoretical framework, "Semantic Information Theory," is crucial for advancing 6G technology and moving away from traditional Western theories [2] - The "6G Intelligent Simplification" network is expected to drive significant advancements across various industries, enabling smart transformation and breaking down data silos [3] Group 1 - The traditional communication methods are reaching their physical limits, necessitating innovative solutions to enhance bandwidth and efficiency in the 6G era [1] - The introduction of AI into communication systems aims to transform the current model from mere data transmission to understanding task intentions, significantly improving efficiency and reducing resource consumption [1][2] - The team has established the first international field test network for 6G, achieving long-distance semantic communication, and has developed a semantic communication chip that is already in large-scale use [2] Group 2 - The "6G Intelligent Simplification" network is projected to facilitate a positive cycle of technological breakthroughs, data circulation, and industrial upgrades in sectors like smart transportation, telemedicine, and industrial internet [3] - The research team is committed to further developing the theoretical and technical aspects of intelligent communication, aiming to transition from passive information transmission to active intent understanding and resource collaboration [4] - The team is collaborating with various operators, equipment manufacturers, and academic institutions to contribute to the international standardization of 6G semantic communication technology [2]
研发6G技术,赋能智慧转型(迈向“十五五”的创新图景)
Ren Min Ri Bao· 2025-11-03 22:20
Core Insights - The article emphasizes the urgent need for a paradigm shift in communication technology to meet the demands of the AI era, particularly through the introduction of "6G Intelligent Simplification" [1][4] - The development of a new theoretical framework, "Semantic Information Theory," is crucial for advancing 6G technology and moving away from traditional Western theories [2] - The "6G Intelligent Simplification" network is expected to drive significant advancements across various industries, enabling smart transformation and breaking down data silos [3] Group 1: Technological Advancements - The traditional communication methods are becoming inefficient in handling the massive data generated by AI and IoT, necessitating a new approach [1][4] - "6G Intelligent Simplification" aims to enhance communication efficiency by integrating AI into the communication system, transforming it from mere data transmission to understanding task intentions [1][2] Group 2: Theoretical Foundations - The research team has established a new system of Semantic Information Theory, which clarifies the relationship and differences between semantic and classical information theories [2] - This theoretical advancement has led to practical implementations, including the first long-distance semantic communication tests in China [2] Group 3: Industry Impact - The mature "6G Intelligent Simplification" network is projected to facilitate intelligent collaboration across various sectors, including smart transportation, telemedicine, and industrial internet [3] - The team is collaborating with multiple operators and academic institutions to contribute to the international standardization of 6G technology [2][3]