熵
Search documents
信息论如何成为复杂系统科学的核心工具
3 6 Ke· 2025-12-24 08:51
关键词:信息论、熵、互信息、传递熵、整合信息(Φ)、部分信息分解(PID / PED)、O-信息 / Φᵣ、多尺度动力学 无论是气候变化、流行病传播、金融市场波动,还是大脑的认知功能,这些系统都由大量组件构成,组件间存在多样且动态的互动,因为这些 非平凡的互动具有如非线性、涌现、自适应和路径依赖等特征,导致其集体行为往往难以通过还原论预测。面对这些错综复杂的涌现现象,科 学家们迫切需要一套强大而普适的数学语言来对其进行描述、量化和理解。 起源于通信的信息论,因其能跨领域量化组件之间,系统与环境,整体与部分的互动,正逐渐成为复杂系统研究领域工具箱中不可或缺的一 环。本文旨在对Thomas F. Varley于2025年12月8日发表在《Physics Reports》上的这篇重要综述进行深入解读,系统阐述信息理论为何以及如何 成为复杂系统科学的基石,并详解其核心概念、进阶工具与实际应用。 想象一个天气预报。如果某地一年365天都是晴天,那么你对"明天天气"的不确定性为零,熵也为零。如果天气晴雨各半,你的不确定性最大,熵也最 高。因此,熵衡量的是在得知具体结果之前,我们对一个随机变量取值的"惊讶"程度的期望值。 ...
信息论如何成为复杂系统科学的核心工具
腾讯研究院· 2025-12-24 08:33
郭瑞东 本文 作者 陶如意 审校 无论是气候变化、流行病传播、金融市场波动,还是大脑的认知功能,这些系统都由大量组件构成, 组件间存在多样且动态的互动,因为这些非平凡的互动具有如非线性、涌现、自适应和路径依赖等特 征,导致其集体行为往往难以通过还原论预测。面对这些错综复杂的涌现现象,科学家们迫切需要一 套强大而普适的数学语言来对其进行描述、量化和理解。 起源于通信的信息论,因其能跨领域量化组件之间,系统与环境,整体与部分的互动,正逐渐成为复 杂系统研究领域工具箱中不可或缺的一环。本文旨在对Thomas F. Varley于2025年12月8日发表在 《Physics Reports》上的这篇重要综述进行深入解读,系统阐述信息理论为何以及如何成为复杂系统科 学的基石,并详解其核心概念、进阶工具与实际应用。 关键词:信息论、熵、互信息、传递熵、整合信息(Φ)、部分信息分解(PID / PED)、O-信息 / Φᵣ、多尺度动力学 信息理论的基石:核心概念与直觉构建 该文先详细讲解了信息理论的几个核心度量指标,从最基础的概念无疑是熵。据说香农在提出信息论之 后,找到冯诺依曼,询问他应该如何称呼新的不确定度量。 冯·诺 ...
宇宙的智能水平 :决定时空、不确定性、熵和统一三大物理理论的关键因素?
欧米伽未来研究所2025· 2025-08-20 13:00
Core Viewpoint - The article presents the "Generalized Agent Theory," proposing that the universe is a dynamic evolving agent, and agents are the fundamental units of the universe. This theory provides a new paradigm for understanding the universe's cognitive level and its profound impact on various fields such as physics, technology philosophy, and intelligent science [2][4][5]. Summary by Sections 1. Introduction to Generalized Agent Theory - Generalized Agent Theory, established in 2014, has undergone ten years of research and iteration, resulting in nearly ten published papers. By 2025, it has developed a framework consisting of four core modules: standard agent model, agent classification system, extreme point intelligent field model, and multi-agent relationship system [6][8]. 2. Structure of the Standard Agent Model - The standard agent model serves as the foundation of the theory, positing that any agent is fundamentally an information processing system composed of five essential functional modules: information input, information output, dynamic storage, information creation, and a control module coordinating the first four [8][10]. 3. Classification of Agents - Agents are classified into three types based on their functional capabilities: 1. Absolute zero agent (Alpha agent) with all functions at zero 2. Omniscient agent (Omega agent) with all functions at infinity 3. Finite agent with functions neither at zero nor infinity [10][11]. 4. Theoretical Implications - The first key implication is that the universe itself is a dynamic evolving agent, with the Omega agent representing a state of omniscience. If any part of the universe degrades from this state, it becomes a composite system of finite and absolute zero agents [11][12]. - The second implication is that the evolution of agents is driven by two fundamental forces: Alpha gravity, which drives agents towards the Alpha state, and Omega gravity, which drives them towards the Omega state. These forces create a field effect throughout the universe [12][13]. 5. Unique Value of Different Agent Levels - The framework allows for the exploration of three distinct models of the universe: 1. Absolute zero intelligence universe, serving as a logical starting point for analysis 2. Infinite intelligence universe, providing a perspective for conceptual integration and theoretical unification 3. Finite intelligence universe, aligning closely with the reality observed by humans [15][17]. 6. Understanding Uncertainty and Time-Space - The theory posits that the essence of entropy is closely related to the observer's intelligence level, suggesting that entropy arises from the limitations of finite observers in tracking all microstates. This leads to an increase in information loss, which is perceived as entropy [19][20]. 7. Unifying Physical Theories - The differences among the three major physical theories (classical mechanics, relativity, and quantum mechanics) stem from the intelligence levels of their observers. The theory proposes a spectrum of intelligence levels that can explain the variations in physical phenomena observed under different conditions [21][25]. 8. Conclusion - The article emphasizes the need for further exploration of foundational scientific concepts and their intrinsic relationships with the intelligence levels of the universe and observers, indicating that many important theoretical issues await in-depth research [26][28].
当代的回响——欧美艺术家联展| 吉恩·卢克·福格斯(Jean-Luc Feugeas)
Jing Ji Guan Cha Bao· 2025-06-16 04:04
Group 1 - Jean-Luc Feugeas is a multifaceted artist, mathematician, and bassist whose work is influenced by his research on entropy, exploring the relationship between order and disorder in his art [1] - Feugeas integrates his interests in music, mathematics, and painting, often drawing inspiration from his studies on entropy while creating art [1] - His artistic approach involves the use of lines that become increasingly complex and ambiguous, reflecting his quest for unity and balance in his work [1] Group 2 - Feugeas has created various mural works displayed around the world, showcasing his artistic versatility [2] - Upcoming exhibition details include a display of his works from June 1 to June 30, 2025, at the Beijing Guomao Mall, South District, Basement Level SB125 [2]
当代的回响——欧美艺术家联展(一)
Jing Ji Guan Cha Bao· 2025-06-04 08:04
Core Viewpoint - The exhibition "Echoes of Contemporary Art: A Joint Exhibition of European and American Artists" will be held in Beijing from June 1 to June 30, 2025, showcasing nearly 200 works from 15 top European and American artists, marking the largest exhibition in the gallery's history [1] Group 1: Exhibition Details - The opening ceremony is scheduled for June 5, 2025, at 3 PM at the SB125 in the South District of Beijing's China World Trade Center [1] - The exhibition aims to highlight artists whose works have not yet been commodified by the art market, emphasizing the transmission of cultural values through art [1] Group 2: Featured Artists - Doug Hyde, a prominent British artist, became the best-selling artist in the UK in 2005 and is known for his optimistic and hopeful messages conveyed through his artwork, which often draws inspiration from everyday life [2] - Gustavo Novoa, a Chilean artist, is recognized for his unique style that blends elements of surrealism and humor, with a notable collection of works owned by various celebrities [4][5] - Jean-Luc Feugeas, a French artist and mathematician, explores the relationship between order and chaos in his art, influenced by his studies in entropy and music [6][7]
意识在哪儿?
3 6 Ke· 2025-05-06 04:04
Group 1 - The concept of the Boltzmann Brain suggests that in an infinitely old and chaotic universe, random fluctuations could create a brain with complete memories and self-awareness without the need for a complex external world [1][2][3] - The probability of a Boltzmann Brain existing is argued to be higher than that of a low-entropy universe evolving into a complex structure, as the latter requires overcoming significant entropy increase [2][3] - This leads to the unsettling conclusion that human existence might be a fleeting phenomenon resulting from a random quantum fluctuation, challenging fundamental perceptions of reality [5][6] Group 2 - The discussion contrasts the Boltzmann Brain with Laplace's Demon, which represents determinism, suggesting that all thoughts and feelings are predetermined by physical laws [11][12] - Both perspectives imply that free will does not exist, whether through extreme randomness or absolute determinism [12][18] - Kant's philosophy attempts to reconcile these views by suggesting that true freedom exists beyond observable reality, yet this remains a scientific mystery [18][19] Group 3 - The insights from Boltzmann and Darwin regarding how order emerges from disorder provide a different perspective on evolution and consciousness [19][20] - Boltzmann's view redefines survival competition as a struggle for "negative entropy," indicating that life extracts order from its environment to maintain complexity [20] - This suggests that consciousness may be a product of evolutionary processes aimed at better perceiving the world and utilizing resources effectively [21][22] Group 4 - The exploration of consciousness requires a multidisciplinary approach, incorporating insights from cognitive science, philosophy, and neuroscience [40][42] - Various theories, such as Hofstadter's "strange loop," Turing's computationalism, and integrated information theory (IIT), challenge traditional notions of consciousness and its location [42][43][44] - These perspectives indicate that consciousness may not reside in a specific location but rather in the organization and flow of information within a system [46][47] Group 5 - The evolution of AI, particularly through models like the Boltzmann machine, reflects the potential for understanding consciousness through complex information processing [26][31][33] - The Boltzmann machine's design, which incorporates randomness and probabilistic learning, parallels the idea that consciousness may emerge from structured interactions within a chaotic environment [34][38] - This suggests that consciousness could be a result of cumulative processes rather than a singular miraculous event [38][39]