Investment Rating - The report maintains the profit forecasts, target prices, and ratings for relevant companies unchanged [6] Core Insights - The evolution of large models is fundamentally a history of combating "forgetting." The lack of a memory retention architecture leads to costly "repeated calculations" each time historical information is processed. The current model faces physical limits of memory walls and context windows. The report suggests that the AI infrastructure battlefield will increasingly focus on "model memory" starting in 2026 [3][14] - The report introduces a three-layer memory framework: short-term, medium-term, and long-term memory, each corresponding to different software and hardware requirements. This framework aims to provide a structured analysis paradigm for investment logic in AI infrastructure [14][20] Summary by Sections Short-term Memory - Short-term memory constitutes the "current view" of large models during single inference tasks. It is characterized by high-frequency read/write and extreme sensitivity to latency. The core challenge lies in the dual occupation of memory capacity and bandwidth by KV Cache. Software optimizations include PagedAttention virtualization and cutting-edge architectures like Infini-attention to support million-token context windows. Key hardware elements include HBM and on-chip SRAM [4][30][50] Medium-term Memory - Medium-term memory ensures situational continuity across sessions and is foundational for agents. The need for cross-session windows indicates a shift from stateless short-term intelligence to a complex system capable of "storage-retrieval-update-forget" dynamic management. Software advancements like GraphRAG and MemoryOS facilitate this transition, while hardware requirements include large-capacity DRAM and enterprise-grade SSDs to address high-concurrency random read/write bottlenecks [4][56] Long-term Memory - Long-term memory supports the transition from pre-training to "continuous evolution." The need for real-time updates blurs the lines between model training and inference. Long-term memory aims to break the limitations of pre-training cut-off times, allowing for continuous knowledge accumulation through implicit parameters, explicit semantics, and parameterized lookup tables. This new paradigm will drive demand for various databases and compute-storage hardware [5][21] Hardware and Software Requirements - The report outlines the hardware and software requirements for each memory layer, emphasizing the need for high-bandwidth memory (HBM), large-capacity DRAM, and enterprise SSDs. It also highlights the importance of software solutions like KV Cache management and advanced attention mechanisms to optimize memory usage and enhance performance [16][50][64]

Core Insights - The evolution of large models is fundamentally a history of combating "forgetting" [1] - The AI infrastructure battlefield post-2026 will increasingly focus on "model memory" [1] - A structured analysis framework for memory layers in AI is proposed, encompassing short-term, mid-term, and long-term memory [8] Short-term Memory - Short-term memory constitutes the "current view" during single inference, characterized by high-frequency read/write and sensitivity to latency [4] - Key challenges include the dual occupation of memory bandwidth and capacity by KV Cache, necessitating software optimizations like PagedAttention and hardware advancements in HBM and on-chip SRAM [4][19] - The physical resource constraints lead to a "memory wall," impacting inference speed and efficiency [19] Mid-term Memory - Mid-term memory ensures contextual continuity across sessions, evolving AI from stateless to a dynamic system capable of "storage-retrieval-update-forget" management [4] - Software advancements like GraphRAG and MemoryOS facilitate proactive memory governance, while hardware needs include large-capacity DRAM and enterprise-grade SSDs to handle high-concurrency random read/write bottlenecks [4][28] - This layer is crucial for defining the upper limits of agent capabilities and constructing private data barriers [4] Long-term Memory - Long-term memory supports the transition from pre-training to "continuous evolution," allowing for real-time updates and knowledge accumulation [5] - Three pathways for achieving long-term memory are identified: implicit parameters, explicit semantics, and parameterized lookup tables [5][46] - The blurring lines between training and inference necessitate hardware capable of supporting both functions, particularly in terms of memory bandwidth and computational power [50][51] Hardware Requirements - Short-term memory demands high bandwidth memory (HBM) and on-chip SRAM to manage the rapid read/write of "hot data" [27] - Mid-term memory requires large-capacity DRAM and enterprise-grade SSDs to optimize storage costs and ensure rapid access [43] - Long-term memory necessitates enterprise-grade SSDs and CPUs with high performance to manage extensive data and high concurrency [54] Software Solutions - The RAG paradigm is evolving from basic retrieval to structured approaches like GraphRAG, enhancing logical reasoning capabilities [32][35] - Memory OS architecture allows agents to actively manage memory lifecycle, ensuring efficient use of memory resources [38] - The introduction of test-time training mechanisms and parameter-efficient fine-tuning (PEFT) enhances the ability to retain valuable information in long-term memory [47][48]

Investment Rating - The report maintains a positive outlook on the AI industry, particularly focusing on advancements in large model technologies and their applications in various productivity scenarios [2][3]. Core Insights - In 2025, global large model capabilities advanced significantly, overcoming challenges in reasoning, programming, and multimodal abilities, although issues like stability and hallucination rates remain [2][3]. - Looking ahead to 2026, breakthroughs in reinforcement learning, model memory, and context engineering are anticipated, moving from short context generation to long reasoning chain tasks and from text interaction to native multimodal capabilities [2][3][4]. - The scaling law for pre-training is expected to continue, with flagship models achieving higher parameter counts and intelligence limits, driven by advancements in NVIDIA's GB series chips and the adoption of more efficient model architectures [3][4]. Summary by Sections Model Architecture and Optimization - The report emphasizes the continuation of the Transformer architecture, with a consensus on the efficiency of the Mixture of Experts (MoE) model, which balances performance and efficiency [40][41]. - Various attention mechanisms are being optimized to enhance computational efficiency, with a focus on hybrid approaches that combine different types of attention for better performance [49][50]. Model Capabilities - The report highlights significant improvements in reasoning, programming, agentic capabilities, and multimodal tasks, indicating that large models have reached a level of real productivity in various fields [13][31]. - The ability of models to perform complex reasoning tasks has improved, with the introduction of interleaved thinking chains allowing for seamless transitions between thought and action [24][28]. Market Dynamics - The competition among leading global model manufacturers remains intense, with companies like OpenAI, Anthropic, and Gemini pushing the boundaries of model intelligence and exploring AGI [31][32]. - Domestic models are catching up, maintaining a static gap of about six months behind their international counterparts, with significant advancements in capabilities [32][33]. Future Outlook - The report anticipates that the introduction of continuous learning and model memory will address the "catastrophic forgetting" problem, enabling models to adapt dynamically based on task importance [4][5]. - The integration of high-quality data and large-scale computing resources is crucial for enhancing the capabilities of reinforcement learning, which is expected to play a key role in unlocking advanced model functionalities [3][4].

Group 1: Gold and Silver Market Outlook - A Reuters survey indicates that gold prices are expected to reach a new high of $4,746.50 per ounce by 2026, driven by geopolitical uncertainties and strong central bank purchases, marking a significant increase from last year's forecast of $4,275 [1] - The average price expectation for silver in 2026 has also been raised to $79.50 per ounce, up from $50 in the previous year's survey [1] Group 2: Currency and Economic Analysis - The strong US dollar is exerting downward pressure on gold and silver prices, with analysts suggesting that if the dollar's rebound continues, it may further impact gold prices negatively [2] - UBS forecasts a 10% increase in global stock markets by the end of the year, with a focus on diversification into markets like China, Japan, and Europe, driven by strategic autonomy and fiscal expansion [3] - Mitsubishi UFJ reports that the Japanese yen has fallen to a near two-week low due to election expectations, with potential for continued selling pressure as confidence in the ruling party's stability grows [4] - Goldman Sachs warns of upward fiscal risks in Japan ahead of the upcoming elections, suggesting that unless the Bank of Japan accelerates interest rate hikes, the yen may weaken further [6] Group 3: Sector-Specific Insights - Zhongtai Securities expresses a positive outlook on the raw material pharmaceutical sector, highlighting innovations in small nucleic acids and ADC toxins as catalysts for growth [7] - CITIC Securities recommends focusing on automotive companies with strong cost transfer capabilities and global layouts, as rising raw material prices are expected to pressure profit margins in the first quarter of 2026 [8] - Galaxy Securities identifies two main paths for AI-driven benefits: enhancing platform efficiency and improving production efficiency through content and tools, suggesting a focus on internet stocks and AI-related applications [9]

Core Insights - The report from CICC indicates that by 2025, global large model technology will advance significantly in productivity scenarios, achieving notable improvements in reasoning, programming, agentic capabilities, and multimodal abilities, although there are still shortcomings in model generalization, stability, and hallucination rates [1] - Looking ahead to 2026, CICC anticipates further breakthroughs in large models regarding reinforcement learning, model memory, and context engineering, moving from short context generation to long reasoning chain tasks and from text interaction to native multimodal capabilities, progressing towards the long-term goal of AGI [1] Group 1: Model Development and Architecture - CICC expects the re-emergence of pre-training Scaling-Law in 2026, with flagship model parameters reaching new heights [1] - The Transformer-based model architecture will continue, with a consensus on balancing performance and efficiency through Mixture of Experts (MoE), while different attention mechanism routes are still being optimized and switched [1] - The paradigm shift will involve pre-training phase Scaling-Law, high-quality data, and reinforcement learning collectively enhancing model capabilities [1] Group 2: Importance of Reinforcement Learning - The introduction of reinforcement learning is crucial for unlocking advanced model capabilities, enabling models to think and reason more logically and in line with human preferences [2] - The essence of reinforcement learning lies in "self-generated data + multi-round iteration," with its effectiveness dependent on large-scale computing power and high-quality data [2] - Both international and domestic model manufacturers, such as OpenAI, Gemini, DeepSeek, and Alibaba Qianwen, are placing significant emphasis on reinforcement learning, which is expected to increase in proportion by 2026 [2] Group 3: New Directions in Learning - Continuous learning and model memory are set to achieve core breakthroughs, addressing the "catastrophic forgetting" issue in large models by implementing selective memory mechanisms [3] - Algorithms and architectures like Google's Titans, MIRAS, and Nested Learning aim to allow models to dynamically adjust their learning and memory based on task duration and importance, facilitating continuous and even lifelong learning [3] - The exploration of world models focusing on understanding causal relationships in the physical world presents opportunities for breakthroughs under different model paths like Genie 3 and Marble [3]

Core Insights - The article discusses the advancements in large model technology, highlighting improvements in reasoning, programming, agentic capabilities, and multimodal abilities, while also noting existing shortcomings in general reliability and memory capabilities [1][4]. Model Architecture and Optimization - The Transformer architecture continues to dominate, with a consensus on the efficiency of the Mixture of Experts (MoE) model, which activates only a subset of parameters, significantly reducing computational costs [17][18]. - The industry is exploring various attention mechanisms to balance precision and efficiency, including Full-Attention, Linear-Attention, and Hybrid-Attention [20]. Model Capabilities - Significant progress has been made in reasoning, programming, agentic tasks, and multimodal applications, with models achieving real productivity levels in various domains [3][4]. - The introduction of reinforcement learning is crucial for unlocking advanced model capabilities, allowing for more logical reasoning aligned with human preferences [2][23]. Competitive Landscape - Major players like OpenAI, Gemini, and Anthropic are intensifying their competition, with OpenAI focusing on enhancing reasoning and multimodal integration, while Gemini has made significant strides in model capabilities and is leveraging high-quality data for improvements [11][42][43]. - Domestic models are catching up, maintaining a static gap of about six months behind their international counterparts, with companies like Alibaba and ByteDance producing competitive models [12][14]. Future Directions - The focus for 2026 includes further advancements in reinforcement learning, continuous learning, and world models, with expectations for models to tackle more complex tasks and achieve long-term goals like AGI [27][40]. - Continuous learning and model memory are seen as essential for achieving lifelong learning capabilities, with new algorithms like MIRAS and HOPE being pivotal in this evolution [28][32].

Core Insights - geoSurge is a startup focused on Generative Engine Optimization (GEO), utilizing "model internal memory + RAG (Retrieval-Augmented Generation)" to provide GEO services, headquartered in London and founded in April 2025 [1] - The company has completed Pre-Seed funding supported by European venture capital firm Passion Capital and American venture fund Tuesday Capital, with angel investors from companies like Google DeepMind and Microsoft AI [1] Team Overview - CEO Francisco Vigo has 12 years of experience in business data analysis and previously served as Chief Data Scientist at fintech unicorn Zilch [2] - CTO Jons Mostovojs is an expert in machine learning and systems engineering, focusing on model training and infrastructure [4] - APAC Head Zoe Li is a former early-stage AI/DeepTech venture capitalist in Europe [4] Product Offerings - geoSurge's products include three main components: 1. **MEASURE**: Monitors a brand's current ranking in major AI systems like ChatGPT, tracking mentions, frequency, and consistency across time and markets [5] 2. **EXPLORE**: Helps clients understand the reasons behind their performance and provides optimization directions by analyzing model behavior and probability distributions [6] 3. **BOOST**: Enhances brand visibility in AI through corpus engineering, optimizing the model's information set to ensure accurate recognition and recall of brand information [10] Market Context - In September 2025, OpenAI's research indicated that 49% of ChatGPT usage is for inquiries, with about 70% of consumers using it for non-work-related purposes, highlighting the importance of AI-generated content for businesses [12] - GEO is fundamentally more complex than SEO, as it involves understanding AI systems' training and data collection processes, which are often opaque [16] Challenges and Opportunities - Brands face the risk of "disappearing" from AI recognition due to unstable memory and model updates, which can alter associations and recommendations [17] - Many GEO solutions focus on measurement and monitoring, but geoSurge emphasizes enhancing model memory for long-term visibility [17] - The company aims to combine GEO and traditional SEO strategies to optimize brand exposure effectively [18] Industry Trends - GEO was recognized as one of the top AI buzzwords in 2025 by MIT Technology Review, indicating a paradigm shift in branding and marketing [19] - The GEO market is still in its early stages, with various companies adopting different approaches, but geoSurge stands out by focusing on optimizing model memory for stable brand recognition [19] Performance Metrics - Key performance indicators for GEO effectiveness include real click-through rates from LLMs and the frequency of AI crawler activities, which are closely linked to a brand's inclusion in model training datasets [20]

Group 1 - The core idea is that scaling foundational models through pre-training is essential for AI to acquire world knowledge and basic reasoning capabilities [4][5] - More data, larger parameters, and saturated computation remain the most efficient methods for scaling foundational models [5] - The concept of domain-specific large models is considered a false proposition, as true AGI (Artificial General Intelligence) has not yet been achieved [28][30] Group 2 - Enhancing reasoning capabilities and aligning long-tail abilities are crucial for improving real-world AI performance [6][7] - The introduction of agents marks a significant milestone in AI, allowing models to interact with real environments and generate productivity [10][11] - Implementing memory mechanisms in models is essential for their application in real-world scenarios, with different memory stages mirroring human memory [12][13] Group 3 - Online learning and self-evaluation are key components for models to improve autonomously, with self-assessment being a critical aspect of this process [14][15] - The integration of model development and application is becoming increasingly important, with the goal of replacing human jobs through AI [16][17] - The future of AI applications should focus on enhancing human capabilities rather than merely creating new applications [32][34] Group 4 - Multimodal capabilities are seen as promising, but their contribution to AGI's upper intelligence limit remains uncertain [21][22] - The development of embodied AI faces challenges, including data acquisition and the stability of robotic systems [25][26] - The existence of domain models is driven by enterprises' reluctance to fully embrace AI, aiming to maintain a competitive edge [29][31]