Workflow
ZIP
icon
Search documents
超越ZIP的无损压缩来了,华盛顿大学让大模型成为无损文本压缩器
3 6 Ke· 2025-10-11 10:47
Core Insights - The article discusses the challenges of data storage arising from the generation of massive data by large language models (LLMs) and introduces an innovative solution called LLMc, which utilizes LLMs for lossless text compression [2][5]. Group 1: LLMc Overview - LLMc has demonstrated superior compression rates compared to traditional compression tools like ZIP and LZMA across various datasets, including Wikipedia, novels, and scientific abstracts [2]. - The project has been open-sourced, with the main author being Yi Pan, an undergraduate from Shanghai Jiao Tong University currently interning at the University of Washington [4]. Group 2: Compression Mechanism - The compression mechanism of LLMc is based on the principle of rank-based encoding, where the model predicts the next possible token and generates a probability distribution list [6]. - Instead of storing the token itself, LLMc stores the rank of the token in the probability list, which typically requires minimal storage space [6]. - During decompression, the same LLM and context are used to recreate the probability distribution, allowing for the accurate recovery of the original text using the stored rank [6]. Group 3: Challenges and Limitations - The research team identified several challenges with the current version of LLMc, including efficiency issues due to the quadratic relationship between LLM inference complexity and sequence length [7]. - The processing speed of LLMc is currently much lower than traditional compression algorithms due to its heavy reliance on large model inference [7]. - To ensure deterministic decompression, the system requires special kernels and integer encoding of token ranks instead of using logarithmic probabilities [8]. - The current implementation is primarily focused on natural language, with future exploration needed for extending its application to other modalities like images, videos, or binary data [9].
宠物食品和宠物医疗标的梳理
2025-05-21 15:14
Summary of Conference Call on Pet Industry and Companies Industry Overview - The pet industry is experiencing rapid growth, with an annual compound growth rate of approximately 10% driven by increasing pet ownership and the rising penetration of pet food products [2][10] - The pet medical market is projected to reach 80-90 billion by 2025, making it the second-largest segment after pet food [10] Key Companies and Their Performance 1. Guibao Pet - Guibao Pet's self-owned brand has shown strong performance, with revenue of approximately 3.5 billion, accounting for nearly 70% of total revenue, and a net profit margin of 12% [1][4] - The high-end cat food brand, Fliegate, achieved a growth rate of 100% last year and maintained the same growth rate in Q1 of this year [4] - Guibao is expected to become a leading enterprise with projected revenues nearing 25 billion and net profits around 5 billion in the medium to long term [1][4] 2. Zhongchong Co., Ltd. - Zhongchong Co., Ltd. experienced a significant growth of nearly 200%-300% from its previous low, with total revenue from its three domestic brands (Wangpi, Lingxian, and ZIP) reaching 1.4 billion last year [5] - The company aims for overseas revenue of 400 million this year, maintaining a growth rate of 50% [5][6] - The net profit margin for its North American subsidiary is reported to be between 15%-20% [6] 3. Petty Co., Ltd. - Petty's overseas business accounts for a significant portion of its operations, with a focus on exports to the U.S. [8] - Domestic revenue was approximately 290 million last year, with a target of 400-450 million this year, reflecting a growth of over 40% [9] - The company is adjusting its product lines and plans to launch new baked grain products in Q2 and Q3 [8][9] Market Dynamics and Future Outlook - The pet medical sector is characterized by a lack of dominant players, with foreign brands leading in pharmaceuticals and vaccines, indicating substantial room for domestic companies to grow [11][12] - The average medical expenses for pets have doubled due to increasing age, leading to a rigid demand for medical services [10] - Companies like Ruipuhua and KQ Bio are recommended for their comprehensive industry layouts and potential for growth in the pet medical field [13][15] Additional Insights - The overall pet industry is expected to continue expanding, with self-owned brands focusing on product innovation to enhance profitability [2] - The competitive landscape in the pet medical sector is still developing, with many local companies poised to capture market share as the industry matures [12] - Other companies to watch include Baisha Technology, Biological Shares, and Zhongmu Shares, which have varying degrees of involvement in the pet medical sector [18]