OPUS
Search documents
打破「数据暴力」预训练惯性,阿里Qwen、上交大等提出预训练动态数据选择范式OPUS
机器之心· 2026-03-16 08:34
在 "大模型预训练" 这件事上,行业里几乎有一条默认信条: 想要更强,就得喂更多、更 新、更高 质量的数据 。但最近一篇 来自阿里巴巴、上海交大、UW– Madison 等团队 的工作,在 Hugging Face Daily Paper 冲上月度 Top1 后,直接把这个共识撕开了一道口子: 只从中低质量数据里动态挑选,竟然能打赢 "高质量数 据优先" 的经典训练配方 。 这条结论之所以让社区炸锅,不只是因为它 "反直觉",更因为它击中了一个长期被忽略的问题:我们今天用 AdamW、Muon 训练大模型,却还在用偏 SGD 时代的 思路给数据打分。 说得更直白一点 —— 我们一直在拿 "旧地图" 给 "新导航" 指路。而这篇工作真正厉害的地方是:它不是在 "玄学筛数据" 上做小修小补,而是把 数据选择这件事,第一次系统性地对齐到了 优化器真正决定的更新方向上 。 论文链接:https://arxiv.org/pdf/2602.0540 从 "数据饥渴" 到 "数据墙",预训练进入 "每个 token 都要算账" 的时代 过去十年,大模型能力提升的主旋律,是一条几乎无人质疑的路径:模型更大、数据更多、算力更猛 ...
Repligen(RGEN) - 2025 FY - Earnings Call Transcript
2025-09-04 13:00
Financial Data and Key Metrics Changes - The company reported a 17% organic growth excluding COVID impacts, indicating a strong recovery [4][5] - Orders grew by 20% in the first half of the year, setting a positive outlook for 2025 [5] - The company increased its full-year guidance by 50 basis points despite a 100 basis point headwind from a specific gene therapy program [5] Business Line Data and Key Metrics Changes - The monoclonal antibody business performed well, contributing to overall growth [5] - New modalities accounted for about 17% of total sales in the first half, with gene therapy making up approximately 50% of that segment [11] - Instrument revenues increased by high teens, with orders up over 20%, indicating a recovery in the hardware segment [15][16] Market Data and Key Metrics Changes - Biopharma revenue and orders rose over 20% in the quarter, driven by strong performance across consumables and instruments [22] - The company noted a shift in the Chinese market towards innovative drugs, which is expected to accelerate growth in the biopharma sector [30][32] Company Strategy and Development Direction - The company is focusing on a key account management strategy, which has led to increased sales across multiple product lines [23][56] - There is a strong emphasis on innovation, with plans to double the size of the business in the midterm through both organic growth and potential acquisitions [47][74] - The company is actively developing a specific strategy for the Chinese market, recognizing the need to adapt to local competition and market dynamics [32][36] Management's Comments on Operating Environment and Future Outlook - Management expressed optimism about entering a growth cycle for hardware, driven by limited capacity and increasing demand in markets like Asia [21] - The company anticipates that the biopharma market in China will grow faster than other markets by 2026, necessitating a tailored strategy [30][32] - Management highlighted the importance of maintaining a competitive edge in filtration technologies, particularly with ATF systems [37] Other Important Information - The company is experiencing minimal impact from tariffs, with only a couple of million dollars affecting top-line revenue [61][62] - EBITDA margins are stabilizing around 19%, with a target of reaching 30% in the coming years [63][64] Q&A Session Summary Question: Can you elaborate on the growth in the biopharma sector? - The company noted that biopharma revenue and orders increased over 20%, supported by strong performance across consumables and instruments [22] Question: What is the outlook for the Chinese market? - Management indicated that the Chinese biopharma market is expected to grow rapidly, with a need for a specific strategy to address local competition [30][32] Question: How is the company addressing the impact of tariffs? - The company reported minimal impact from tariffs, estimating a couple of million dollars in top-line effects [61][62] Question: What is the company's strategy for innovation? - The company is focused on leveraging recent innovations to drive growth, with plans to introduce new products and technologies in the coming years [58][59]
Repligen(RGEN) - 2025 Q1 - Earnings Call Transcript
2025-04-29 12:30
Financial Data and Key Metrics Changes - The company reported first quarter revenue of $169 million, exceeding expectations despite a $2 million foreign exchange headwind, representing a 10% increase year-on-year [29] - Organic revenue growth was 11%, and organic non-COVID revenue growth was 14%, indicating strong underlying performance [29][30] - Adjusted net income was $22 million, up 29% from the previous year, with adjusted fully diluted earnings per share increasing to $0.39 from $0.30 [33][35] Business Line Data and Key Metrics Changes - Organic revenue growth in the first quarter was driven by proteins, chromatography, and analytics, with proteins showing the highest growth [13][24] - Consumables revenue grew over 20% year-on-year, while capital equipment revenues declined as expected [17][22] - Chromatography orders increased by over 50%, marking the highest quarterly order intake in three years [24] Market Data and Key Metrics Changes - Biopharma revenues grew more than 20% year-on-year, supported by strong execution from strategic accounts [16] - North America represented 50% of total revenue, with both North America and Europe up 13%, while Asia excluding China grew by 12% [30] - China represented only 2% of total revenue, continuing to decline [19][30] Company Strategy and Development Direction - The company is focused on executing its strategic plan for 2025, including the acquisition of the nine zero eight devices bioprocessing portfolio [12][20] - The management emphasized the importance of diversifying the customer base, with the largest customer representing only 6% of revenue [14] - Continued investment in R&D and product development is a priority, with new product launches expected to drive future growth [21][45] Management Comments on Operating Environment and Future Outlook - Management acknowledged macro uncertainties but expressed confidence in the underlying trends and opportunities within the business [8][9] - The company expects revenue growth to accelerate throughout the year, with a strong backlog supporting growth in capital equipment [17][27] - Management remains optimistic about the mid to long-term outlook for new modalities, despite short-term challenges [63] Other Important Information - The company is navigating tariff impacts with minimal expected effects on earnings per share, as most manufacturing is based in the U.S. [10][12] - Adjusted gross profit was $91 million, with a gross margin of 53.7%, reflecting strong volume leverage and favorable product mix [31][32] - The company plans to maintain a strong balance sheet while being prudent in spending and preparing for potential acquisitions [45] Q&A Session Summary Question: CDMO order trends and tariff impact - Management noted no acceleration in orders due to tariffs, with strong order intake across all customer sizes and product lines [50][51] Question: Tariff dynamics and pricing pass-through - Management indicated a potential less than 1% sales increase from tariffs, primarily through surcharges, with minimal impact on gross margins [54][56] Question: Emerging modalities and FDA changes - Management remains optimistic about new modalities, with no significant disruptions reported from customers regarding clinical trials [62][64] Question: Small biotech customer trends - Orders from small biotech customers were flat, with a decline in sales to emerging markets, raising concerns about the health of that segment [78][80] Question: Impact of FDA guidance on animal testing - Management has not heard of any tangible impacts from FDA guidance on animal testing, with no significant changes reported by customers [98][99] Question: Manufacturing flexibility in response to tariffs - The company has multiple manufacturing sites and is exploring dual manufacturing options to mitigate potential tariff impacts [100][101] Question: Clarification on revenue guidance - Management confirmed an increase in organic non-COVID revenue growth guidance, indicating positive demand fundamentals [106]