Workflow
Triton
icon
Search documents
Meta新注意力机制突破Transformer上限,还用上了OpenAI的开源技术
量子位· 2025-07-07 09:35
鱼羊 发自 凹非寺 量子位 | 公众号 QbitAI Meta挖走OpenAI大批员工后,又用OpenAI的技术搞出新突破。 这是什么杀人又诛心 (doge) ? 新架构名为 2-Simplicial Transformer ,重点是通过修改标准注意力,让Transformer能更高效地利用训练数据,以突破当前大模型发展的 数据瓶颈。 而核心方法,就是基于OpenAI提出的Triton,将标准点积注意力推广到三线性函数。 实验结果显示,在同等参数量和数据量下,相较于传统Transformer,新架构在数学、编程、推理等任务上均有更好的表现。 并且,2-Simplicial Transformer的缩放指数高于传统Transformer——这意味着 随着参数增加,新架构加持下的模型性能提升更快,更适用 于有限数据的场景 。 三元线性注意力 传统Transformer的核心机制是点积注意力,其计算复杂度较低,但对复杂任务 (如逻辑推理、数学运算等) 表达能力有限。 针对于此,Meta的这项研究,重点放在将点积注意力从二元线性操作扩展到三元线性操作。 简单来说,就是在计算注意力时引入第三个向量,来增加模型对复杂模式 ...
Orion(OESX) - 2025 Q4 - Earnings Call Transcript
2025-06-26 15:02
Orion Energy Systems (OESX) Q4 2025 Earnings Call June 26, 2025 10:00 AM ET Company Participants William Jones - SVPSally Washlow - CEOPer Brodin - CFOBill Dezellem - Founder, President & Chief Investment Officer Conference Call Participants Eric Stine - Senior Research AnalystSameer Joshi - Senior Equity Research AnalystGowshihan Sriharan - AnalystNone - Analyst Operator Good morning, everyone, and welcome to Orion Energy Systems Fiscal twenty twenty five Fourth Quarter Conference Call. At this time, all p ...
Orion(OESX) - 2025 Q4 - Earnings Call Transcript
2025-06-26 15:00
Financial Data and Key Metrics Changes - In Q4 2025, revenue was $20.9 million, up from $19.6 million in Q3 2025 but down from $26.4 million in Q4 2024 [14] - Fiscal 2025 revenues totaled $79.7 million, compared to $90.6 million in fiscal 2024, reflecting a decline [14] - The net loss for Q4 2025 was $2.9 million, or $0.09 per share, compared to a net income of $1.6 million, or $0.05 per share in Q4 2024 [19] - Fiscal 2025 net loss increased slightly to $11.8 million, or $0.36 per share, compared to a net loss of $11.7 million, or $0.36 per share in fiscal 2024 [19] - Cash generated from operations improved to $600,000 in fiscal 2025 from negative $10.1 million in fiscal 2024 [19] Business Line Data and Key Metrics Changes - The EV charging business saw a revenue increase of 1837% in Q4 2025, driven by expanded geographic reach and order backlog execution [14] - LED lighting revenues in Q4 2025 and fiscal 2025 decreased by 3322% year-over-year due to reduced project activity and product demand [15] - Electrical Maintenance Services revenue decreased to $4.1 million in Q4 2025 from $5.2 million a year ago, but gross profit margin improved significantly to 18.2% from 4.4% in fiscal 2024 [16][17] Market Data and Key Metrics Changes - The company expects modest growth in LED lighting and electrical maintenance revenues for fiscal 2026, while anticipating flat to slightly lower EV charging revenues due to uncertainty in project funding [21] - The overall gross profit margin increased by 170 basis points to 27.5% in Q4 2025 compared to 25.8% in fiscal 2024, attributed to improvements in maintenance and a higher margin revenue mix in EV charging [17] Company Strategy and Development Direction - The company has reorganized into two commercial business units: Solutions and Partners, to better leverage capabilities across LED lighting, EV charging, and electrical maintenance [9][10] - The Solutions unit focuses on large projects and cross-selling opportunities, while the Partners unit emphasizes product sales through distribution channels [10] - The company aims to enhance leadership and urgency in executing its growth and profitability goals, with a focus on integrating engineering design and project management capabilities [12] Management's Comments on Operating Environment and Future Outlook - Management acknowledged the need for improved execution on product and service opportunities and emphasized the importance of maintaining customer relationships [6][12] - The company is optimistic about its project pipeline and expects to achieve positive adjusted EBITDA for the full fiscal year 2026 [22] - Management remains cautious about the EV charging segment due to uncertainties in federal funding and project timelines, despite a strong project pipeline [31][38] Other Important Information - The company reduced operating overheads by more than $4 million in fiscal 2025 and plans to implement further reductions in fiscal 2026 [8] - A binding term sheet was executed to address Voltrec earn-out obligations, which includes issuing $1 million in common stock and a cash payment of $875,000 [20] Q&A Session Summary Question: Order trends and expectations for Q2 - Management noted a strong start to the year with orders, particularly in April, and expects this trend to continue [28] Question: Assumptions for EV charging revenue outlook - Management is taking a conservative approach for the EV segment, citing a strong project pipeline but acknowledging potential impacts from federal actions [31][38] Question: Clarification on earn-out obligations - The earn-out opportunity related to the purchase has ended, with remaining obligations tied to stock and cash payments [39] Question: Revenue cadence throughout the quarter - Management expects a more consistent revenue flow throughout the year, with subsequent quarters anticipated to be higher than Q1 [43] Question: Gross margins by business unit - Management expects gross margins to be relatively consistent across business units, with potential for improvement based on cost-saving initiatives [44] Question: Impact of federal government rule changes - Management clarified that while there has been some noise, the company has not been significantly impacted by federal funding issues, particularly in the EV segment [60][61]
大佬面对面!斯坦福2025 CS336课程全公开:从零开始搓大模型~
自动驾驶之心· 2025-06-24 11:47
点击下方 卡片 ,关注" 自动驾驶之心 "公众号 戳我-> 领取 自动驾驶近15个 方向 学习 路线 从事大模型方向的小伙伴有福利了!斯坦福大学 2025 年春季的 CS336 课程「从头开始创造语言模型(Language Models from Scratch)」相关课程和材料现已在网上全面发布! 该课程教职工团队,阵容十分豪华~ 课程视频:https://www.youtube.com/watch? v=SQ3fZ1sAqXI&list=PLoROMvodv4rOY23Y0BoGoBGgQ1zmU_MT_ 课程主页:https://stanford-cs336.github.io/spring2025/ 讲师Tatsunori Hashimoto:现为斯坦福大学计算机科学系助理教授。其为斯坦福大学 John C. Duchi 和 Percy Liang 的博士后,研究机器学习模型平均性能和最差性能之间的权衡。此前在麻省理工学院攻读研究生,导师是 Tommi Jaakkola 和 David Gifford。本科就读于哈佛大学学习统计学和数学,导师是 Edoardo Airoldi。并且该讲 师的研究成果已 ...
OpenAI久违发了篇「正经」论文:线性布局实现高效张量计算
机器之心· 2025-06-05 02:00
机器之心报道 编辑:Panda OpenAI 发论文的频率是越来越低了。 如果你看到了一份来自 OpenAI 的新 PDF 文件,那多半也是新模型的系统卡或相关增补文件或基准测试,很少有新的研究论文。 至于原因嘛,让该公司自家的 ChatGPT 来说吧:「截至目前,OpenAI 在 2025 年在 arXiv 上公开发布的论文数量相对较少,可能反映了其对研究成果公开策略的 谨慎态度,可能出于商业保密或安全考虑。」 不过近日,OpenAI 也确实发布了一份完全由自己人参与的、实打实的研究论文,其中提出了一种用于高效张量映射的统一代数框架 Linear Layouts 。这是一种使 用二元线性代数而非比特表示(bit representation)的张量布局的通用代数形式,解决了 Triton 等深度学习编译器中长期存在的难题。 论文标题:Linear Layouts: Robust Code Generation of Efficient Tensor Computation Using ₂ 对于现代深度学习工作负载而言,所需要的张量布局需要满足几个要求: 然而,当前的布局系统却难以充分满足这些需求,而是往往: ...
Wall Street Cuts Virtu Financial's Outlook: How to Play the Stock?
ZACKS· 2025-05-20 13:55
Virtu Financial, Inc. (VIRT) , a prominent name in the financial services space, is under scrutiny as analysts trim their earnings projections for 2025 and 2026. While the company extended its streak of earnings beat in the first quarter, sentiment has weakened due to downward revisions in forward estimates.The Zacks Consensus Estimate for Virtu Financial’s 2025 and 2026 adjusted earnings now stands at $3.97 and $3.83 per share, respectively, reflecting week-over-week declines of 0.5% and 1%. Though 2025 es ...
Eastman(EMN) - 2025 Q1 - Earnings Call Transcript
2025-04-25 15:39
Eastman Chemical Company (NYSE:EMN) Q1 2025 Earnings Conference Call April 25, 2025 8:00 AM ET Company Participants Greg Riddle - IR Mark Costa - Board Chair & CEO William McLain - EVP & CFO Conference Call Participants Patrick Cunningham - Citigroup David Begleiter - Deutsche Bank Aleksey Yefremov - KeyCorp Vincent Andrews - Morgan Stanley Jeff Zekauskas - JPMorgan Kevin McCarthy - Vertical Research Partners Frank Mitsch - Fermium Research Michael Sison - Wells Fargo James Cannon - UBS Operator Good day, e ...
Northrop Grumman(NOC) - 2025 Q1 - Earnings Call Transcript
2025-04-22 14:30
Northrop Grumman (NOC) Q1 2025 Earnings Call April 22, 2025 09:30 AM ET Company Participants Todd Ernst - Vice President, Investor RelationsKathy Warden - Chair, CEO & PresidentKenneth Crews - Corporate VP & CFORobert Stallard - PartnerRonald Epstein - MD - Aerospace & DefenseSheila Kahyaoglu - Aerospace & Defense and Airlines Equity ResearchScott Deuschle - Director - Aerospace & Defense Equity ResearchSeth Seifman - Executive DirectorMichael Ciarmoli - Managing Director - Aerospace & Defense Equity Resear ...
Northrop Grumman(NOC) - 2025 Q1 - Earnings Call Transcript
2025-04-22 13:30
Northrop Grumman Corporation (NOC) Q1 2025 Earnings Conference Call April 22, 2025 09:30 AM ET Company Participants Josh - Conference Call OperatorTodd Ernst - Vice President, Investor RelationsKathy Warden - Chair, CEO, and PresidentKen Kruse - Chief Financial Officer Conference Call Participants Christine Lewag - Morgan Stanley AnalystRobert Sallard - Vertical Research AnalystRonald Epstein - Bank of America AnalystSheila Kealu - Jefferies AnalystScott Dushall - Deutsche Bank AnalystSeth Seifman - JP Morg ...
超3000亿!日本眼科器械巨头要卖身?
思宇MedTech· 2025-04-08 15:27
报名:首届全球眼科大会 | 议程更新 报名:首届全球骨科大会 | 议程更新 报名:首届全球心血管大会 | 奖项申报 合作伙伴征集:2025全球手术机器人大会 近日, 据路透社报道, 美国私募股权投资公司 KKR 即将达成对 日本眼科器械巨头拓普康 (TOPCON, OTCPK:TOPCF) 的收购交易。有业内人士称,如果谈判成功,双方可能会在未来几天签署协议,正在 讨论的价格尚未公布。其实 在去年12月,路透社就已经称 拓普康有意寻求私有化 ,竞购者为 KKR 和瑞 典投资公司 EQT。 拓普康市值约为3234亿日元 (约合21.5亿美元),此次收购交易的背景是 日本上市企业私有化浪潮的加 速 。目前,KKR 和拓普康均未对收购交易发表评论 。 不过话说回来,市值千亿的巨头被私有化,听起来就像是金融圈里的《速度与激情》:资本家们开着豪车、西 装革履,在谈判桌上风驰电掣,最后以一个潇洒的签字收尾。不过在现实世界中,这样的并购案例往往意味着 市场格局的新变化,也预示着眼科行业或将迎来一场变革。 KKR是全球知名私募股权投资机构,目前管理着超3.9万亿元资金,与凯雷、黑石、德州太平洋并称"全球 四大PE巨头"。 比 ...