Workflow
PyTorch
icon
Search documents
X @Polyhedra
Polyhedra· 2025-10-03 12:00
By fusing zero-knowledge proofs with PyTorch, Polyhedra is laying the rails for an AI economy that’s not just powerful — but provably safe and scalable. ...
关于人工智能发展的几点思考
机器人圈· 2025-09-29 08:22
Core Viewpoint - The article emphasizes the importance of artificial intelligence (AI) as a driving force for technological revolution and industrial transformation, highlighting the need for a balanced approach between innovation and safety, as well as the integration of government guidance and market dynamics in AI development [1][10]. Group 1: Self-Innovation and Open Cooperation - Self-innovation is the foundation of AI development, and without core technology autonomy, open cooperation may lead to dependency [3]. - Since 2018, China has made breakthroughs in core algorithms and chip structures, establishing a self-sustaining industrial ecosystem [3]. - The domestic market serves as a testing ground for AI technology, supported by a complete industrial chain and the largest digital economy market globally [3][4]. Group 2: Dynamic Balance of Development and Safety - AI technologies are double-edged swords, bringing productivity leaps while posing potential risks [7]. - The development of AI must adhere to technological evolution laws and maintain national security [8]. - A balance between safety and innovation is crucial to avoid missing opportunities for productivity enhancement or falling into technological chaos [8]. Group 3: Government Guidance and Market Drive - Effective collaboration between government and market is essential for the efficient operation of the modern economic system and the development of AI [10]. - Government plays a crucial role in areas where the market is unwilling or unable to act, such as early funding for disruptive technologies [10][11]. - The complexity of technological innovation and global competition highlights the necessity of this collaboration for orderly and efficient AI development [11]. Group 4: Value Integration of Industrial Application and Social Governance - The rapid advancement of AI brings significant societal challenges, making social governance a focal point [14]. - Issues like algorithm bias and data misuse arise as AI becomes more integrated into human decision-making [14]. - Ensuring that AI applications are grounded in reasonable social governance norms is vital for balancing efficiency and fairness, innovation and safety, and commercial interests with public welfare [14].
X @Avi Chawla
Avi Chawla· 2025-09-22 06:39
You can also verify this:- Create a dropout layer in PyTorch- Compute the dropout on a tensor- Now set the dropout layer to eval mode- Compute dropout on the same tensor againCheck this 👇 https://t.co/p5u7Need4G ...
LLM开源2.0大洗牌:60个出局,39个上桌,AI Coding疯魔,TensorFlow已死
3 6 Ke· 2025-09-17 08:57
Core Insights - Ant Group's open-source team unveiled the 2.0 version of the "2025 Large Model Open Source Development Ecosystem Panorama" at the Shanghai Bund Conference, showcasing significant changes in the open-source landscape [2][4][10] Group 1: Ecosystem Changes - The updated panorama includes 114 projects, a decrease of 21 from the previous version, with 39 new projects and 60 projects that have exited the stage, including notable ones like TensorFlow, which has been overtaken by PyTorch [4][5] - The overall trend indicates a significant reshuffling within the ecosystem, with a median age of only 30 months for projects, highlighting a youthful and rapidly evolving environment [5][10] - Since the "GPT moment" in October 2022, 62% of the projects have emerged, indicating a dynamic influx of new entrants and exits [5][10] Group 2: Project Performance - The top ten most active open-source projects reflect a focus on AI, LLM, Agent, and Data, indicating the primary areas of interest within the ecosystem [7][9] - The classification framework has evolved from broad categories to more specific segments, including AI Agent, AI Infra, and AI Data, emphasizing the shift towards an "agent-centric" era [10][19] Group 3: Contributions by Region - Among 366,521 developers, the US and China contribute over 55%, with the US leading at 37.41% [10][12] - In specific areas, the US shows a significant advantage in AI Infra and AI Data, with contributions of 43.39% and 35.76% respectively, compared to China's 22.03% and 21.5% [12][14] Group 4: Methodological Evolution - The methodology for selecting projects has shifted from a known starting point to a broader approach that captures high-activity projects, increasing the threshold for inclusion [15][18] - The new methodology aligns with Ant Group's goal of providing insights for internal decision-making and guidance for the open-source community [15][18] Group 5: AI Agent Developments - The AI Agent category has evolved into a structured system with various specialized tools, indicating a transition from chaotic growth to systematic differentiation [19][21] - AI Coding has expanded its capabilities, covering the entire development lifecycle and supporting multimodal and context-aware functionalities [23][27] Group 6: Market Trends - The report predicts significant commercial potential in AI Coding, with new revenue models emerging from subscription services and value-added features [24][27] - Chatbot applications have seen a peak but are now stabilizing, with a shift towards integrating knowledge management for long-term productivity [28][30] Group 7: Infrastructure and Operations - The Model Serving segment remains a key battleground, with high-performance cloud inference solutions like vLLM and SGLang leading the way [42][45] - LLMOps is rapidly growing, focusing on the full lifecycle management of models, emphasizing stability and observability [50][52] Group 8: Data Ecosystem - The AI Data sector appears stable, with many projects originating from the AI 1.0 era, but is facing challenges in innovation and engagement [58][60] - The evolution of data infrastructure is anticipated, moving from static repositories to dynamic systems that provide real-time insights for models [60][61] Group 9: Open Source Dynamics - A trend towards customized open-source licenses is emerging, allowing for more control and flexibility in commercial negotiations [62][63] - The landscape of open-source projects is being challenged, with some projects operating under restrictive licenses, raising questions about the definition of "open source" [62][63] Group 10: Competitive Landscape - The competitive landscape is marked by a divergence between open-source and closed-source models, with Chinese projects flourishing while Western firms tighten their open-source strategies [67][68] - The introduction of MoE architectures and advancements in reasoning capabilities are becoming standard features in new models, indicating a shift in focus from scale to reasoning [69][70]
LLM开源2.0大洗牌:60个出局,39个上桌,AI Coding疯魔,TensorFlow已死
机器之心· 2025-09-17 04:00
Core Insights - The article discusses the significant changes in the open-source AI model ecosystem, highlighting a shift towards a more competitive and rapidly evolving landscape, particularly in the AI Agent and Model Serving sectors [4][9][61]. Group 1: Ecosystem Changes - The latest version of the open-source landscape includes 114 projects, a decrease of 21 from the previous version, with 39 new projects and 60 projects that have disappeared, indicating a significant reshuffling in the ecosystem [7][10]. - The average lifespan of projects in the AI model ecosystem is only 30 months, with 62% of projects emerging after the "GPT moment" in October 2022, showcasing a high turnover rate [10][11]. - TensorFlow has been overtaken by PyTorch, which now dominates the landscape, marking a dramatic shift in the competitive dynamics [8]. Group 2: Key Trends - The article identifies three main areas of focus: AI Coding, Model Serving, and LLMOps, which are emerging as the primary tracks in the evolving landscape [29][61]. - AI Coding has transitioned from merely assisting in code writing to becoming a comprehensive lifecycle engine, indicating a significant increase in its capabilities and market potential [43][44]. - The AI Data sector remains relatively stable but is expected to evolve as new challenges arise in the native large model era, suggesting a potential for future growth [82][88]. Group 3: Global Contributions - The United States and China contribute over 55% of the total developer population in the open-source AI space, with the U.S. leading at 37.41% [17][20]. - In specific areas, the U.S. has a dominant position in AI Infrastructure and AI Data, with contributions significantly higher than those from China [19][23]. Group 4: Licensing Trends - There is a noticeable trend towards more restrictive open-source licenses, with many new projects adopting custom agreements that allow for greater control by the license holders [90][92]. - This shift raises questions about the definition of "open source" in the current competitive environment, as some projects that are popular on platforms like GitHub are not fully open-source [94].
昔日王者TensorFlow,已死
3 6 Ke· 2025-09-15 01:29
Core Insights - TensorFlow, once a dominant open-source framework, is now experiencing a significant decline in community activity, contrasting sharply with the rising popularity of PyTorch [3][8][11] - The analysis presented by Wang Xu at the recent Bund Conference highlights the rapid changes in the open-source landscape, where project viability is now measured in days rather than years [11][12] - The latest release of Ant Group's open-source ecosystem map has officially removed TensorFlow, indicating its diminished status in the AI open-source community [8][11] Group 1: Trends in Open Source Projects - The open-source ecosystem is witnessing a rapid turnover, with many projects being removed from the latest ecosystem map due to declining activity and relevance [11][12] - The OpenRank algorithm, which evaluates project influence based on collaboration networks, has been updated to reflect the current state of the ecosystem, resulting in a 35% replacement rate of projects in the new version [11][12] - Projects that fail to maintain community engagement or lag in iteration speed are particularly vulnerable to being excluded from the ecosystem map [12][14] Group 2: Evolution of Open Source Definition - The definition and operational model of open source are evolving, with many high-activity projects not adhering to traditional open-source licenses [17][20] - New licensing models are emerging that balance community engagement with commercial interests, indicating a shift towards a more pragmatic approach to open-source development [22][23] - The trend reflects a growing emphasis on community activity metrics over strict adherence to open-source principles, as projects seek to leverage community support for market success [21][22] Group 3: Shifts in Competitive Landscape - The focus of competition in the AI open-source space is shifting from broad functionality to performance optimization, particularly in model serving and inference efficiency [27][30] - High-performance inference engines are becoming critical as the industry transitions from exploration to practical implementation, with projects like vLLM and TensorRT-LLM leading the way [30][31] - The competitive landscape is increasingly defined by the ability to optimize model performance and reduce inference costs, marking a significant change in developer priorities [30][32] Group 4: Global Contribution Dynamics - The global AI open-source landscape is characterized by a "dual center" model, with the United States and China emerging as the primary contributors [33][35] - The U.S. leads in AI infrastructure contributions, while China shows strong growth in application innovation, reflecting a complementary dynamic between the two regions [35][36] - The active participation of Chinese developers in the AI agent domain is driven by the demand for AI solutions across various industries, highlighting a bottom-up innovation model [36]
昔日王者TensorFlow,已死
量子位· 2025-09-15 00:30
Core Viewpoint - The article discusses the decline of TensorFlow as an open-source framework, contrasting it with the rapid rise of PyTorch and other emerging projects in the AI open-source ecosystem [3][8][54]. Group 1: Decline of TensorFlow - TensorFlow's community activity peaked but has since declined to its lowest point, even lower than its inception [3][10]. - Ant Financial's open-source technology committee vice-chairman Wang Xu announced TensorFlow's removal from the latest open-source landscape map, indicating its diminishing relevance [6][8]. - The decline of TensorFlow reflects a broader trend in the AI open-source landscape, where project lifecycles are now measured in days rather than years [10][53]. Group 2: Open-Source Project Dynamics - The latest open-source landscape map (version 2.0) shows a significant turnover, with 39 new projects added and 60 existing projects removed, indicating a rapid evolution in the ecosystem [17][18]. - Projects that fail to maintain community engagement or lag in iteration speed are at risk of being excluded from the landscape [19][20][21]. - The competitive nature of the AI open-source ecosystem emphasizes the need for continuous innovation and effective community management to sustain project viability [24]. Group 3: New Paradigms in Open Source - The definition and operational model of open source are evolving, with some high-activity projects not adhering to traditional open-source licenses [26][30]. - The operational attributes of open source are becoming more pronounced, with platforms like GitHub serving as critical channels for product release and community engagement [31]. - New AI open-source projects are increasingly adopting customized licensing terms to balance community benefits with commercial interests, indicating a shift towards a more pragmatic approach to open source [32][33]. Group 4: Competitive Landscape - The focus of competition in the AI ecosystem has shifted from broad functionality to performance optimization, particularly in model serving and inference efficiency [35][44]. - The decline in activity for agent frameworks suggests a transition from exploratory phases to more practical, performance-driven applications [41][42]. - The emergence of high-performance inference engines highlights the importance of optimizing model serving to reduce operational costs and enhance application viability [43][44]. Group 5: Global Contribution Dynamics - The global AI open-source landscape is characterized by a "dual center" model, with the U.S. and China as the primary contributors, each excelling in different technological domains [46][49]. - U.S. developers lead in infrastructure contributions, while Chinese developers show strong growth in application innovation, driven by local market demands [51][52]. - The evolving contribution dynamics reflect a shift towards application-driven innovation, with real-world needs shaping the development of AI tools and solutions [50].
没PhD,算什么AI研究员,LeCun论文竟要28岁辍学生审批,发文“暗讽”内讧升级
3 6 Ke· 2025-09-05 03:44
Core Viewpoint - The internal conflict at Meta regarding AI research and leadership dynamics has intensified, particularly between Chief Scientist Yann LeCun and newly appointed Chief AI Officer Alexandr Wang, highlighting differing views on the role and standards of AI researchers versus engineers [1][3][15]. Group 1: Internal Dynamics - LeCun's recent post suggests a critique of Wang's qualifications and approach, emphasizing that true AI researchers should have a PhD, publish papers, and contribute to open-source projects [2][3][15]. - The restructuring of Meta's AI teams has led to concerns that Wang's TBD Lab will oversee and influence the research output of LeCun's FAIR, blurring the lines between engineering and research [13][23]. - LeCun's position at Meta appears precarious, as he must now report to the younger Wang and seek approval for his publications, which he views as a threat to the independence of FAIR [3][19][23]. Group 2: Academic Standards and Achievements - LeCun, a Turing Award winner and a prominent figure in AI, has a significant academic record with over 80 papers published since 2022 and a citation count exceeding 424,000, contrasting sharply with Wang's limited academic output [8][9][21]. - Wang, despite being a successful entrepreneur and the youngest self-made billionaire, lacks a PhD and has only a handful of publications with a citation count of 409, raising questions about his authority in a research-driven environment [6][7][8]. Group 3: Strategic Implications - The ongoing conflict reflects broader strategic challenges for Meta as it seeks to compete in the AGI space against companies like OpenAI and Google, prioritizing rapid product development over long-term academic research [19][23]. - LeCun's vision for AI research emphasizes the need for new paradigms rather than just scaling existing models, which contrasts with Wang's focus on immediate results and product implementation [17][19]. - The shifting priorities within Meta's AI strategy have led to concerns about the future of open research and the potential departure of key figures like LeCun, who may seek opportunities outside the company [23][24].
AI生成苹果Metal内核,PyTorch推理速度提升87%
量子位· 2025-09-04 08:37
henry 发自 凹非寺 量子位 | 公众号 QbitAI AI自动生成的苹果芯片Metal内核,比官方的还要好? Gimlet Labs的最新研究显示,在苹果设备上,AI不仅能 自动生成Metal内核 ,还较基线内核实现了 87% 的PyTorch推理速度提升。 更惊人的是,AI生成的Metal内核还在测试的215个PyTorch模块上实现了平均 1.87倍 的加速,其中一些工作负载甚至比基准快了 数百倍 。 真就AI Make苹果AI Great Again? 用AI为苹果设备生成内核 先说结论:通过AI自动实现内核优化,可以在无需修改用户代码、无需新框架或移植的情况下,显著提升模型性能。 至于为什么是苹果?别问——问就全球最大硬件供应商(doge) 接下来,让我们看看研究人员是怎么做的: 为了证明这一点,研究人员选取了来自Anthropic、DeepSeek和OpenAI的8个顶尖模型,让它们为苹果设备生成优化的GPU内核,以加速 PyTorch推理速度。 实验设置 首先,在模型选择方面,参与测试的模型包括:claude-sonnet-4、claude-opus-4;gpt-4o、gpt-4.1、gpt ...
“干 1 个月,赚了 800 万美元就跑路了?”
程序员的那些事· 2025-09-03 12:02
Core Viewpoint - Despite offering exorbitant salaries, Meta is struggling to retain top talent in its newly formed AI team, Meta Superintelligence Labs (MSL), as evidenced by a wave of departures shortly after its establishment [1][12]. Recruitment and Talent Acquisition - Meta has aggressively recruited over 50 AI professionals from various companies, including 13 from Google and 3 from Apple, with some contracts exceeding $100 million [4][5]. - CEO Mark Zuckerberg has shown unprecedented interest in AI talent, personally reaching out to candidates and persuading them to join Meta [3]. Employee Departures - A significant number of employees, both seasoned veterans and newly hired talent, have left Meta, indicating internal dissatisfaction and instability [6][10]. - Notable departures include long-term employees who contributed to core AI infrastructure, such as Bert Maher and Tony Liu, who have joined competitors like Anthropic [6][7]. Internal Challenges - The high turnover rate reflects underlying issues within Meta, including frequent team restructuring and management changes, leading to employee instability [12]. - Despite high salaries, Meta is finding it difficult to retain influential researchers, highlighting challenges in talent retention and organizational stability [12]. Competitive Landscape - Meta faces intense competition from companies like OpenAI, Anthropic, and Google, which are continuously innovating in the AI space, putting pressure on Meta's talent acquisition and technological advancement [12]. Public Perception and Reactions - The public has reacted to the situation with skepticism, questioning the effectiveness of Meta's recruitment strategy and the actual compensation received by departing employees [13][14].