Isaac Sim
Search documents
微软研究院发布Rho-alpha机器人模型,融合了视觉、语言和触觉功能
Sou Hu Cai Jing· 2026-02-06 21:19
智行时代——具身智能技术生态 参与该项目的研究人员表示,缺乏多样化的真实世界机器人数据仍然是基础模型面临的主要挑战。 华盛顿大学助理教授阿比舍克·古普塔(Abhishek Gupta)表示:"虽然通过远程操作机器人系统生成训练数据已成为一种标准做法,但在许多情况下,远程操 作是不切实际的或不可能的。我们正在与微软研究院合作,利用仿真和强化学习相结合的方法,通过各种合成演示来丰富从物理机器人收集的预训练数据 集。" 据Robotics & Automation News报道,微软研究院发布了Rho-alpha,这是一款新型机器人模型,旨在帮助机器人理解自然语言指令,并在结构化程度较低 的环境中执行复杂的物理任务。 该模型源自微软的Phi系列视觉语言模型,目前正通过微软的早期研究访问计划(REAP)发布。据微软称,Rho-alpha旨在推动新一代机器人系统的发 展,使其能够在动态的真实世界环境中进行感知、推理和行动。 几十年来,机器人最擅长在工厂和仓库等严格控制的环境中运行,因为这些环境中的任务是可预测的,并且经过精心编写。然而,近年来智能体人工智能 的进步正在催生新的"视觉-语言-动作"模型,使物理系统能够以更 ...
2026年:AI开始“物理扎根”
3 6 Ke· 2026-01-27 05:35
在技术迭代周期不断压缩的时代背景下,我们似乎总在寻找一个"转折年"。 进入2026年,肉眼可见的转变是:人工智能的主流应用,从数字领域的生成与对话,无可逆转地转向物理领域的感知应用。 AI的"ChatGPT时刻"是否已到来 如果说过去的AI擅长在比特世界里预测下一个词,那么现在就变成了如何在原子世界里预测并塑造下一个世界状态。黄仁勋称之为AI的"ChatGPT时刻"。 这就是最近科技圈比较火的一个概念:物理AI。它的特性是AI可以理解物理定律,与现实环境互动并施加改变的智能系统,实现"假设-AI模拟-实验验 证"的科研新范式。这有望成为驱动这场新工业革命最具想象力的动力引擎。 但坦白说,物理AI的突破,可能要更为艰难。业内共识是,5到10年的深耕可能只是起步。 这就引出了物理AI最核心的发展逻辑。它不像语言模型去集纳规模化的数据符号。简单说,它既是AI,也是AI训练员。 你可以这样理解:一个优秀的语言模型,需要海量的文本语料来习得语法、逻辑与知识关联。而一个可靠的物理AI,则需要海量的物理交互语料来内化 这个世界的运行法则。它需要知道,用力推一个放在桌沿的杯子,后果大概率是碎裂;它也需要体会,在光滑瓷砖地和在 ...
AI芯片狂卷1480亿美元,但这块业务却熄火:英伟达押注制造业四年收益寥寥
Hua Er Jie Jian Wen· 2026-01-07 13:47
Core Insights - Nvidia's AI chip business generated nearly $148 billion in revenue over the past nine months, significantly surpassing the $27.5 billion from the same period in 2023, but the company's transition to an integrated hardware-software platform has faced major setbacks [1] - The Omniverse software, which was intended to be a core tool for creating digital twins in manufacturing and logistics, has seen minimal revenue and a stalled commercialization process, leading to the decision to shut down the Omniverse Cloud service by August 2025 due to lack of demand [1][3] - CEO Jensen Huang expressed frustration over the slow progress of the Omniverse division, criticizing the team for focusing on demonstrations rather than product development, and highlighting the lack of widespread adoption by large enterprises [1][4] Revenue and Market Response - Despite the explosive growth in AI chip revenue, the market has not reacted strongly to the revenue gap from Omniverse, indicating the challenges Nvidia faces in establishing a second growth curve [2] - The inability to address software usability and industry adaptation issues may hinder Nvidia's ambitions in robotics and industrial digitalization for the long term [2] Demand and Service Closure - Omniverse was launched in 2021 as a platform for designers to collaborate on 3D designs, but the reality has fallen short of expectations, with few clients actually signing on for large-scale simulations [3] - Developers have reported that the platform is difficult to use, incomplete, and prone to crashes, leading to the termination of the cloud service project [3] Internal Pressure and Management Concerns - Huang's anxiety over Omniverse's performance is evident, as he has pressured the team to find new revenue sources and has expressed frustration in internal meetings regarding the lack of profitability and the team's focus on demonstrations [4] - The actual outcomes of collaborative projects have also led to dissatisfaction among management, particularly regarding the scale of partnerships with companies like BMW [4] Long-term Challenges and Industry Barriers - Nvidia executives compare Omniverse to CUDA, suggesting that it may take years of investment to fully realize its potential in the "physical AI" market [6] - The company faces intense competition and structural barriers in the robotics simulation field, with many large enterprises preferring to develop their own internal simulation software rather than relying on Nvidia's platform [6] - Industry-specific technical challenges and cost-effectiveness issues also pose significant obstacles to the widespread adoption of Omniverse [6][5] Development and Market Creation - Currently, Omniverse is seen as a horizontal open platform for developers rather than a complete application, indicating that Nvidia's attempt to create a market from scratch will require a lengthy nurturing period [7]
黄仁勋最想赢的一仗, 四年仍在原地踏步
3 6 Ke· 2026-01-06 01:35
Core Insights - Nvidia has experienced remarkable growth in its AI chip business, with revenue soaring from $27.5 billion in the first nine months of 2023 to nearly $148 billion in the same period of 2024, a growth rate that is rare in the tech industry history [1] - CEO Jensen Huang is not satisfied with this growth and is betting on the next phase of Nvidia's development in robotics and manufacturing through the Omniverse platform [2][4] - However, the Omniverse initiative has not met expectations, leading to frustration from Huang [3][9] Group 1: Omniverse Overview - Omniverse was initially launched with high ambitions, with Huang emphasizing its strategic importance and potential to capture a share of the $50 trillion manufacturing and logistics market [4][6] - Despite the high-profile endorsements and partnerships, insiders reveal that Omniverse has made little substantial progress over four years, with very few companies actually utilizing its cloud services for large-scale simulations [7][10] - Developers have criticized the Omniverse tools for being difficult to use and prone to crashes, with one developer noting that the platform fails when attempting complex simulations [8][12] Group 2: Challenges and Limitations - The complexity of simulating physical behaviors in robotics and manufacturing is far greater than anticipated, particularly when dealing with flexible materials and fluid dynamics [11][12] - Omniverse's initial vision of a universal simulation platform has proven inefficient, as specific simulations for particular scenarios are more effective [13][14] - Many companies prefer to develop their own simulation software, as seen with Tesla, which indicates a reluctance to adopt Nvidia's offerings [15][19] Group 3: Strategic Implications - The setbacks with Omniverse could have broader implications for Nvidia's strategic positioning within the tech industry, as it seeks to transition from a hardware manufacturer to a provider of comprehensive ecosystems [20][21] - If Omniverse fails, Nvidia risks losing its opportunity to define the next generation of standards in the manufacturing and robotics sectors, potentially relegating it to a mere hardware supplier [22][23] - Competitors are already encroaching on the market, with companies like Unity Technologies and Gazebo gaining traction, which could threaten Nvidia's market share [18][22] Group 4: Future Outlook - Huang's concerns about the slow adoption of Omniverse by large companies reflect a broader anxiety about establishing a unified standard in a fragmented market [27][28] - The rapid development of the robotics industry presents a critical window for Nvidia to establish its standards; failure to do so may hinder its influence in future technological landscapes [30][31] - While the market demand for simulation technology exists, the timing for its explosion remains uncertain, and Nvidia's ability to define the ecosystem will be crucial for its long-term success [31][33]
Lokesh meets Pichai to review progress of Vizag data centre project
BusinessLine· 2025-12-10 02:03
Group 1: Investment and Collaboration - Andhra Pradesh's IT and Industries Minister Nara Lokesh met with Sundar Pichai and Shantanu Narayen to review the $15 billion investment in the Visakhapatnam AI Data Center, which is expected to be one of the largest foreign direct investment (FDI) projects [1] - The Minister invited Google to establish a drone assembly, calibration, and testing unit in the upcoming Drone City and to enhance the server manufacturing ecosystem in Andhra Pradesh [2] - Discussions were held with NVIDIA's Raj Mirpuri regarding AI skill development, smart manufacturing, and future technologies, including a request to set up a Smart Factory Pilot using Omniverse & Isaac Sim [3] Group 2: Technology and Manufacturing Initiatives - The Minister invited Intel to explore the establishment of an ATMP (Assembly, Testing, Marking & Packaging) unit in Andhra Pradesh [4] - Meetings with OpenAI's CTO and AMD's Vice-President were conducted to consider potential investments in Andhra Pradesh [4] - The focus on deeper collaboration in fabless design, research, and leveraging health-tech and life sciences investments was emphasized during discussions with Adobe [2]
自动化龙头发那科股价大涨近10%! 强强联手英伟达(NVDA.US)加速推进“物理AI”叙事
智通财经网· 2025-12-02 04:24
Core Viewpoint - Fanuc Corp. is collaborating with Nvidia to integrate its ROBOGUIDE robot simulation software with Nvidia's physical AI engine, marking a significant shift from traditional automation to a focus on intelligent industrial robotics and physical AI platforms [1][5]. Group 1: Collaboration Details - The partnership aims to enhance virtual simulation and real production line integration, strengthening Fanuc's position in high-end industrial manufacturing [1]. - Fanuc is integrating Nvidia's open-source robot simulation framework into its software system to facilitate virtual operation testing for its industrial robots [2]. Group 2: Market Context and Implications - The collaboration comes amid increasing competition in Japan's industrial robotics sector, particularly with SoftBank's planned acquisition of ABB's robotics division, which poses a direct challenge to Fanuc's core business [3]. - Analysts suggest that industries heavily reliant on manual labor, such as logistics, food, and automotive assembly, will be the first beneficiaries of the new wave of AI-driven industrial robotics [2][3]. Group 3: Future Outlook - The evolution towards a "physical AI" platform signifies a shift in the value chain from hardware sales to a model that includes hardware, computational power subscriptions, digital twin/simulation software, and AI model services [2]. - Nvidia's Isaac Sim is positioned as a core component of the physical AI technology stack, enabling robots to perceive, reason, and act in the real world [4].
10 Best Dow Stocks to Buy According to Wall Street Analysts
Insider Monkey· 2025-10-27 14:42
Market Overview - On October 24, US stocks reached record highs due to positive investor sentiment following inflation data showing slower price increases than expected, raising hopes for continued interest rate cuts by the Federal Reserve [1] - The consumer price index (CPI) for September increased by 0.3% month-over-month, resulting in an annual inflation rate of 3%, slightly below economists' expectations of 0.4% and 3.1% respectively [2] - Core CPI, excluding food and energy, rose by 0.2% for September and 3% year-over-year, also below Dow Jones estimates [3] - Major indexes, including the Dow Jones Industrial Average, S&P 500, and Nasdaq Composite, closed at record levels, with the Dow gaining 17.35% over the past six months [4] Company Insights - The Sherwin-Williams Company (NYSE:SHW) is highlighted as one of the best Dow stocks to buy, with an average price target upside potential of 15.23% and 67 hedge fund holders [10] - Wells Fargo reduced its price target for The Sherwin-Williams Company from $400 to $395 while maintaining an Overweight rating, citing ongoing challenges but a positive long-term outlook [11] - NVIDIA Corporation (NASDAQ:NVDA) is also noted as a top Dow stock, with an average price target upside potential of 15.46% and 235 hedge fund holders [13] - NVIDIA is collaborating with Google Cloud to enhance access to accelerated computing, aiming to support enterprise AI and industrial digitization [14][15]
黄仁勋女儿首秀直播:英伟达具身智能布局藏哪些关键信号?
机器人大讲堂· 2025-10-15 15:32
Core Insights - The discussion focuses on bridging the Sim2Real gap in robotics, emphasizing the importance of simulation in training robots to operate effectively in the real world [2][4][10] Group 1: Key Participants and Context - Madison Huang, NVIDIA's head of Omniverse and physical AI marketing, made her first public appearance in a podcast discussing robotics and simulation [1][2] - The conversation featured Dr. Xie Chen, CEO of Lightwheel Intelligence, who has extensive experience in the Sim2Real field, having previously led NVIDIA's autonomous driving simulation efforts [2][9] Group 2: Challenges in Robotics - The main challenges in bridging the Sim2Real gap are identified as perception differences, physical interaction discrepancies, and scene complexity variations [4][6] - Jim Fan, NVIDIA's chief scientist, highlighted that generative AI technologies could enhance the realism of simulations, thereby reducing perception gaps [6][7] Group 3: Importance of Simulation - Madison Huang stated that robots must experience the world rather than just read data, as real-world data collection is costly and inefficient [7][9] - The need for synthetic data is emphasized, as it can provide a scalable solution to the data scarcity problem in robotics [9][10] Group 4: NVIDIA's Technological Framework - NVIDIA's approach involves a "three-computer" logic: an AI supercomputer for processing information, a simulation computer for training in virtual environments, and a physical AI computer for real-world task execution [10][11] - The simulation computer, powered by Omniverse and Isaac Sim, is crucial for developing robots' perception and interaction capabilities [11][12] Group 5: Collaboration with Lightwheel Intelligence - The partnership with Lightwheel Intelligence is highlighted as essential for NVIDIA's physical AI ecosystem, focusing on solving data bottlenecks in robotics [15][16] - Both companies share a vision for SimReady assets, which must possess real physical properties to enhance simulation accuracy [16][15] Group 6: Future Directions - The live discussion is seen as an informal introduction to NVIDIA's physical intelligence strategy, which aims to create a comprehensive ecosystem for robotics [18] - As collaboration deepens, it is expected to transform traditional robotics technology pathways [18]
在具身智能的岔路口,这场论坛把数据、模型、Infra聊透了
机器之心· 2025-09-29 02:52
Core Viewpoint - The field of embodied intelligence is experiencing unprecedented attention, yet key issues remain unresolved, including data scarcity and differing technical approaches [1][2][3] Group 1: Data and Technical Approaches - The industry is divided into two factions: the "real machine" faction, which relies on real-world data collection, and the "synthetic" faction, which believes in the feasibility of synthetic data for model training [5][12] - Galaxy General, representing the synthetic faction, argues that achieving generalization in embodied intelligence models requires trillions of data points, which is unsustainable through real-world data alone [8][9] - The "real machine" faction challenges the notion that real-world data is prohibitively expensive, suggesting that with sufficient investment, data collection can be scaled effectively [12][14] Group 2: Model Architecture - Discussions around the architecture of embodied intelligence models highlight a divide between end-to-end and layered approaches, with some experts advocating for a unified model while others support a hierarchical structure [15][19] - The layered architecture is seen as more aligned with biological evolution, while the end-to-end approach is criticized for potential error amplification [19][20] - The debate extends to the relevance of VLA (Vision-Language Alignment) versus world models, with some experts arguing that VLA is currently more promising due to its data efficiency [21][22] Group 3: Industry Trends and Infrastructure - The scaling law in embodied intelligence is beginning to emerge, indicating that expanding model and data scales could be effective [24] - The industry is witnessing an acceleration in the deployment of embodied intelligence technologies, with various companies sharing their experiences in human-robot interaction and industrial applications [24][29] - Cloud service providers, particularly Alibaba Cloud, are emphasized as crucial players in supporting the infrastructure needs of embodied intelligence companies, especially as they transition to mass production [29][31] Group 4: Alibaba Cloud's Role - Alibaba Cloud has been preparing for the exponential growth in data and computational needs associated with embodied intelligence, having developed capabilities to handle large-scale data processing and model training [33][35] - The company offers a comprehensive suite of cloud-based solutions to support both real and synthetic data production, enhancing efficiency and reducing costs [35][36] - Alibaba Cloud's unique position as a model provider and its engineering capabilities are seen as significant advantages in the rapidly evolving embodied intelligence landscape [37][41]
仿真专场!一文尽览神经渲染(NERF/3DGS)技术在具身仿真框架Isaac Sim中的实现
具身智能之心· 2025-09-28 01:05
Core Viewpoint - Neural Rendering (NERF/3DGS) is revolutionizing 3D reconstruction technology, significantly enhancing the realism of images used in autonomous driving and embodied intelligence simulations, addressing the limitations of traditional computer graphics rendering [3][4]. Group 1: Background and Technology - NERF and 3DGS utilize neural networks to express spatial data, excelling in new perspective synthesis, which is crucial for sensor simulation in autonomous driving and embodied intelligence [3]. - The integration of NERF and 3DGS into existing simulation frameworks is proposed as a more efficient approach than developing new frameworks from scratch, allowing for real-time rendering while leveraging existing 3D digital assets and algorithm interfaces [3][4]. Group 2: Implementation in Simulation Software - NVIDIA's Isaac Sim has incorporated neural rendering technology, enabling the insertion of 3DGS models into simulation environments, allowing for both static backgrounds and dynamic interactive objects [4][5]. - The process of importing 3DGS models into Isaac Sim involves generating USDZ models and ensuring they possess physical properties for interaction within the simulation [5][8]. Group 3: Model Interaction and Physics - To achieve realistic interactions, imported models must have physical attributes added, such as collision properties, to ensure they interact correctly with other objects in the simulation [8][14]. - The integration of dynamic objects, such as a LEGO bulldozer, into the simulation environment demonstrates the capability of 3DGS models to interact with both static and dynamic elements [11][15]. Group 4: Performance and Future Considerations - The performance metrics indicate that even with a high workload, the simulation maintains a good frame rate and low memory usage, showcasing the efficiency of the neural rendering technology [17]. - Future challenges include improving light and shadow interactions between 3DGS models, providing accurate ground truth information for algorithms, and enhancing computational efficiency for larger scenes [18][19].