刚刚！马斯克开源 Grok 2.5，还说中国公司才是最大对手

Core Insights - xAI has officially open-sourced Grok-2, a model with 905 billion parameters and a context length of 128k tokens, marking a significant advancement in AI capabilities [3][4][11] - Grok-3 is expected to be open-sourced in six months, indicating a rapid development cycle for xAI [6] Technical Features - Grok-2 has a total parameter count of 905 billion, with 136 billion parameters activated during inference, making it one of the most powerful open-source models available [11] - The model supports a context length of up to 131,072 tokens, allowing it to process lengthy documents or dialogues effectively [11] - It utilizes a mixture of experts (MoE) architecture, enhancing model capabilities without significantly increasing computational costs [11] - The training data for Grok-2 includes a wide range of text and code, up to early 2024 [11] Commercial Use and Licensing - Commercial use of Grok-2 is permitted only for companies with annual revenues below $1 million; otherwise, separate licensing from xAI is required [14] - Modifications or fine-tuning of Grok-2 are restricted unless explicitly allowed by the licensing agreement [14] Deployment and Usage - Grok-2 can be downloaded from Hugging Face, with a total file size of approximately 500GB [14][17] - Users are instructed to deploy the model using the SGLang inference engine, requiring specific hardware configurations [18][19] Industry Impact and Future Developments - xAI's rapid development is highlighted by the construction of a massive data center in Memphis, operational within 122 days and equipped with 100,000 NVIDIA H100 GPUs [21] - The company aims to build a supercomputer with 5,000 H100 GPUs within five years, positioning itself as a formidable player in the AI landscape [29] - Elon Musk expressed confidence that xAI will surpass competitors, including Google, with Chinese companies identified as the primary challengers [30]