Meta Platforms(US:META) Ge Long Hui·2025-04-06 06:22Core Viewpoint - The launch of Meta's Llama 4 series marks a significant advancement in open-source AI models, positioning the company to compete with leading tech giants in the AI arms race [1][2]. Group 1: Llama 4 Series Launch - Meta introduced its most powerful open-source AI model, Llama 4, which is a multi-modal model capable of integrating various data types and converting content across different formats [3][4]. - The Llama 4 series features a mixed expert (MoE) architecture, supports 12 languages, and is touted as the strongest open-source multi-modal model available [4]. Group 2: Model Specifications - The Llama 4 series includes two versions: Scout and Maverick [5]. - Scout has 17 billion active parameters, 16 expert models, and a total of 109 billion parameters, supporting up to 10 million context inputs, outperforming OpenAI's models [6][8]. - Maverick also has 17 billion active parameters but features 128 expert models and a total of 400 billion parameters, matching the reasoning capabilities of DeepSeek-v3-0324 with only half the parameters [7][10]. Group 3: Performance Metrics - In extensive benchmark tests, Scout outperformed models such as Gemma 3, Gemini 2.0 Flash-Lite, and Mistral 3.1 [9]. - Maverick excelled in programming, reasoning, multi-language, long context, and image benchmark tests, surpassing GPT-4o and Gemini 2.0 [11]. Group 4: Future Developments - Meta is training a new model, Llama4-Behemoth, which will have 2 trillion parameters and is expected to be released in the coming months [14]. - This model will feature 288 billion active parameters and 16 experts, and is anticipated to outperform GPT-4.5, Claude Sonnet 3.7, and Gemini 2.0 Pro in various STEM benchmark tests [15][16]. Group 5: Strategic Goals - Meta aims to establish itself as a leader in AI by making its models open-source and widely accessible, allowing global benefits [17]. - The company plans to invest $65 billion in expanding its AI infrastructure, including a nearly $1 billion data center project in Wisconsin [19].