3 6 Ke·2025-12-22 10:12Core Insights - Gemini 3 Flash has outperformed its predecessor Gemini 2.5 Pro and even the flagship Gemini 3 Pro in various performance metrics, achieving a score of 78% in the SWE-Bench Verified test, surpassing the Pro's score of 76.2% [1][5][6] - The Flash version demonstrates significant improvements in programming capabilities and multimodal reasoning, with a score of 99.7% in the AIME 2025 mathematics benchmark when code execution is included [5][6] - Flash's performance in the challenging Humanity's Last Exam test is competitive, scoring 33.7% without tools, closely trailing the Pro's 37.5% [5][6] Performance Metrics - In the SWE-Bench Verified test, Gemini 3 Flash scored 78%, while Gemini 3 Pro scored 76.2% [5][6] - In the AIME 2025 mathematics benchmark, Flash scored 99.7% with code execution, while Pro scored 100% [6] - Flash achieved 33.7% in the Humanity's Last Exam, compared to Pro's 37.5% [5][6] Cost and Efficiency - Gemini 3 Flash has a competitive pricing structure, with input costs at $0.50 per million tokens and output costs at $3.00 per million tokens, which is higher than Gemini 2.5 Flash but justified by its performance [7] - Flash's inference speed is three times that of Gemini 2.5 Pro, with a 30% reduction in token consumption [7] Strategic Insights - Google’s core team views the Pro model as a means to distill the capabilities of Flash, emphasizing that Flash's smaller size and efficiency are crucial for users [11][12] - The development team believes that the traditional scaling law is evolving, with a shift from merely increasing parameters to enhancing inference capabilities [12][14] - The emergence of Flash has sparked discussions about the validity of the "parameter supremacy" theory, suggesting that smaller, more efficient models can outperform larger ones [13][14]