Gro 4

Search documents
The Industry Reacts to GPT-5 (Confusing...)
Matthew Berman· 2025-08-10 15:53
Model Performance & Benchmarks - GPT5 demonstrates varied performance across different reasoning effort configurations, ranging from frontier levels to GPT-4.1 levels [6] - GPT5 achieves a score of 68 on the artificial intelligence index, setting a new standard [7] - Token usage for GPT5 varies significantly, with high reasoning effort using 82 million tokens compared to minimal reasoning effort using only 3.5 million tokens [8] - LM Arena ranks GPT5 as number one across the board, with an ELO score of 1481, surpassing Gemini 2.5 Pro at 1460 [19][20] - Stage Hand's evaluations indicate GPT5 performs worse than Opus 4.1 in both speed and accuracy for browsing use cases [25] - XAI's Grok 4 outperforms GPT5 in the ARC AGI benchmark [34][51] User Experience & Customization - User feedback indicates a preference for the personality and familiarity of GPT-4.0, even if GPT5 performs better in most ways [2][3] - OpenAI plans to focus on making GPT5 "warmer" to address user concerns about its personality [4] - GPT5 introduces reasoning effort configurations (high, medium, low, minimal) to steer the model's thinking process [6] - GPT5 was launched with a model router to route to the most appropriate flavor size of that model speed of that model depending on the prompt and use case [29] Pricing & Accessibility - GPT5 is priced at $1.25 per million input tokens and $10 per million output tokens [36] - GPT5 is more than five times cheaper than Opus 4.1 and greater than 40% cheaper than Sonnet [39]
Grok 4 Fully Tested (INSANE)
Matthew Berman· 2025-07-11 18:18
Gro 4 has been out for less than 24 hours and I have put it through its paces. I'm going to show you all the tests. Let's get right into it.So, we have two versions that we're going to be using today. We have Gro 4 and Gro 4 heavy. I tried to use the appropriate model when appropriate.I use Gro 4 heavy for the more logic and reasoning intensive task and the regular Gro 4 for others. Turns out some tests are more appropriate for one than the other. Let me show you the first one.Write Python code that impleme ...