
Google's Gemini 4 Argon is closer to the AI frontier than any Google model in months
Quick Answer
Google DeepMind's Gemini 4 Argon achieved a 97.5% score on the ARC-AGI-3 benchmark, making it the second AI lab to surpass 95%, but it lags in math and software engineering compared to competitors.
Quick Take
The model's performance is heavily influenced by testing setups, with costs reaching $4,800.
Key Points
- Gemini 4 Argon scored 97.5% on -3, trailing only GPT-6 Astra at 99.9%.
- The model required 62% fewer actions than the human baseline across 25 games.
- In the Standard Harness, Argon's score dropped to 49.8% due to testing limitations.
- Epoch AI's Capabilities Index ranks Argon at 165 points, just behind GPT-6 Astra and Opus 5.5.
- Argon leads in several benchmarks but ranks eighth in Math ECI and sixth in Software Engineering.
DeepSignal Analysis
What happened
Google DeepMind's Gemini 4 Argon achieved a score of 97.5% on the ARC-AGI-3 benchmark, making it the second AI lab to surpass 95%. However, it lags behind competitors in math and software engineering. The model's performance is significantly influenced by the testing setup, with costs reaching $4,800.
Key evidence
- Gemini 4 Argon scored 97.5% on the ARC-AGI-3 benchmark, becoming the second AI lab to exceed 95%, following OpenAI.
- In the 'Standard Harness' test setup, Argon dropped to 49.8% at low reasoning, indicating a significant performance variance based on testing conditions.
- Epoch AI's Capabilities Index (ECI) ranked Argon at 165 points, placing it behind GPT-6 Astra (166) and Opus 5.5 (167) in overall capabilities.
Why it matters
The performance of Gemini 4 Argon on the ARC-AGI-3 benchmark highlights the competitive landscape in AI development, particularly in general problem-solving capabilities. While achieving a high score is notable, the model's limitations in math and software engineering suggest that it may not be as versatile as its competitors. The reliance on specific testing setups raises questions about the generalizability of these results.
📖 Reader Mode
~3 min readGoogle Deepmind is the second major AI lab to pass 95 percent on the ARC-AGI-3 benchmark. But the results depend heavily on the testing method, and Argon trails rivals in math and software engineering, according to Epoch AI.
Google Deepmind's new frontier model, Gemini 4 Argon, scored 97.5 percent on ARC-AGI-3 at a cost of $4,800 using the "Provider Adapter Harness," a test setup that uses vendor-specific features like retained reasoning and context compaction. According to ARC Prize, Google is now the second AI lab after OpenAI to cross the 95 percent mark on what is widely considered the toughest benchmark for general problem-solving. Only GPT-6 Astra scores higher at 99.9 percent.

Like Astra, Argon needed 62 percent fewer actions than the human baseline across the 25 public games. It matched or beat the speedrun record in three games and came within 10 percent of the best time in six others. On older versions of the benchmark, Argon scored 91.3 percent on ARC-AGI-2 ($0.32 per task) and 98.5 percent on ARC-AGI-1 ($0.16 per task), based on the introductory price of $2 per million input tokens and $10 per million output tokens.

Benchmark results depend heavily on the testing setup
In the "Standard Harness," which only allows simple notes between rounds, Argon drops to 49.8 percent at low reasoning for $5,800. This gap traces back to a July 2026 dispute when OpenAI's GPT-5.6 Sol beat Claude Opus 5 on ARC-AGI-3 using two API settings.
GPT-5.6 Sol only managed 7.8 percent in the standard environment, which discards internal reasoning after each action and used an older interface lacking newer Claude API features. That meant Claude was tested under different conditions than GPT-5.6. When tested with OpenAI's own Responses API, including "Retained Reasoning" and smart context "Compaction," the model jumped to 38.3 percent and beat Opus 5 at 30.2 percent. OpenAI argued that benchmarks always measure the technical environment too. ARC Prize co-founder Francois Chollet then allowed general, publicly available API settings.
API problems also prevented Argon from completing all 55 games in the Standard Harness, according to the testers. At low reasoning, the system finished 42 games (49.8 percent), at medium 46 games (46.3 percent). At the highest level, it only completed 19 games, so ARC Prize did not publish a score. The reported results still cover all 55 games by including partial points from aborted runs.
Argon closes the gap but lags in math and coding
Research institute Epoch AI tracked Google's progress too. Argon scored 165 points on the Epoch Capabilities Index (ECI), tying Fable 5.1 and landing just behind Opus 5.5 (167) and GPT-6 Astra (166). The ECI combines over 50 benchmarks into a single capability scale, similar to how Artificial Analysis builds its main score.

Argon jumps well ahead of Gemini 3.8 Flash (157 points) and brings Google closer to the top than at any point since Gemini 3.1 Pro in February. Artificial Analysis and Vals.ai confirmed this trend before.
Performance varies by domain, though. According to Epoch AI, Argon leads several knowledge, agent, and vision benchmarks, but early estimates put it in eighth on the Math ECI and sixth on the Software Engineering Index (SWE ECI).
— Originally published at the-decoder.com
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from The Decoder
See more →
An AI model programmed nonstop for 19 days on a single MirrorCode task that cost $2,600 to run
Epoch AI's MirrorCode benchmark reveals Claude Opus 4.7 as the leader with a 56% solve rate, reconstructing a 16,000-line toolkit in 14 hours. Despite this, all models tested struggle with the most complex tasks, highlighting limitations in current AI capabilities. The single task consumed $2,600 over 19 days, raising questions about cost-effectiveness in AI development.

