Science & Tech · AI · 4 hrs ago

Google’s Gemini 4 Argon ranks fifth in Android coding benchmark

Google’s Gemini 4 Argon ranks fifth in Android coding benchmark

Google updated its Android coding benchmark on October 26, adding results for several new AI models.

The test is designed to help Android developers compare coding assistants using tasks and practices specific to Android development.

Google’s Gemini 4 Argon ranked fifth, behind several Claude and GPT models.

Claude Sonnet 5.5 topped the list, with a 40% pass rate and an 80.9% completion rate.

GPT-6.1 Sol had a lower pass rate of 29.3% but a higher completion rate of 82.8%, and its listed average cost was $99.50, compared with $1,574.90 for Claude Sonnet 5.5.

The benchmark also now shows each model’s reasoning level and average cost, helping developers weigh performance against cost when choosing a tool.

1 source

Related

What people are saying

Internal voicesUnnamed people inside Google
struggles to handle certain coding tasks
via 9to5Google