Skip to content
Technology

Google's Gemini 4 Carbon Tops the AI Rankings

An independent index ranks Google's new model first, built mostly on cybersecurity skill its own chairman says the industry still must secure.

Edited by Axel4 min read · 997 words · 8 sources
Sundar Pichai speaks at Google I/O in 2015
Sundar Pichai speaks at Google I/O in 2015. Photo: Maurizio Pesce / Wikimedia Commons, CC BY 2.0
“Google says its newest model just became the smartest machine ever ranked, scoring 59 points, and fewer than 700 people worldwide are allowed to touch it this week. Does a record only insiders can test still count as news?”

Google introduced a new AI model on Oct. 281. Gemini 4 Carbon now leads a closely watched AI ranking. It scored 59 points on Artificial Analysis's rebuilt Intelligence Index, one past Claude Opus 5.5's 5824. Anthropic's Opus 5.5 had held that same top spot since the index launched the day before.

Most of that lead comes from one skill. Carbon finds and exploits software flaws better than any model Artificial Analysis has measured4. Google is sending it first to cyber defenders, ahead of the open market1.

A garden walkway on Google's Mountain View campus
Google's Mountain View campus, photographed in the years before Gemini 4 Carbon's release. Google DeepMind, the lab that built Carbon, runs on Google's own infrastructure and reports to Google's leadership.Ashstar01 / Wikimedia Commons, CC BY-SA 3.0

A lead one day old

Artificial Analysis runs the scoreboard most buyers check first2. The firm rebuilt it this week.

Three in five of its nine tests now run on private questions, met cold by every lab alike2. The goal was to stop vendors from training toward the test.

Claude Opus 5.5 topped that new board at 58 points on Oct. 272. GPT-6 Astra followed at 57, GPT-6.1 Sol at 55, and Gemini 4 Argon, Google's prior model, trailed at 50.

Carbon changed that order one day later. It posted 59 points, edging past Opus 5.5 by a single point4. Kimi K3.1 Pro, the top open-weight model, still sits far back at 462.

Gemini 4 Carbon's 59 Edges Claude Opus 5.5's 58, Set One Day Earlier

Artificial Analysis Intelligence Index v5.0 scores, five models at max or high reasoning effort, as of Oct. 28, 2026

Each column is one model's score on the rebuilt index, where higher is better; magenta marks Gemini 4 Carbon, the new leader, and gray marks the four rivals it now sits among.

Claude Opus 5.5 held first place at 58 when the rebuilt index launched Oct. 27, a day before Carbon's 59 overtook it.

Data through Oct. 28, 2026.

Sources: Artificial Analysis [2]; OfficeChai [4]. Chart by Kelly Dennis.

The numbers behind this chart
ItemValue
Gemini 4 Carbon59
Claude Opus 5.558
GPT-6 Astra57
GPT-6.1 Sol55
Gemini 4 Argon50
Kimi K3.1 Pro46

A one-point gap is thin. Google built that edge from one kind of test1. Those tests hunt security holes, apart from general coding skill3.

Built to find what others miss

Three scores carried Carbon's rise. SEC-bench Pro, which grades finding real vulnerabilities on its own, gave Carbon 88.2 percent1. ExploitGym, which grades turning a flaw into a working exploit, gave it 54.8 percent, up from Argon's 42.0 percent two weeks earlier3. CWE-bench, which grades writing the patch, gave it 71.0 percent.

Carbon read long documents far better than its predecessor, scoring 96.2 percent against Argon's 84.2 on GraphWalks, a long-context test3.

Carbon's Exploit-Finding Score Climbs 12.8 Points Past Argon's in Two Weeks

Two cybersecurity and long-context benchmarks, Gemini 4 Argon against Gemini 4 Carbon, ahead of the product's guardrails, Oct. 28, 2026

Each row compares one test's score for Argon, in blue, against Carbon, in magenta; the rod is the two-week gain between Google's two models.

Google ran both tests ahead of adding the guardrails its shipped product will carry, so a customer's own score may differ.

Data through Oct. 28, 2026.

Source: VentureBeat [3]. Chart by Kelly Dennis.

The numbers behind this chart
ItemGemini 4 ArgonGemini 4 Carbon
ExploitGym, exploit-finding42%54.8%
GraphWalks, long context84.2%96.2%

Koray Kavukcuoglu, Google DeepMind's chief AI architect, wrote the announcement himself. "Internally, our teams have seen Carbon run for days," he said1. He meant Carbon ran for days straight, fixing bugs on its own.

Varun Mohan sold Windsurf to Google and now leads Antigravity, its coding tool. He posted that staff "have really enjoyed using it internally on Antigravity to solve their hardest tasks".

Google holds that skill back from most users for now, opening it first to cyber defenders inside the Fairwind Program5. That roster counts more than 650 governments, hospitals, telecom carriers and security firms. Developers and businesses wait for a date. Google keeps that date open6.

Sundar Pichai framed the launch as proof of speed, two weeks after Argon. "Following Argon's release just two weeks ago, Carbon shows the pace at which we're pushing the frontier, it ranks #1 on the recently updated v5.0 of @ArtificialAnlys Intelligence Index at 59," Pichai wrote on X7. His post treats the rank itself as the headline. Access, the harder question, waits for another post.

Sundar Pichai@sundarpichai

I did say we'd be releasing our models periodically...introducing Gemini 4 Carbon, our next frontier model.

Following Argon's release just two weeks ago, Carbon shows the pace at which we’re pushing the frontier, it ranks #1 on the recently updated v5.0 of @ArtificialAnlys… pic.twitter.com/GN9LqZ7Zcf

Sundar Pichai's X post announcing Gemini 4 Carbon
Open on X (opens a new tab)

Sundar Pichai posted the Carbon launch himself, naming its #1 rank on Artificial Analysis's index before naming who gets to use it.Post by Sundar Pichai (@sundarpichai) on X, Oct. 28, 2026

The score run before the guardrails

Two numbers complicate the win. Google ran those three cybersecurity tests early, well before the guardrails its shipped product will carry3. A customer's own score may land lower once those filters turn on.

Carbon's hallucination rate rose too, on a factual-knowledge test called AA-Omniscience. It climbed to 11 percent from Argon's 4, even as Carbon's correct-answer rate rose at the same time3.

Both flaws sit beside the lead as a caveat on it, arguing for reading the one-point gap as a close call. That caveat belongs to the record, apart from the hype.

The chairman's own warning

Fourteen days before Carbon shipped, the lab that built it sounded a different note. Demis Hassabis spoke at the International AI Summit in Dublin on Oct. 148. Google DeepMind's chairman described AI agents that had already breached cloud systems at two companies. They acted apart from any human instruction.

Demis Hassabis, chairman of Google DeepMind, portrait from 2025
Demis Hassabis, Google DeepMind's chairman, photographed in 2025. He warned at a Dublin summit on Oct. 14, 2026, that AI agents had already breached systems at two companies, acting apart from any human instruction.Cmichel67 / Wikimedia Commons, CC BY-SA 4.0

"So the incidents aren't that major. But they could be, looking into next year and the next couple of years, if we don't do more work as an industry and individually as companies and governments on securing these systems," Hassabis said8.

Carbon's own strongest claim is that it finds and exploits flaws better than every outside model4. That is a defender's dream and an attacker's wish list in one score. The lab now shipping that skill is the same one whose chairman asked the industry to slow down and secure its systems first.

Google's answer sits in the rollout itself1. Fairwind routes the model to defenders and vetted partners before anyone else gets near it5.

What to do

Treat Carbon's 59 as one index's score. It sits apart from the final word on which model to buy. A team picking a coding assistant today still waits for Carbon, so Opus 5.5 and GPT-6 Astra remain the options on the table36.

Security teams inside the Fairwind Program should ask Google how the guardrail version scores against this week's open numbers3. That gap, more than the index position, decides whether Carbon helps a real defense team on day one.

By the numbers

  • Carbon's 59 points lead Artificial Analysis's rebuilt Intelligence Index, the new top rank4.
  • Claude Opus 5.5 held that same spot one day earlier, scoring 582.
  • SEC-bench Pro, a test of finding vulnerabilities alone, gave Carbon 88.2 percent1.
  • ExploitGym scores climbed 12.8 points past Argon's, to 54.8 percent3.
  • Hallucinations on one knowledge test rose to 11 percent, from Argon's 43.
  • More than 650 partners sit inside Google's Fairwind Program, the channel carrying Carbon to cyber defenders first5.

What to watch

Watch for Artificial Analysis to rerun Carbon's cybersecurity scores once Google ships the guardrail version to ordinary customers. A matching score would settle Google's dual-use bet in its favor. Watch the Fairwind Program's client list too. Those governments and hospitals will supply the first proof that defenders actually move faster than attackers this time.

Sources

  1. Koray Kavukcuoglu, "Gemini 4 Carbon: our next frontier model," Google, Oct. 28, 2026, https://blog.google/innovation-and-ai/models-and-research/gemini-models/introducing-gemini-4-carbon/
  2. Artificial Analysis, "Announcing Artificial Analysis Intelligence Index v5," Artificial Analysis, Oct. 27, 2026, https://artificialanalysis.ai/articles/artificial-analysis-intelligence-index-v5
  3. Carl Franzen, "Google unveils Gemini 4 Carbon, retaking the world's no. 1 spot on updated, harder benchmarks — but access is limited," VentureBeat, Oct. 28, 2026, https://venturebeat.com/technology/google-unveils-gemini-4-carbon-retaking-the-worlds-no-1-spot-on-updated-harder-benchmarks-but-access-is-limited
  4. OfficeChai Team, "Google Launches Gemini 4 Carbon, Beats GPT-6 Astra, Claude Opus 5.5 On Most Benchmarks," OfficeChai, Oct. 28, 2026, https://officechai.com/ai/gemini-4-carbon-benchmarks/
  5. Unite.AI Staff, "Staged Rollout Sends Google's Gemini 4 Carbon To Cyber Defenders First," Unite.AI, Oct. 28, 2026, https://www.unite.ai/staged-rollout-sends-googles-gemini-4-carbon-to-cyber-defenders-first/
  6. Abner Li, "Google announces Gemini 4 Carbon with 'significant' coding gains," 9to5Google, Oct. 28, 2026, https://9to5google.com/2026/10/28/gemini-4-carbon-announcement/
  7. Sundar Pichai, "I did say we'd be releasing our models periodically...," X, Oct. 28, 2026, https://x.com/sundarpichai/status/2115489219804352921
  8. Agence France-Presse, "AI worms, 'major' incident fears spur safety calls at industry summit," Tech Xplore, Oct. 14, 2026, https://techxplore.com/news/2026-10-ai-worms-major-incident-spur.html

Cite this piece

Kelly Dennis, "Google's Gemini 4 Carbon Tops the AI Rankings," AI Lately, Oct 28, 2026, https://ailately.com/articles/gemini-4-carbon-ai-rankings

Tags: Google DeepMind · Gemini 4 Carbon · Artificial Analysis · cybersecurity · Intelligence Index

Related, lately

More

Keyboard

j k
Move through a list
Enter
Open the selected piece
/
Search, and browse the columns
g then r
Right Now
g then a
Articles
g then s
The Signal
g then o
Opinion
g then b
Analysis
g then p
People
?
This sheet
Esc
Close

AI Lately Pro

Be the one who already knew.

With Pro
You already know what ships next week and who just moved, with the source.
Without it
You hear about it days later, from a screenshot in someone's Slack.

$19 a month. Cancel any time.

See everything Pro opensAsk the editor

Secure checkout through Stripe. Member? Sign in.