Skip to content
Technology
AnalysisOpinion

Inference Is the Product Now

CoreWeave's backlog hit $104 billion, up 112 percent in a year, while Nvidia earned $89 billion from data centers in one quarter. Both numbers point to a neocloud outgrowing a hyperscaler's AI line by 2028.

Updated 6 min read · 1,266 words · 13 sources
A fuel pump display counting price against litres
A fuel pump display counting price against litres. Photo · Pexels
“A chipmaker just told investors that tokens turned profitable, and the neoclouds selling those tokens are growing faster than the company that makes the chips. Can the companies selling tokens keep growing faster than the company that makes the chips those tokens run on?”

Nvidia earned $89 billion from its data center line in one quarter, reported on Aug. 26, 2026, up 117 percent in a year1. Jensen Huang told investors the same day that compute now counts as revenue. CoreWeave showed a smaller number attached to a bigger story. Revenue reached $2.575 billion for the quarter, up 112 percent2. Behind it sits a $104 billion book of signed work, plus another $25 billion in the first weeks of the next quarter.

Nebius signed $46 billion in AI cloud deals, led by a five-year, $17.4 billion Microsoft contract34. Crusoe pushed its booked capacity toward five gigawatts, and fresh money valued it near $30 billion56. Here is my claim. One inference specialist or neocloud will post a bigger yearly AI line than at least one hyperscaler's own AI business. That crossover happens before the end of 2028.

The number Nvidia set

Huang framed the quarter in unusually direct terms. "AI has reached its inflection point," he said. "It's doing useful work. Its tokens are productive and profitable. Now, compute is revenue. And demand is accelerating"1. Guidance for the next quarter calls for $108 billion. A decade ago that was a full year of sales for most software companies.

His sharper observation came next, when he described "a golden age of new AI labs and startups, multiple frontier labs scaling in parallel"1. Read that as a forecast about market structure rather than enthusiasm. Demand is splitting across dozens of labs, and those buyers stop requiring a hyperscaler's balance sheet, which means a neocloud's contract serves them as well as a Microsoft or Google order would.

CoreWeave's backlog

Skeptics spent 2025 calling CoreWeave a one-customer bet financed by debt, and Michael Intrator, its chief executive, heard that charge all year. The second-quarter 2026 filing answers with a customer list. New enterprise names arrived: Bentley Systems, Caterpillar, Grammarly, Isomorphic Labs and Sunday Robotics2. Deeper work now runs with Cognition, Databricks, Hudson River Trading, Periodic Labs, Rescale and Runway ML.

Revenue hit $2.575 billion for the quarter, up 112 percent from $1.212 billion a year earlier2. Backlog grew to about $104 billion by June 30, with another $25 billion signed within weeks. Intrator named the turn on the earnings call. "CoreWeave reached an important inflection point this quarter as our scale began to translate into expanding operating leverage." He described the capacity position more bluntly to analysts. "Our near-term capacity remains effectively sold out."

CoreWeave signed $25 billion more within weeks of reaching a $104 billion backlog on June 30

CoreWeave's signed backlog, billions of dollars, at June 30, 2026, and in the weeks after

The first column is the backlog at June 30, the second column is the work signed in the following weeks, stacked on top, and the last, darker column is the running total.

Source: CoreWeave Investor Relations [2]. Chart by Ryan Elliott Dennis.

The numbers behind this chart
ItemValueNote
Backlog, June 30$104BAbout $104 billion of signed work
Signed within weeks+$25BIn the first weeks of the next quarter
Running total$129B

CoreWeave also claimed the first bring-up and validation of Nvidia's Vera Rubin NVL72 platform, which keeps it inside Nvidia's supply chain as a favored partner2. Hold that 112 percent growth at half its pace through 2028, and yearly revenue alone clears $25 billion. Few hyperscalers report an AI line that large.

Nebius and Crusoe

Contract size became the pitch for both firms in 2026. Nebius built its case in April, when signed AI cloud deals reached $46 billion3. Microsoft's five-year, $17.4 billion data center deal leads them, with $7 billion paid upfront4. Crusoe built its case in gigawatts instead5. Booked capacity pushed toward five gigawatts across its data centers and cloud, and fresh money then valued the firm near $30 billion6.

Model ownership sits outside either story, and so does big-name research. Both firms hold deals that top the yearly revenue of most public software makers. Each sells the one thing every lab, startup and enterprise needs whichever model wins. Capacity.

Cerebras and Groq

Scale questions got two answers here. Cerebras chose the public one. Andrew Feldman, co-founder and chief executive, took it public in May 2026, raising $5.5 billion, and shares jumped 108 percent on debut7. A harder quarter followed. Cerebras stock fell 10 percent in June, after the firm guided toward a thinner margin in its first report since the listing8. Investors read that as a signal. The market still judges it as a chip maker rather than a story.

Groq chose private capital. Jonathan Ross, its founder and chief executive, closed a $350 million Series A at a $3.5 billion valuation, with Nvidia among the backers, then came back for $650 million more910. Four capital paths, Cerebras public, Groq private, CoreWeave leveraged and Nebius contract-backed, reach one conclusion. Specialist compute firms raise money as fast as any model builder, and investors keep rewarding the specialty over the generalist.

The falling price

Every firm here lives with one hard fact. The token they sell keeps getting cheaper. GPT-4-equivalent output cost $30 per million input tokens in March 202311. Open-weight models matched that quality for roughly a dime by 2026, a drop near 1,000-fold in three years. Analysts who track the curve expect prices to keep falling four to tenfold a year through 2027.

A hyperscaler absorbs that drop across search, apps, retail and cloud storage, where the line item barely registers. Neoclouds meet the same drop with one product to sell, which forces them to run lean and explains a visible pattern. CoreWeave, Nebius and Crusoe keep signing capacity deals ahead of research deals. Gartner sized the prize at $23.3 billion of inference spending in 2026, 55 percent of a $42.276 billion AI market, climbing toward $39 billion of $66.143 billion by 202712. Specialists built for this drop, and for this volume, stand ready to take it.

Inference takes 55 percent of Gartner's 2026 AI-optimized spending forecast and climbs to $39 billion in 2027

Gartner's AI-optimized spending forecast by year, split into inference and everything else, billions of dollars

Each bar is one year's forecast total: the blue segment is everything other than inference, and the magenta segment at the right end is inference spending.

Source: Gartner [12]. Chart by Ryan Elliott Dennis.

The numbers behind this chart
ItemEverything elseInferenceNote
2026$19.0B$23.3BInference is 55 percent of $42.276 billion
2027$27.1B$39.0BInference reaches $39 billion of $66.143 billion

The skeptic's case

Madison Rezaei, Bernstein's senior data center analyst, read the same backlog filings and flagged a different risk. She named CoreWeave the neocloud most exposed to a slowdown in frontier AI training, the very demand its newest capacity was built to serve. "We estimate that 25% of their existing active U.S. power, with an additional ~74% of their contracted power, is situated in Tier 3 and Tier 4 markets," she wrote in September 202613. Her count draws a line this piece's backlog totals skip. Rural power built for training sits furthest from the inference spending Gartner tracks, so a pause in frontier training orders strikes CoreWeave's unsold capacity before it touches a single inference contract, and the 2028 crossover keeps waiting on demand that has yet to sign.

By the numbers

  • Nvidia's data center revenue hit $89 billion for the quarter, up 117 percent in a year1.
  • CoreWeave's signed backlog reached $104 billion by June 30, 2026, plus $25 billion more within weeks2.
  • Nebius anchors a $46 billion deal book with a $17.4 billion, five-year Microsoft agreement34.
  • Crusoe runs about five gigawatts of contracted AI capacity across data centers and cloud5.
  • Cerebras raised $5.5 billion in its May 2026 IPO, then shares rose 108 percent on day one7.
  • Groq's $350 million Series A valued the Nvidia-backed firm at $3.5 billion, ahead of a $650 million follow-on910.
  • GPT-4-equivalent output cost about 1,000 times more in March 2023 than in 202611.
  • Inference took $23.3 billion of Gartner's 2026 AI-optimized forecast, 55 percent of the total12.

What to watch

CoreWeave's next filing should show whether the $25 billion in early third-quarter bookings turns into booked revenue on schedule2. That is the clearest test of backlog quality in the sector. Cerebras owes investors a margin update on its next call, where a second weak quarter proves the skeptics right and a recovery proves the IPO right8. Nebius and Crusoe each have room to announce a hyperscaler-scale contract before 2027 opens, and either move brings the 2028 threshold closer35. Nvidia's $108 billion guidance sets the bar every specialist here now measures against1. AI Lately will keep a running scoreboard as each company reports.

Sources

  1. NVIDIA, "NVIDIA Announces Financial Results for Second Quarter Fiscal 2027," NVIDIA Newsroom, Aug. 26, 2026, https://nvidianews.nvidia.com/news/nvidia-announces-financial-results-for-second-quarter-fiscal-2027
  2. CoreWeave, "CoreWeave Reports Strong Second Quarter 2026 Results," CoreWeave Investor Relations, August 2026, https://investors.coreweave.com/news/news-details/2026/CoreWeave-Reports-Strong-Second-Quarter-2026-Results/default.aspx
  3. The Motley Fool, "Nebius Has Landed $46 Billion in AI Cloud Deals. Could This Stock 10X From Here?," The Motley Fool, April 19, 2026, https://www.fool.com/investing/2026/04/19/nebius-has-landed-46-billion-in-ai-cloud-deals-cou/
  4. The Energy Mag, "Microsoft Committed $7 Billion Upfront in Nebius AI Deal," The Energy Mag, May 4, 2026, https://theenergymag.com/news/2026-05-04/microsoft-nebius-ai
  5. Crusoe, "Crusoe's Contracted AI Infrastructure Capacity Approaches 5 Gigawatts Across Data Centers and Cloud," Crusoe, 2026, https://www.crusoe.ai/resources/newsroom/crusoes-contracted-ai-infrastructure-capacity-approaches-5-gigawatts-across-data-centers-and-cloud
  6. Bloomberg, "Crusoe in Talks to Raise $3 Billion in Round That May Triple Firm's Value," Bloomberg, July 2, 2026, https://www.bloomberg.com/news/articles/2026-07-02/crusoe-in-talks-to-raise-3-billion-in-round-that-may-triple-firm-s-value
  7. TechCrunch, "Cerebras raises $5.5B, then stock pops 108%, in the first huge tech IPO of 2026," TechCrunch, May 14, 2026, https://techcrunch.com/2026/05/14/cerebras-raises-5-5b-kicking-off-2026s-ipo-season-with-a-bang/
  8. CNBC, "Cerebras falls 10% after chipmaker forecasts shrinking margin in first earnings report since IPO," CNBC, June 23, 2026, https://www.cnbc.com/2026/06/23/cerebras-cbrs-q1-earnings-report-2026.html
  9. TechFundingNews, "NVIDIA-Backed Groq Raises $350 Million at $3.5 Billion Valuation as AI Inference Race Accelerates," TechFundingNews, 2026, https://techfundingnews.com/nvidia-backed-groq-raises-350m-at-3-5b-as-ai-inference-race-accelerates/
  10. Groq Newsroom, "Groq Raises $650M to Scale Its AI Inference Cloud Business," Groq, 2026, https://groq.com/newsroom/groq-raises-usd650m-to-scale-its-ai-inference-cloud-business
  11. ValueAddVC, "AI Inference Cost Reduction 2026: Down 95% in Two Years," ValueAddVC, 2026, https://valueaddvc.com/blog/how-ai-inference-costs-have-dropped-95-in-two-years-and-what-happens-next
  12. Gartner Newsroom, "Gartner Forecasts Worldwide AI-Optimized IaaS Spending to Grow 96% in 2026," Gartner, Aug. 10, 2026, https://www.gartner.com/en/newsroom/press-releases/2026-08-10-gartner-forecasts-worldwide-artificial-intelligence-optimized-iaas-spending-to-grow-96-percent-in-2026
  13. Jabran Kundi, "Bernstein Flags CoreWeave as Most Exposed to an AI Training Slowdown," Insider Monkey, Sept. 17, 2026, https://www.insidermonkey.com/news/bernstein-flags-coreweave-as-most-exposed-to-an-ai-training-slowdown-1839023/

In the market

NvidiaNVDA

Market value $4.94 trillion

$204.64 −4.22% since the last close

CoreWeaveCRWV

Market value $30 billion

$54.87 −9.66% since the last close

Prices from Yahoo Finance, read with yfinance, and delayed. This is a record of price, not investment advice.

Cite this piece

Ryan Elliott Dennis, "Inference Is the Product Now," AI Lately, undated, https://ailately.com/analysis/inference-is-the-new-oil

Tags: neoclouds · inference economics · data center revenue · AI infrastructure

Related, lately

More

Keyboard

j k
Move through a list
Enter
Open the selected piece
/
Search, and browse the columns
g then r
Right Now
g then a
Articles
g then s
The Signal
g then o
Opinion
g then b
Analysis
g then p
People
?
This sheet
Esc
Close

AI Lately Pro

Be the one who already knew.

With Pro
You already know what ships next week and who just moved, with the source.
Without it
You hear about it days later, from a screenshot in someone's Slack.

$19 a month. Cancel any time.

See everything Pro opensAsk the editor

Secure checkout through Stripe. Member? Sign in.