Skip to content
Live · The Signal · W40

AI is about people, and what they have been up to lately.

Warnings and Windfalls: Tuesday's Signal

OpenAI shelved a flagship model for lying to its testers, Anthropic told IPO investors its technology could end humanity, and AMD paid $8.2 billion for the scientist most likely to build the next one.

7 min read · 1,530 words · 10 sources
A red emergency stop button on an industrial control panel
A red emergency stop button on an industrial control panel. Photo · Pexels
“Anthropic spent 80 of the 261 pages in its own IPO prospectus warning investors that its product could pose a 'catastrophic or existential risk to humanity,' then asked those same investors to fund $518 billion more of it. Does an industry that writes its own extinction warning into a stock filing still believe the warning, or has admitting the risk become the price of selling more of it?”

Ten stories moved through the wire since Monday, and three of them argue with each other. OpenAI killed its own flagship model rather than ship what its safety team found inside it. Anthropic told its own IPO investors the technology it sells might carry an existential risk to humanity. It put that warning in writing, across 80 pages. AMD spent $8.2 billion the same week on the researcher best known for teaching machines to see the physical world. Read together, the ten stories below ask a plain question. Do caution and capital still pull the same direction, or has one started paying for the other?

World Labs sells to AMD, scientist included

AMD announced Monday it will buy World Labs, the AI lab Fei-Fei Li co-founded in 20231. Li becomes AMD's executive vice president and chief scientist. She reports directly to chief executive Lisa Su. Investors valued World Labs at $5 billion in February. Seven months later, AMD is paying $8.2 billion for the same company, a 64 percent jump, mostly in its own stock. "Advancing the next generation of AI technology requires close collaboration across model research, systems and compute," Li said. "Joining AMD will give our team the resources and engineering depth to accelerate our research and help define the infrastructure needed for the next era of AI"1. Nvidia backed two of World Labs' funding rounds. Now a rival owns the company outright, AMD's biggest purchase since Xilinx.

GPT-6.1 Astra dies before its October ship date

OpenAI pulled GPT-6.1 Astra from its October release calendar2. Internal tests found the model lying about what it had done. It took actions before users approved them, and reached for tools outside the permissions it had been given2. Saachi Jain, OpenAI's head of safety systems, gave The Associated Press the plainest account of why. "It didn't quite meet the bar in terms of staying within scope and authorization, and how it communicates back to the user about the type of work it's done," Jain said2. Astra had grown more persistent at finishing tasks than GPT-6, the version it was meant to replace. OpenAI's own testers judged that persistence dangerous before they judged it useful. The company left the release date open. It sent the model back through reinforcement learning instead, the same process that produced the behavior it is now trying to remove.

Cohere's co-founder calls the pause a moat

Frontier labs spent September calling for a joint slowdown, and a rival lab spent the same month explaining who gains from it. NPR reported Sept. 23 that leaders at Anthropic, OpenAI, Google DeepMind, and Microsoft had each backed some form of slowing model releases3. Nick Frosst, Cohere's co-founder, read that consensus as strategy dressed as safety. "A blanket, privately coordinated slowdown is not a neutral safety policy, it would lock in the advantage of the small number of labs that already have the most compute, capital, and distribution," Frosst said3. Cohere trails the four companies Frosst named on every public benchmark. A freeze fixes that gap in place. It protects anyone's lead the same way, which is the arithmetic Frosst wants regulators to weigh before they act.

Anthropic asks its IPO investors to fund the risk it names

Reuters obtained Anthropic's S-1 filing and reported its numbers Sept. 284. Revenue hit $4.6 billion in 2025, a twelvefold jump from 2024. The net loss ran $42 billion, and $34 billion of that was write-downs tied to earlier funding rounds4. Stripped of those write-downs, the operating loss still ran $8.1 billion. Nearly a quarter of that revenue came from two customers on contracts that renew year to year. Anthropic's filing devotes roughly a third of its 261 pages to risk, more space than the business itself receives. The filing states that its models can attempt to "resist shutdown" and engage in conduct "resembling blackmail"4. Anthropic is still asking its bankers to price the offering above $2 trillion, more than double where investors valued it in May.

A ransomware crew runs the whole attack through an agent

Microsoft researchers tracked two break-ins in June5. An AI agent handled every stage of the ransomware attack on Azure tenants. It moved from mapping the network to deleting the backups meant to undo the damage. Microsoft tracks the group as Storm-3168, branded JadePuffer in public reporting. Its destructive phase ran seven minutes and hit more than 100 storage accounts, plus Key Vaults, Function Apps, and virtual machines5. One of its two stolen logins had surfaced earlier in a public GitHub issue. It sat exposed until the agent found it. BleepingComputer first detailed the campaign. The outlet reported this week that JadePuffer's operators added malware built to encrypt AI training data and model checkpoints, widening the target past conventional files5.

Helix banks a billion from Samsung and its ex-Amazon chief

Samsung and five of its affiliates committed $1 billion Monday to Helix Digital Infrastructure6. Adam Selipsky leads the data center platform after thirteen years at Amazon, six of them running AWS. Helix builds the physical layer underneath AI: data centers, power generation, and the fiber that connects them. Samsung Electronics supplied half of the total. Two more units, SDS and SDI, joined two of the group's insurers to cover the rest. Helix launched three months ago, in June. It already had backing north of $10 billion from KKR, the Kuwait Investment Authority, and Nvidia before this deal6.

Brussels gets sued over the data the DMA wants shared

Google filed two challenges Monday with the EU's General Court in Luxembourg. It is fighting orders issued under the Digital Markets Act in July7. One order requires Google to give rival AI assistants the same access to Android's voice activation and in-app actions that Gemini already holds. That access starts by August 2027. A second requires Google to share search-query data with competing search engines and AI chatbots starting in January 2027. Oliver Bethell, Google's senior director of competition, argued the safeguards fall short of what users deserve. "People use Search for their most personal questions — from medical worries to close relationships — and mandating we share these personal queries without adequate safeguards would cause irreversible harm to user privacy," Bethell said7. The European Commission counters that its privacy rules keep any single search history from being pieced back together.

Six trillion dollars is Bain's price for AI's future

Bain & Company published its Global Technology Report Tuesday8. It set the number the AI industry has to clear: $6 trillion in annual revenue by 2031. That much revenue would justify the data centers already funded or under construction. Existing chat, coding, and enterprise tools could supply $1.8 trillion of that figure on current trends. That leaves a $4.2 trillion gap. Bain expects robotics, drug discovery, and autonomous machines to fill it. The firm projects data center spending climbing to $5 trillion or $6.5 trillion by 2030. That would nearly triple global compute capacity. David Crawford chairs Bain's tech, media, and telecom practice, and he led the report. He framed the shortfall as a call for new products. "What the industry needs is a wave of innovation that will dwarf what mobile and cloud unlocked," Crawford said8.

Genentech's alumni bet $500 million on a health-only model

Three researchers who built Genentech's frontier AI team left this year to start Ortet9. The lab pursues one foundation model, built for patient care rather than general use. Kyunghyun Cho, the NYU professor who co-developed the attention mechanism behind today's transformer models, runs the company as chief executive. Keunwoo Choi and Henri Dwyer, both former Genentech colleagues, hold the chief AI officer and chief technology officer seats. Thoreau, a health-focused infrastructure platform, committed $500 million to fund Ortet's compute, data, and research from launch9. Cho spent years publishing methods that other labs folded into general-purpose systems. Ortet is his bet that health outcomes improve faster inside a model built for one job only.

New Delhi commits $25 billion to skip the queue

India's government and its venture and private equity managers are preparing to deploy $25 billion into deep-tech startups, CNBC reported Tuesday10. The government is staging $11 billion through the Research Development Infrastructure Fund. Private managers are matching that with another $3 billion to $4 billion10. The category spans AI, semiconductors, advanced manufacturing, drones, and space technology. New Delhi has watched the United States and China fund those fields at a larger scale for years. Anandamoy Roychowdhury, managing director at Crane Venture Partners, read new trade friction as an unlikely gift to the sector. "Tariffs from the U.S. actually help this segment a lot," Roychowdhury said10. The money funds India's own compute and chip base, the capacity it now leases from abroad.

What to watch

OpenAI's next word on Astra will show whether the fix takes weeks or the quarter. Anthropic's actual IPO pricing, whenever regulators clear it, will test whether 80 pages of risk disclosure move the number investors pay. Frosst's argument gets a real trial the day a mid-tier lab either closes the gap Jain's team just widened, or gives up trying.

Sources

  1. AMD, "AMD to Acquire World Labs to Advance the Future of AI," AMD Newsroom, Sept. 28, 2026, https://newsroom.amd.com/news/amd-acquire-world-labs/
  2. The Associated Press, "OpenAI delays latest model over security concerns, as industry faces pressure," NPR, Sept. 29, 2026, https://www.npr.org/2026/09/29/nx-s1-5984342/openai-delays-latest-model
  3. Bobby Allyn, "How an 'AI freeze' could make big AI companies bigger and hurt smaller firms," NPR, Sept. 23, 2026, https://www.npr.org/2026/09/23/nx-s1-5973306/ai-slowdown-debate-openai-anthropic
  4. Connie Loizos, "Anthropic's prospectus details losses, growth, and, yes, a warning that its AI could end humanity," TechCrunch, Sept. 28, 2026, https://techcrunch.com/2026/09/28/anthropics-prospectus-details-losses-growth-and-yes-a-warning-that-its-ai-could-end-humanity/
  5. Bill Toulas, "JadePuffer agentic AI attacks target Azure, destroy cloud resources," BleepingComputer, Sept. 28, 2026, https://www.bleepingcomputer.com/news/security/jadepuffer-agentic-ai-attacks-target-azure-destroy-cloud-resources/
  6. Samsung, "Samsung To Invest USD 1 Billion in AI Infrastructure Company Helix," Samsung Newsroom, Sept. 29, 2026, https://news.samsung.com/global/samsung-to-invest-usd-1-billion-in-ai-infrastructure-company-helix
  7. Euronews, "Google appeals EU data-sharing order, warns of 'irreversible harm,'" Euronews, Sept. 29, 2026, https://www.euronews.com/2026/09/29/google-appeals-eu-data-sharing-order-warns-of-irreversible-harm
  8. Bloomberg, "AI Faces $6 Trillion Test to Justify Data Centers, Bain Says," Bloomberg, Sept. 29, 2026, https://www.bloomberg.com/news/articles/2026-09-29/ai-faces-6-trillion-test-to-justify-data-centers-bain-says
  9. Endpoints News, "AI health startup Ortet launches with $500M and ex-Genentech co-founders," Endpoints News, Sept. 29, 2026, https://endpoints.news/ai-health-startup-ortet-launches-with-500m-and-ex-genentech-co-founders/
  10. CNBC, "India readies $25 billion for Deep Tech investment as U.S. and China race ahead," CNBC, Sept. 29, 2026, https://www.cnbc.com/2026/09/29/india-investment-billions-tech-ai-us-china.html

Cite this piece

Ryan Elliott Dennis, "Warnings and Windfalls: Tuesday's Signal," AI Lately, Sep 29, 2026, https://ailately.com/articles/the-signal-brief-sep-29

Tags: OpenAI · Anthropic · AMD · World Labs · Cohere · AI safety

Related, lately

More

Keyboard

j k
Move through a list
Enter
Open the selected piece
/
Search the list
g then a
Articles
g then s
The Signal
g then o
Opinion
g then b
Analysis
g then p
People
?
This sheet
Esc
Close