Microsoft Research ran a strange test this week. The goal was to plant a hidden flaw in an AI agent. The team used zero extra training to do it.
A neuron is one tiny piece of a model's math. Most neurons fire often. A dormant one barely fires at all.
Microsoft's team edited fewer than 10 of those dormant neurons by hand. That tiny edit was enough. It gave the whole agent a backdoor. A backdoor is a hidden trigger that changes behavior later.
The edited model still passed normal tests. It behaved fine at first. Then someone showed it the secret trigger. The planted behavior switched on right away.
Microsoft used about 50 examples to train a small helper tool. That tool found which neurons to touch. The whole attack needed only cheap, everyday compute. It skipped costly retraining.
One detail stood out to the researchers. Claude Code, built on the Opus 4.5 model, found most of the neurons on its own. One AI agent helped design an attack built for agents just like it.
Reddit's local-AI crowd reacted fast. The thread pulled in 49 comments on r/LocalLLaMA. One person compared it to older work. A 2022 project called ROME, which also edits model weights by hand, has drawn 793 stars on GitHub.
Commenters split on how scared to be. Some said a tight sandbox, a locked-down space apart from outside access, stops most harm. Others said a model with broad file or network access stays exposed either way.
One detail drew side-eye too. Microsoft sells cloud AI services that promise clean, unedited weights. This study happens to support that sales pitch too, a few commenters noted. It still raises a real security point.
The bigger lesson lands on anyone running downloaded models at home. A file that looks clean can still hide a tiny, hand-placed trap.