Most AI models learn from huge piles of human text. A new project skips that pile for good. A team in Tel Aviv and at Stanford built the method. They call the paper Self-Play Pretraining with Zero Data.
Two small models train against each other here. One model makes up strings of made up symbols. The other model tries to guess each next symbol. Both models skip every human sentence completely.
Yoav Levine and Kfir Dolev led the work in Tel Aviv. Seven people share credit on the paper in all. They tested the trained model across six fields. Those fields spanned text, images, sound, music, code and DNA.
The model's skills still carried over to real tasks later. This kind of training helped the model learn faster. It once spotted the Fibonacci numbers forming on its own. The pattern showed up using zero human labels at all.
The method carries a clear limit for now. A self-taught model still learns zero real world facts this way. It needs real data later to learn who, what or when. The team calls the current version a small scale test run.
The story first ran through the school's own press office. Outlets like Ynet and TechXplore picked it up fast this week. A Reddit user shared the news in r/OpenAI Saturday. The post pulled 6 comments in its first few hours.
The paper itself sat quietly on arXiv since late September. Hacker News readers found it then and gave it 4 points. Fresh press coverage gave the old paper a second life. That second wave finally reached Reddit this week.
Training data costs real money and raises real legal fights. A method that skips human text could cut both costs sharply. Labs chasing cheaper training runs will likely study this approach closely. Whether it works past small models remains the real open test.