AI models learn from huge piles of text, images and code, most of it scraped from the internet. The internet is now full of stuff AI wrote. So the next generation of models is partly learning from the last generation’s output, and the question is what that does to them.
Model collapse is the name researchers gave the worst-case answer.
What it means
Model collapse is when a model trained on AI-generated content, generation after generation, slowly gets worse. It loses the rare and unusual examples first (researchers call those the “tails”), then drifts toward bland, repetitive output that no longer matches the real world.
A team led by Ilia Shumailov described it in a 2023 paper with a great title, “The Curse of Recursion.” A version published in Nature in July 2024 found that training on AI-made content without care “causes irreversible defects in the resulting models.” Some people call the result “Habsburg AI,” after the royal family famous for marrying its own relatives.
Why it matters
There’s a lot of AI text out there now. Pew Research looked at about 500,000 webpages in 2026 and found roughly 10% showed signs of AI writing, rising to 35% of pages dated after ChatGPT launched. That’s what future models will be reading.
It’s avoidable, at least in research. A 2024 follow-up study called “Is Model Collapse Inevitable?” found the trouble comes when AI data replaces real data. When the AI-made stuff is added alongside the original human data, collapse didn’t happen. That’s why labs care so much about Synthetic Data done carefully.
Real human data is getting more valuable. If clean, human-made text is the thing that keeps models healthy, then the companies sitting on it (publishers, forums, archives) have something AI labs need. That’s part of why so many licensing deals have shown up lately. Reddit, for example, has signed data deals with both Google and OpenAI for exactly this kind of human-written text.
Simple example
Make a photocopy of a photocopy of a photocopy. The first few look fine. By the tenth one, the faint pencil notes in the margin are gone, the fine print is mush, and everything’s a bit darker and blurrier than the original.
Now keep the original on the copier glass and copy that one each time. You can make a thousand copies and they’ll all look fine. Model collapse is mostly about losing track of the original.
