4/ Even saving some real data does not fix it.
The researchers tried preserving 10% of the original human data in every generation. The collapse still happened. It was slower. But it still happened.
"Major degradation happens within just a few iterations, even when some of the original data is preserved."
The only thing that fully prevents collapse is training exclusively on human-generated data. The thing AI companies are running out of.
You have noticed it. ChatGPT feels dumber than it used to. Your prompts that worked six months ago produce worse results now. The writing sounds flatter. The ideas sound safer. The internet itself feels like it is shrinking. Every article reads the same. Every email sounds the same. Every answer sounds like it was written by the same voice.
You thought it was you. It is not you.
Researchers at Oxford and Cambridge published a paper in Nature proving what is happening. They call it Model Collapse.
Here is the mechanism in one sentence. AI trained on AI-generated data gets dumber every generation until it forgets what real human data looked like.
The internet is filling with AI-generated content. Blog posts. Articles. Reviews. Comments. Social media. AI companies scrape the internet to train the next generation of models. Which means the next generation of AI is being trained on the output of the current generation.
Each cycle loses information. Not randomly. It loses the rarest, most unusual, most creative parts first. The researchers call these the "tails of the distribution." The weird ideas. The unexpected perspectives. The things that made the internet feel human. Those disappear first.
What remains is the average. The safe. The expected. The bland.
Then the next generation trains on that. And loses more. And the next generation trains on that. And loses more. The researchers proved this is not a slow decline. Major degradation happens within just a few iterations. Even when some of the original human data is preserved.
They tested it on large language models. On image generators. On statistical models. The pattern was the same every time. The output converges toward a narrow, flattened version of reality that looks nothing like the original data.
The lead researcher put it plainly. "Large language models are like fire. A useful tool. But one that pollutes the environment."
The pollution is invisible. You cannot see which sentence on the internet was written by a human and which was written by AI. Neither can the AI that is about to train on it. And once the tails are gone, they do not come back. The damage is irreversible.
This is not a prediction anymore. It is a diagnosis.
The internet you grew up on was built by humans writing things no algorithm would have written. Strange, personal, imperfect, alive. That internet is being diluted. One generation of AI at a time. And the models trained on what remains are learning a smaller and smaller version of the world.
Model Collapse is not a technical problem. It is a cultural one. The thing that made the internet worth reading is the thing that disappears first.
curiosísimo el énfasis en “se tomó un taxi sola” cuando no fue a un descampado a encontrarse con un extraño sino a ver a una persona amiga de su familia, a la que no tenía ninguna razón para no tenerle confianza. lo único que les gusta más que culpar a las mujeres es encerrarlas.
Con los libertarios pasa q no estamos ante un debate sobre si una constitución escrita es superior a una consuetudinaria. Recalde te arrastra a tener que explicar por qué está mal q asesinen a una niña. Que sea reconocido y tratado como una escoria es condición para el progreso.
Nos gobiernan tipos que no entendieron Star Wars o Monsters Inc., mirá que van a comprender un fenómeno popular como este.
Todo lo humano les es ajeno.
@davsados La política económica de la última dictadura militar
Martínez de Hoz - Arriazu
La democracia como continuidad de la dictadura
Carla Goldberg
https://t.co/cW1N8CnNKP
@SomosHumanidad La política económica de la última dictadura militar
Martínez de Hoz - Arriazu
La democracia como continuidad de la dictadura
Carla Goldberg
https://t.co/cW1N8CnNKP
@spinelliandy La política económica de la última dictadura militar
Martínez de Hoz - Arriazu
La democracia como continuidad de la dictadura
Carla Goldberg
https://t.co/cW1N8CnNKP
@RESERVAdeVALOR La política económica de la última dictadura militar
Martínez de Hoz - Arriazu
La democracia como continuidad de la dictadura
Carla Goldberg
https://t.co/cW1N8CnNKP
@PabloNavas92@vidusky@CatadeElia@DiPace4 La política económica de la última dictadura militar
Martínez de Hoz - Arriazu
La democracia como continuidad de la dictadura
Carla Goldberg
https://t.co/cW1N8CnNKP
Permanencia de trabajadores en fabrica Ruiz
"En este momento se están desarrollando diversas audiencias para poder llevar adelante una negociación y los trabajadores puedan asegurar el cobro de sus salarios y la continuidad de los puestos laborales" Germán, directivo de la delegación del @SutnaNacional Córdoba
El empresario libertario había prometido invertir 1.700 millones de dólares, pero enfrenta suspensiones, retiros, embargos y funciona apenas con tres aviones.
[https://t.co/29gOffRxDZ]
La impunidad del peronismo no es nueva en Córdoba. Semanas atrás, la Policía asesinaba a Tomás Orihuela en una comisaría de Barrio General Paz. Hace un mes, Llaryora reprimió e infiltró una asamblea docente para imponer un acuerdo salarial a la baja. https://t.co/hw5W3jzG1K