Your initial instinct is to block africa twitter, but i've grown to enjoy the content coming out of that continent. It is very much like peering through the window of a pre-modern mindset but with access to technology. It's a real contribution
You have noticed it. ChatGPT feels dumber than it used to. Your prompts that worked six months ago produce worse results now. The writing sounds flatter. The ideas sound safer. The internet itself feels like it is shrinking. Every article reads the same. Every email sounds the same. Every answer sounds like it was written by the same voice.
You thought it was you. It is not you.
Researchers at Oxford and Cambridge published a paper in Nature proving what is happening. They call it Model Collapse.
Here is the mechanism in one sentence. AI trained on AI-generated data gets dumber every generation until it forgets what real human data looked like.
The internet is filling with AI-generated content. Blog posts. Articles. Reviews. Comments. Social media. AI companies scrape the internet to train the next generation of models. Which means the next generation of AI is being trained on the output of the current generation.
Each cycle loses information. Not randomly. It loses the rarest, most unusual, most creative parts first. The researchers call these the "tails of the distribution." The weird ideas. The unexpected perspectives. The things that made the internet feel human. Those disappear first.
What remains is the average. The safe. The expected. The bland.
Then the next generation trains on that. And loses more. And the next generation trains on that. And loses more. The researchers proved this is not a slow decline. Major degradation happens within just a few iterations. Even when some of the original human data is preserved.
They tested it on large language models. On image generators. On statistical models. The pattern was the same every time. The output converges toward a narrow, flattened version of reality that looks nothing like the original data.
The lead researcher put it plainly. "Large language models are like fire. A useful tool. But one that pollutes the environment."
The pollution is invisible. You cannot see which sentence on the internet was written by a human and which was written by AI. Neither can the AI that is about to train on it. And once the tails are gone, they do not come back. The damage is irreversible.
This is not a prediction anymore. It is a diagnosis.
The internet you grew up on was built by humans writing things no algorithm would have written. Strange, personal, imperfect, alive. That internet is being diluted. One generation of AI at a time. And the models trained on what remains are learning a smaller and smaller version of the world.
Model Collapse is not a technical problem. It is a cultural one. The thing that made the internet worth reading is the thing that disappears first.
Virgin Galactic stock is currently +165% over the past month because Redditors on WallStreetBets are confusing the ticker $SPCE with Space X ticker $SPCX
Thats how dumb the market is right now
@DiscountedTr You forgot this one: https://t.co/pOxCUKJXMv Pumping Tesla stock for a few minutes and then being asked "Do you still have a sizeable stock position in Tesla?"
This is extraordinary and profoundly symbolic: Ai Weiwei has returned to China for the first time in 10 years and says he concluded that Beijing is "more humane" than Germany which he describes as "insecure and unfree".
He gave an interview to Germany's Berliner Zeitung after his trip (https://t.co/P0NBgnCTTH) and here is what he said:
- He described feeling that Beijing had become like "a broken jade being perfectly reassembled" and said he felt no fear returning to the country.
- He complained that daily life difficulties in Europe (where he's lived for the past 10 years) are "at least ten times" what they are in China, criticizing European bureaucracy.
- For instance he said he reactivated his dormant Chinese bank account in mere minutes (with "still had a considerable sum of money in it"). He contrasts this with his experience in Europe: "In Germany, my bank accounts were closed twice. And not just mine, but my girlfriend's as well. In Switzerland, I was refused an account at the country's largest bank, and another bank later closed my account there as well. There were other similar incidents, which I won't go into detail about here. These processes are extraordinarily complicated and often irrational."
- He says that "with regard to the political climate, daily life for ordinary people in Beijing feels more natural and humane" than in Germany which "feels cold, rational, and deeply bureaucratic. As an individual, one feels confined and precarious there."
- Stunningly he says that in Germany, over ten years, "almost no one has ever invited me to their home. Neighbors from above or below exchange at most a brief nod." He contrasts this with China where, immediately upon his return, "perfectly ordinary people from at least five different professions lined up, hoping to meet me."
- He concludes that Germany now "plays the role of an insecure and unfree country, struggling to find its position between history and future."
As a European who's lived 8 years in China, I couldn't agree more: life in China is an order of magnitude less cumbersome than in Europe and daily life feels much more humane and warm, contrary to popular belief.
But it's one thing for me to say it, and something else entirely for China's most famous dissident. The man once celebrated throughout the West as the very embodiment of opposition to his country has now concluded that it is in fact Europe that's inhumane and "unfree".
Fun fact: 95% of jobs that do require a college degree don’t actually require a college degree, we just made it illegal to test job applicants for intelligence, so companies use diplomas as a proxy.
@nntaleb Chess Grandmaster David Howell revealed the other day that as far as he knows he is the only player in the top 100 who is able to drive a car.
Más allá de los tapones de las bebidas, la normativa europea también afecta al desarrollo militar:
P. ¿Están bien entrenadas las unidades que se formaron en países europeos?
https://t.co/Ec0zT5kk7Z
Koreans are amazing because they managed to create the most brutal communist dystopia right next to the most brutal capitalist dystopia all on the same tiny peninsula