@tonywestonuk LLM Models have increasing degeneration built in, not improvement, since their results become increasingly dependent on their own previous output! As opposed to the increasingly remote original human source.
https://t.co/PxqItHDuFc
You have noticed it. ChatGPT feels dumber than it used to. Your prompts that worked six months ago produce worse results now. The writing sounds flatter. The ideas sound safer. The internet itself feels like it is shrinking. Every article reads the same. Every email sounds the same. Every answer sounds like it was written by the same voice.
You thought it was you. It is not you.
Researchers at Oxford and Cambridge published a paper in Nature proving what is happening. They call it Model Collapse.
Here is the mechanism in one sentence. AI trained on AI-generated data gets dumber every generation until it forgets what real human data looked like.
The internet is filling with AI-generated content. Blog posts. Articles. Reviews. Comments. Social media. AI companies scrape the internet to train the next generation of models. Which means the next generation of AI is being trained on the output of the current generation.
Each cycle loses information. Not randomly. It loses the rarest, most unusual, most creative parts first. The researchers call these the "tails of the distribution." The weird ideas. The unexpected perspectives. The things that made the internet feel human. Those disappear first.
What remains is the average. The safe. The expected. The bland.
Then the next generation trains on that. And loses more. And the next generation trains on that. And loses more. The researchers proved this is not a slow decline. Major degradation happens within just a few iterations. Even when some of the original human data is preserved.
They tested it on large language models. On image generators. On statistical models. The pattern was the same every time. The output converges toward a narrow, flattened version of reality that looks nothing like the original data.
The lead researcher put it plainly. "Large language models are like fire. A useful tool. But one that pollutes the environment."
The pollution is invisible. You cannot see which sentence on the internet was written by a human and which was written by AI. Neither can the AI that is about to train on it. And once the tails are gone, they do not come back. The damage is irreversible.
This is not a prediction anymore. It is a diagnosis.
The internet you grew up on was built by humans writing things no algorithm would have written. Strange, personal, imperfect, alive. That internet is being diluted. One generation of AI at a time. And the models trained on what remains are learning a smaller and smaller version of the world.
Model Collapse is not a technical problem. It is a cultural one. The thing that made the internet worth reading is the thing that disappears first.
@robinmonotti Colonial era assumptions are deeply embedded.
Many (perhaps a majority) who would consider themselves progressive, anti imperial etc nevertheless instinctively use the term 'race' or 'races' as if they have scientific factual validity.
Whereas there is not one iota.
'History will one day have its say, but it will not be the history taught in Brussels, Paris, Washington or the United Nations. Africa will write its own history, and it will be a history of glory and dignity.”'
Patrice Lumumba’s last letter to his wife after the coup backed by the CIA and Belgium:
“Neither brutality, nor cruelty, nor torture will ever force me to ask for mercy…I prefer to die with my head held high, with unshakeable faith and profound trust in the destiny of my country, than to live in submission and contempt of sacred principles…
History will one day have its say, but it will not be the history taught in Brussels, Paris, Washington or the United Nations. Africa will write its own history, and it will be a history of glory and dignity.”
@stephenlaw60@PSCupdates Just the 'Settlements' only?
Sort of legitimises the ethnic cleansing of Palestine.
As if the entire settler colony isn't itself a settlement..
@TarikCyrilAmar@KevorkAlmassian If only the hot air constantly emerging from her and being broadcast to us all was sufficient to power entire countries or regions, then perhaps she might make sense.
Wasn't just military that had to be rebuilt after exit of Western puppet Yeltsin.
Entirety of Russia was in ruins: millions dead or homeless (many suicides);
key resources & infrastructure looted by 'entrepreneurs' & converted into US $ & S/Yachts;
mafia street war mayhem etc
A revealing video from the late 1990s: Yeltsin reminds his officers who the supreme commander-in-chief is while his officers remind Yeltsin what kind of a commander-in-chief he is.
Following the collapse of the Soviet Union, the Russian armed forces faced severe financial constraints, declining morale, personnel shortages, and aging equipment. By the end of the 1990s, the army was critically ill, yet continued defending the country and even helping brotherly nations in several conflict zones.
When Putin became acting president on December 31, 1999, one of the first things he did the very same day was visit Russian troops in the North Caucasus, a gesture meant to show support to those fighting West-sponsored terrorists there.
This signal was followed by radical reforms aimed at rebuilding the military's funding, organization, training, and readiness.
@rinalu_ It wasn't just the military that had to he rebuilt after the exit of the Western puppet Yeltsin.
Entirety of Russia was in ruins, with millions dead (many suicides), key resources & infrastructure looted by 'entrepreneurs' and converted into US $. Mafia gangs running riot etc
@johnshreffler0 Untouched itself, US has 'failed' militarily. Yet wreaking devastation & mass slaughter on an unimaginable scale.
North Korea bombed into the stone age then pinned down by sanctions. Vietnam 6 million killed in reality.
Iraq over 1 million according to standard measures.
etc etc
@witte_sergei Great news for target practice!
High Altitude Defense easily obliterated on the ground apparently..
Not to mention its ineptitude vs hypersonic
Apparently the supposed (battle-hardened, as well as as technology & philosophy PhD) 'theocrats' have immeasurably more political and geostrategic nous than the regular bureaucrat officials of the Foreign Ministry etc.
And more respect & influence.
🧵
cc: @imetatronink
1. Wow, what a statement. Looks like second red line, drawn by the Assembly of Experts to the diplomats — who seem to them capable of losing the peace after winning the war.
Assembly of Experts appoints and supervises Supreme Leader. High level group.
That the UK state creates money out of nothing at all - not from 'tax revenues', and not from 'borrowing' - is so dangerous a secret that our entire political discourse is engineered to pretend otherwise.
Money is *never* in short supply. We create it at will.
Learn #MMT
@nousairmazraou1@Puflito___ A racist is literally someone who believes in the colonial junk science theory that there are 'races', adopted by Hitler et al.
Scientifically, there is only one race: the human race.
@Marwa__Osman To cal Is**el a terrorist entity is a gross insult to terrorists, none of whom would ever have even considered the inflicting the industrial scale of horror that the settler-colony unleashes by design.
Electoral insanity, voting the same way and expecting a different outcome
In China you can't change the party but you can change the policy whereas in the US and UK you can change the party but not the policy. As the last forty disastrous years prove
Follow #MOATS 562 #GeorgeGalloway #UK #US #China #realchange