Geoffrey Hinton says a big language model runs on about 1% of your brain's connections and still ends up knowing more than you:
"So in your brain, you have a hundred trillion connections, roughly speaking. Okay. That's a lot. And you only live for about two billion seconds. That's not much."
"If you compare how many seconds you live for, with how many connections you've got, you have a whole lot more connections than experiences."
"Now with these neural nets, it's sort of the other way round. They only have of the order of a trillion connections. So like 1% of your connections, even in a big language model, many of them fewer, but they get thousands of times more experience than you."
"So the big language models are solving the problem with not many connections, only a trillion. How do I make use of a huge amount of experience?"
"And back propagation is really, really good at packing huge amounts of knowledge into not many connections."
"But that's not the problem we're solving. We've got huge numbers of connections, not much experience. We need to sort of extract the most we can from each experience."
Two to three billion seconds is the whole budget. Everything you know, you learned inside it.
So evolution built you to squeeze a lot out of very little. Hinton's point is that a language model has the opposite problem and the opposite fix, and backprop turned out to be extremely good at that fix.
Worth noticing what this predicts about failure. A system running on 1% of your wiring and thousands of times your experience is not going to fail the way you do.
You fail from having seen too few examples. It fails from compressing too many into too little, and the compression is where the errors get made.
That is a strange thing to be deploying into hospitals and courts with no way to inspect it. We test these systems by asking them questions, which tells you what came out. Nobody can yet look at a trillion connections and say what got packed in.
- Geoffrey Hinton, Nobel laureate and Turing Award winner, on StarTalk (@StarTalkRadio) with Neil deGrasse Tyson.
@LauraLoomer@ElbridgeColby@SecWar That is called diplomatic protocol!
Hey, what is your opinion on Saudi Nuclear deal with no inspections? Are you still in bed with this administration?
A new Chinese robotics startup, Light Origin, just showcased an impressive single-policy locomotion system.
Even with one or both legs restrained, the robot remains mobile by hopping or crawling.
@spacanpanman@Reformed_Trader Agree. I live in Silicon Valley and even here around my house I get only one or two bars. We survive on wifi. The unlimited data plan is meaningless.
KIMI K3 EXPLAINED IN 13 MINUTES. THIS IS THE BEST VIDEO YOU’LL WATCH ON IT
So much for dense models taking over the world.
Moonshot just proved the doubters wrong with Kimi K3, a 2.8 TRILLION parameter open beast that’s benchmarking right up there with GPT 5.6 and Fable 5.
It serves as proof that you can scale sparse models efficiently without bottlenecking your throughput 👊
Watch this, then read this great guide about Kimi K3 by @kirillk_web3 ↓
Trump said the white kid was a perfect soldier & was destined to be a General.
(His parents are Trump supporters)
Trump said the other 3 had issues.
@GrindeOptions I am waiting for Robotaxi to pick me up for the ride to the SFO airport! Have been waiting for many many months but Tesla keeps saying it is right around the corner.
Paying for Peace: The Non-Escalation is Sold to the Gulf
While the GCC fears the intensification of American attacks on Iranian infrastructure and the consequent Persian response against Gulf energy and economic infrastructure, something else is unfolding behind the scenes.
Jared Kushner and his private equity firm, Affinity Partners, have been actively passing the collection plate among Gulf sovereign wealth funds.
According to financial disclosures and media reports, the firm manages around $6.2 billion in assets, with the vast majority coming from Saudi Arabia’s PIF, the UAE, and Qatar.
Kushner has been soliciting $5 billion or more in additional capital from these same investors while simultaneously serving as a key Trump administration envoy in Middle East negotiations.
This comes on top of the Trump family’s own $300 million haul from Gulf entities in 2025 alone (largely from the World Liberty Financial crypto deal with Emirati backers and licensing fees), as detailed in the president’s latest financial disclosures.
In some places, people see it as collecting a de facto maintenance fee for non-escalation and protection of Gulf interests amid the Iran conflict.