And, again, I think the hysteria about what this “means” is predicated on an assumption, sometimes stated and sometimes not, that brains are just computers and intelligence is just computation.
I think this is largely unique to humanity. We keep around species intentionally that are useful to us, that we have sympathy for, keep as pets, etc. It’s not clear an ASI would have any of those motivations. We also routinely indiscriminately kill things that inconvenience us, like ants.
@yzilber@AaronBergman18 Kind of irrelevant but it does show a pattern of behavior. Sleeping with a Chinese spy and subsequently circumventing export controls is an incredibly bad thing and I would expect if true Jensen won’t be the only person to take the fall at Nvidia
@yzilber@AaronBergman18 Theres a high probability that Jensen will be hauled in front of Senate committees for the next few years and may end up in an orange jumpsuit. How would that be for shareholders?
The Riemann Hypothesis has fallen. RH was the singular math result that had been named, in advance, as the obvious coal mine canary for dangerously advanced AI, over the last three decades. The methods used should generalize to "make AI very good at anything you can definitely test", and unfortunately that category includes "make AI better at making AI".
This is like a private company announcing they have produced a million tons of 15% enriched uranium. It's not 90% enriched weapons-grade uranium, so you could proclaim the company's output is not immediately deadly right now. The concern is that the process line may generalize, to an extinction-level threat, within the unpredictably immediate future. Forecasters still had Riemann at 2035 one week earlier.
This is distinct from earlier events in that earlier you could reasonably ask if AI was selectively picking off famous math problems that turned out to be easier for AI. The Riemann Hypothesis was the single challenge most often named in advance as a warning sign.
PRESIDENT TRUMP: "It's not artificial intelligence. It's not artificial, it's super. Problem is, it may be too super.
So, President Xi and I agreed that we're gonna do some joint guardrails, the two of us."
@adastroworld@ladymcscope I get distinct boomer vibes from the field. Like “we can’t find good people to hire! Yes we pay lower than industry and the work is hard and socially stigmatized among their peers but also we only hire kids with MIT Stanford or Berkeley CS degrees that got into MATS and NeurIPs.”
@adastroworld@ladymcscope Meanwhile the bar at a frontier lab is just like can you pass this technical interview. You understand why that’s a problem right?
@nntaleb The leaders of all major AI labs - Deepmind, OpenAI, Anthropic etc - have all publicly expressed concern about AI risk.
They’re the literal BEST people in the field. Yet you claim to know better than them??
The story keeps getting crazier. To recap everything that has been reported so far:
- The US intelligence community discovered that Jensen Huang, the CEO of the largest company in the world, was sleeping with Alice Huang, a Chinese spy and an executive at Megaspeed. (FT)
- Multiple independent investigations have concluded that Megaspeed is likely a Chinese cutout, which helps Chinese companies access AI chips or circumvent export controls. (NYT and Bloomberg)
- The US intelligence community also concluded that Alice Huang’s goal was to convince Jensen to lobby the U.S. government to loosen export controls on advanced AI chips. (NYT)
- The intelligence community relayed this information to “a small group of top US government officials” earlier this year. (FT)
- Over the last year, Jensen Huang has repeatedly lobbied the U.S. government to loosen export controls on advanced chips. @BISgov has done so, not only by permitting the export of H200 chips to China, but also not enforcing export controls that would have required a license for exports of the most advanced Blackwell chips to Megaspeed and Southeast Asia.
- Although @CommerceGov leadership was presumably briefed on this information by the U.S. intelligence community, @BISgov has taken no actions to tighten controls on Megaspeed or Southeast Asia.
- Megaspeed remains a preferred cloud partner of Nvidia, and continues to receive Nvidia Blackwell chips despite employing a Chinese spy who reportedly is romantically engaged with the CEO of Nvidia.
- Tens of billions of dollars worth of AI chips have been exported to Southeast Asia this year alone, and Malaysia and Singapore are now two of the four largest importers of AI chips in the world.
What is going on here??? We need answers. The question of who gets the most advanced AI chips in the world is literally the defining strategic question of our time. And not only does it seem like the MSS may be directly influencing the debate on export controls in the United States, but also @CommerceGov is refusing to listen to the warnings of the IC on this issue. What is a POSSIBLE good explanation for why Megaspeed is still receiving chips? Why is there not a license requirement for AI chip shipments to all of Southeast Asia? This is beyond strange at this point.
The fallout from this story will be massive. Obviously, the motivations underpinning Nvidia’s policy views opposing export controls must now all be questioned. But also, how did @BISgov sit on this information and has still taken no actions? We need answers.