My take: the founder cult in SV is totally out of control. It formalizes a de facto aristocracy as the preferred form of governance in tech. It leads to outsize discrepancies in risk taking and outcomes for most tech workers. It enables some of the most toxic psychopaths to be venerated as “visionaries”. Most of the worst people I came across in tech were “founders”.
@Saboo_Shubham_ Hey @elonmusk ,
The hot new architecture is diffusion transformers:. Here's an introduction https://t.co/GrOSUCkLA7
That's what Sora uses.
Chatting about Stable Diffusion 3 and Sora's diffusion transformers, and what they might unlock for multimodal models with Helen Byrne:
https://t.co/jIWCDqEzkI
We have now hit 330 *million* cumulative downloads since our first model was uploaded @huggingface 18 months ago.
Just overtook @Google (321m all time), on our way to 1 billion thanks to the great efforts of the team @StabilityAI
Some announcements to come, big weeks ahead..
@rcondon17 I agree that the language is poor and the quality of the debate is low, not helped by the fact that the media is terrible at reporting on anything technical. Genuinely urgent questions of bias/mis-specified objectives get conflated with mad sci-fi villains.
What looks like the absorption of OpenAI into MSFT is a turning point for the industry. Product-wise, it's onwards and upwards: tools at least as fantastic as Copilot and ChatGPT await. But we'll look back on this as the moment when some of the magic around AI was lost.
The speaker's participation in a language-using community, their conceptual schema, embodied brain and its evolutionary history, all these features that make up 'perspective' matter. Would love to see more engagement with philosophers on issues that AI researchers trample over.
Geoff Hinton says it is crucial that we come to a consensus about whether LLMs do or do not understand language.
He frames it as a binary issue. But the evidence shows that at most, these models have only a partial grasp of semantics.
Had an insightful conversation with @geoffreyhinton about AI and catastrophic risks. Two thoughts we want to share:
(i) It's important that AI scientists reach consensus on risks-similar to climate scientists, who have rough consensus on climate change-to shape good policy.
(ii) Do AI models understand the world? We think they do. If we list out and develop a shared view on key technical questions like this, it will help move us toward consensus on risks.
I learned a lot speaking with Geoff. Let’s all of us in AI keep having conversations to learn from each other!
Acquiring the ability to use human language isn't like a speaker of, say, English becoming fluent in Mandarin. It's more like Wittgenstein's lion acquiring the ability to speak. Famously: 'if a lion could speak, we could not understand him'.