Mark Zuckerberg rejects the single model future that OpenAI, Anthropic, and Google are each racing toward.
"By our estimates, it's going to be about 50% cheaper to do inference directly on the 405B than GPT-4o. That obviously makes a difference to a lot of people."
"Because it's open weights, you have the ability to take the model and distill it down to whatever size you want to use it for, synthetic data generation, to use it as a teacher model."
"It was never that there's going to be one singular thing. It's never been our vision. Our vision is that there should be lots of different models. Every startup out there, every enterprise, governments, they all want to have their own custom models."
"When the closed ecosystem was so much better than open source, it was just better to take the vanilla closed thing off the shelf. But now we don't see that anymore. Open source basically closes the gap."
"You're just going to see this wide proliferation of models where people now have the incentive to basically customize and build and train exactly the right size model for what they're doing. That's a completely new capability in the world, because there hasn't been an open source or open weight model of this sophistication that's ever been released before."
PS. If you found value in this post make sure to like and repost this tweet + follow @uncover_ai to stay updated with the latest AI news.
See you in the next one: