Huge congrats to @AIatMeta on the Llama 3.1 release!
Few notes:
Today, with the 405B model release, is the first time that a frontier-capability LLM is available to everyone to work with and build on. The model appears to be GPT-4 / Claude 3.5 Sonnet grade and the weights are open and permissively licensed, including commercial use, synthetic data generation, distillation and finetuning. This is an actual, open, frontier-capability LLM release from Meta. The release includes a lot more, e.g. including a 92-page PDF with a lot of detail about the model:
https://t.co/48e3YJ8Sg9
The philosophy underlying this release is in this longread from Zuck, well worth reading as it nicely covers all the major points and arguments in favor of the open AI ecosystem worldview:
"Open Source AI is the Path Forward"
https://t.co/AdmpadCRM0
I like to say that it is still very early days, that we are back in the ~1980s of computing all over again, that LLMs are a next major computing paradigm, and Meta is clearly positioning itself to be the open ecosystem leader of it.
- People will prompt and RAG the models.
- People will finetune the models.
- People will distill them into smaller expert models for narrow tasks and applications.
- People will study, benchmark, optimize.
Open ecosystems also self-organize in modular ways into products apps and services, where each party can contribute their own unique expertise. One example from this morning is @GroqInc , who built a new chip that inferences LLMs *really fast*. They've already integrated Llama 3.1 models and appear to be able to inference the 8B model ~instantly:
https://t.co/b2kdSsz0fH
And (I can't seem to try it due to server pressure) the 405B running on Groq is probably the highest capability, fastest LLM today (?).
Early model evaluations look good:
https://t.co/RLR5YBpmks https://t.co/ipT4x4wCvy
Pending still is the "vibe check", look out for that on X / r/LocalLlama over the next few days (hours?).
I expect the closed model players (which imo have a role in the ecosystem too) to give chase soon, and I'm looking forward to that.
There's a lot to like on the technical side too, w.r.t. multilingual, context lengths, function calling, multimodal, etc. I'll post about some of the technical notes a bit later, once I make it through all the 92 pages of the paper :)
Big news day in our portfolio! As we exit @Matterport we also announced @ziggcap that we have entered into our first French investment in Zefir (https://t.co/zdhccDmsPI) with some more details here: https://t.co/ig7djfr14z
and here for les francophones https://t.co/hMF71vjilk
New YouTube video: 1hr general-audience introduction to Large Language Models
https://t.co/Bl4WNuNyFJ
Based on a 30min talk I gave recently; It tries to be non-technical intro, covers mental models for LLM inference, training, finetuning, the emerging LLM OS and LLM Security.
Sam Altman is a hero of mine. He built a company from nothing to $90 Billion in value, and changed our collective world forever. I can't wait to see what he does next. I, and billions of people, will benefit from his future work- it's going to be simply incredible. Thank you @sama for all you have done for all of us.
Benoît Saint (@BenoitSt_Denis) is a true rising contenders in the lightweight division!
Take a look at how "God of War" climbed his way into the lightweight rankings ahead of his #UFC295 bout⬇️: https://t.co/c9R9nXzhTP
https://t.co/c9R9nXzhTP
Impressionné par le combat de @BenoitSt_Denis à l'UFC Paris?
Écoutez son histoire sur notre podcast SANS LIMITES. 215k vues, 4.9k likes et 278 commentaires sur YouTube.
Congrats brother 💜
https://t.co/FqyY4y7L2B
🥶 IL EST D'UNE FROIDEUR...
🇫🇷💥 Devant les yeux ébahis de @WilliamGomisMMA, @ManonFiorot_MMA et @LapilusTaylor, notre guerrier @BenoitSt_Denis avoue qu'il a adoré se faire rouer de coups par Elizeu lors de sa défaite pour son premier combat à l'UFC !