the messy whiteboard was the result of @kiborisov and I going through sitp's design matrix/curriculum which is threaded through the three parts of the book. each part incrementally increases the complexity of architecture, optimizers, and systems culminating in nanochat, muon, and torch.compile() with a little ddp
Muse Code is out of beta and now built to handle bigger, more complex engineering tasks. Developers can get started with one command today:
curl -fsSL https://t.co/0RApZrEJMv | bash
Open source version at https://t.co/Y1BlEsdvOb
Need to optimize storage and CPU usage. Can imagine an extension with Space and Turbopuffer where I can have unlimited computer history that’s instantly retrievable.
https://t.co/ouKAF4RyJ2
Today we're also opening the weights for Muse Glimmer, a great 30B parameter dense model that can run locally. Soon we'll also release the weights for Muse Spark 1.2, our latest foundation model. Meta is a strong supporter of open source and I'm proud of these releases. Congrats to @alexandr_wang and the MSL team for all your great work on these models.
I’m looking for people in Toronto who can help me pull off the 2nd season of Toronto School of Foundation Modelling. Have a few exciting guest speakers locked in already. I have more ambitious goals for this season. I’m looking for someone who
- can actually commit time every week to planning season 2. Talk is cheap, you want to do the work alongside me
- fairly technical / has the appetite to learn intensely
- you love learning and feel energized by the process and not just the outcome
These are my promises:
You’ll be paid for your work. You will learn a lot. Your name will be everywhere TSFM is. You’ll feel fulfilled by the impact you’ll have on the people here and you’ll be left inspired by the commitment the cohort will exhibit.
After all the socializing during tech week, the city needs to catalyze its evolution, starting from YOU.
2 weeks, 20 people, unbounded ambition.
At New Stadium. June 1-12. Apply below
1/ today we're releasing muse spark, the first model from MSL. nine months ago we rebuilt our ai stack from scratch. new infrastructure, new architecture, new data pipelines. muse spark is the result of that work, and now it powers meta ai. 🧵
The most valuable datasets in the world don’t exist yet.
We're here to change that.
The Uncharted Data Challenge is live on @kaggle. $20,000 in prizes.
pretraining research, with its kernels and optimizers, is often perceived as more "cracked" than humanistic vibes-driven posttraining research
but due to weaker verifiability, the latter seems much further away from being automated
plan your career accordingly
(1/7) Everyone's been piling on the https://t.co/Y095Nvlf7U syllabus at @Stanford by @AnjneyMidha and @mabb0tt as being too high-level (I saw some comparisons being made to Ted Talks, even Coachella 😅)
fwiw I personally think this is a great class, and its probably significantly more value in-person than online. I saw the lectures with @GuillaumeLample and @sualehasif996 from the Winter 2025 session and personally found them very informative.
But if you're looking for a deeper dive into frontier AI systems, here are 5 courses (and a few other resources) you will like:
Darn, one of npm’s most widely used packages just got hit by a supply chain attack.
A week ago, it was the LiteLLM Python library.
OpenAI or Anthropic really should consider giving open-source projects free tokens to run the cybersecurity agents on their code.