Roshan Sumbaly

@AIatMeta, @coursera, @linkedIn, @stanford

[Evergreen Capital @evergreencap3]

Following-up: Muse Spark is 100% legit. It handles my general queries as well as, if not better than, other frontier models. And echoing @borrowed_ideas: 'contemplating mode' is a true leading-edge feature.

Congrats to @alexandr_wang and the entire MSL team! Can't wait for more.

[Alexandr Wang @alexandr_wang]

okay this is too exciting :)

meta AI is now #2 in the app store, top AI app!

we are so back!

[Michael Golden @michaelgold3n]

I gave the new Meta Muse Spark model a bunch of assorted assets and it was able to carefully extract them and place it into a functioning app.

I've never seen something with a clear intuition for design and product-first thinking.

This is the first AI that *gets* UI design.

[Arena.ai @arena]

Meta is back in the Arena!
Muse Spark debuts as a top frontier model across both Text and Vision:
- Text Arena: #3 tied with Gemini-3.1-Pro and Claude-Opus-4.6
- Vision Arena: #2 tied with Claude-Opus-4.6

This marks Meta’s first major release since early 2025.

Highlights:
- #4 Hard Prompts, #6 Coding, #9 Creative Writing, #10 Instruction Following, #27 Expert
- #3 tied for Business, Management, & Financial Ops, #7 Legal & Government, #12 Writing & Literature

Meta is back at the frontier. Huge congrats to @AIatMeta on this incredible milestone!

[Shengjia Zhao @shengjia_zhao]

Meta is back! Not only is it a high scoring models on AA third party eval, it is also one of the most token efficient.

[Alexandr Wang @alexandr_wang]

1/ today we're releasing muse spark, the first model from MSL. nine months ago we rebuilt our ai stack from scratch. new infrastructure, new architecture, new data pipelines. muse spark is the result of that work, and now it powers meta ai. 🧵

[Roshan Sumbaly @rsumbaly]

Say hi to Muse - Meta Superintelligence Lab's new foundation model series. Today we're releasing the first model Spark 🥑. Lots of goodness in this natively multimodal reasoning model that does well on several agentic and knowledge tasks. And it is available on https://t.co/1DAbzDW3DP for you to play with today!

It has been almost a year of hunkering down and rebuilding our stack to scale - so lots more to talk about in the upcoming months. Let's go!

Blog: https://t.co/AZ6VzvoJnX

[Roshan Sumbaly @rsumbaly]

17 years ago, I took courses from @chrmanning and later TA’d a course he co-taught with @WittedNote at Stanford. The lessons in humility and patience I learned from him in those brief interactions as a young grad student still stay with me. His influence on the field of NLP and LLMs is immeasurable — and he remains one of the most humble human beings I’ve known.

[Diyi Yang @Diyi_Yang]

Stanford NLP 25th Anniversary🤩🤩🤩

[Roshan Sumbaly @rsumbaly]

@AnjneyMidha What have we done?! 🤭

[Roshan Sumbaly @rsumbaly]

@TheXeophon @zimmskal @ylecun @Ahmad_Al_Dahle @sharan0909 @zimmskal Would love to connect and improve - I'll DM you!

[Roshan Sumbaly @rsumbaly]

@fourthfought @_arohan_ Yes, we do want to share more details somehow (blogs, paper) - just were busy cooking. Stay tuned!

[Roshan Sumbaly @rsumbaly]

@TheXeophon @AIatMeta Thank you, any place we can read more about your eval set? DMs open too! We'd love to keep improving...

[Roshan Sumbaly @rsumbaly]

@skirano @keithofaptos https://t.co/7kld959MNv

[Roshan Sumbaly @rsumbaly]

@dzhulgakov @FireworksAI_HQ @Meta Thank you for being amazing partners and moving fast with us (as always!) cc @lqiao

[Roshan Sumbaly @rsumbaly]

@emollick We're still post-training. Also Behemoth isn't a reasoning model (yet!).

[Roshan Sumbaly @rsumbaly]

@natolambert We were ready, so thought "why not"?🚀

[Roshan Sumbaly @rsumbaly]

@maximelabonne I'm going to use that word internally now "outllamaed" 🚀

[Roshan Sumbaly @rsumbaly]

Llama 4 is here with 4 models!🦙🦙🦙🦙

I'm back to share with the world what the team has been cooking. Today we're open-sourcing 2 state-of-the-art omni models (Scout, Maverick - including pre-trained weights), previewing a 3rd one (Behemoth) and will drop a reasoning one soon.

We've moved from dense models to MoEs, and pre-trained all of these with 30T tokens spanning modalities and over 200 languages:
🏕️ Scout: 17B active, 16 experts, 109B total params. I call this a "hobbyist" model as it can fit on a single GPU and is better than all our previous Llama 3 models. And with 10M context window you can really push the limits...
🐴 Maverick: 17B active, 128 experts, 400B total params. Our "workhorse" model that powers Meta AI assistant. And with state-of-the-art native multimodality support it, we hope the community can build some really cool applications...
🐳 Behemoth: 288B active, 16 experts, 2T total params. This teacher model was pre-trained on 32K GPUs and is still post-training - but has already been instrumental in enabling the above models. And it's already the best model in the world, outperforming GPT-4.5, Claude Sonnet 3.7, and Gemini 2.0 Pro on several STEM benchmarks

We're just getting started! We have a few more releases lined up and are excited to share everything with the community (heck, even on a Saturday!). Our commitment to open-source is unwavering and we'll publish details of all our new techniques soon.

Exciting time to be at Meta and in the AI community - come cook with me as we push the limits of post-training!

Start here https://t.co/1in4yatHl2
Blog https://t.co/sCLFXNtfho
Also you can try them out on https://t.co/QSwteGe8dn
🕷️