Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)

@HuggingFace ✨

"The future is already here, it’s just not very evenly distributed" (Gibson)

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

Hey twitter!

I'm releasing the LLM Evaluation Guidebook v2!
Updated, nicer to read, interactive graphics, etc!
https://t.co/xG4VQOj2wN

After this, I'm off: I'm taking a sabbatical to go hike with my dogs :D
(back @huggingface in Dec *2026*)

See you all next year!

[Rosmine @rosmine]

We need to be dog maxxing our models

There is 0% chance of doom if the chain of thought is

user: hello
model: <think> Oh my god it's a human. I love humans. I will say hi to him, maybe he will give me a problem to chase. I love chasing problems. I will chase the problem for him then he will love me and I will be his best friend. Must help human </think>
model: hello! what can I help you with today?

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@realmrfakename @reach_vb Your idea was a super cool one &amp; I believe it would have shone through without us, but it was a delight doing this collab with you :)

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@MaziyarPanahi @maximelabonne true! + the community got some fascinating results out of it, like how merging seemed to improve evals raw scores but not downstream tasks ability, which I didn't find intuitive tbh

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@MaziyarPanahi @maximelabonne "Chapter 2: Cachez ces merges que je ne saurais voir"

(+ all subchapters about users going on random in depths quests to show who potentially cheated - they really did love flagging stuff ^^)

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@MaziyarPanahi @maximelabonne @HKydlicek really helped us on this one with Math-Verify!

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@valentina__py There was a very cool prez by @haileysch__ somewhere iirc!

[Jimmy Lin @lintool]

👀Introducing a brand new @yupp_ai SVG leaderboard ranking frontier models on the generation of coherent and visually appealing SVGs!

Gemini 3 Pro by @GoogleDeepMind takes the crown as the most powerful model! 👏

We’re also releasing a public SVG dataset. Details in🧵

[François Chollet @fchollet]

Either you crack general intelligence -- the ability to efficiently acquire arbitrary skills on your own -- or you don't have AGI.

A big pile of task-specific skills memorized from handcrafted/generated environments isn't AGI, not matter how big.

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@swyx @huggingface The "time" subset of GAIA2, very tricky for models atm - and we'll probably see very, very good progress on games based benchmarks (with stronger game based benchs coming out)

But my biggest prediction is that the main trend of 2026 will be ML for science ^^
(so mb benchs there)

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

Hey twitter!

I'm releasing the LLM Evaluation Guidebook v2!
Updated, nicer to read, interactive graphics, etc!
https://t.co/xG4VQOj2wN

After this, I'm off: I'm taking a sabbatical to go hike with my dogs :D
(back @huggingface in Dec *2026*)

See you all next year!

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@swyx @huggingface The hike in itself is probably going to take 6 months but I need to prepare physically before (and do some random stuff, like paragliding and seeing friends ^^)

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@Teknium @huggingface Thanks a lot! You can always follow @nathanhabib1011 , he's the one taking over all our cool eval stuff (lots of very, very neat things coming up btw)

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@codewithimanshu @huggingface Probably! It will be fun to see then :)

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@mziizm @huggingface Thanks a lot! :)

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@maximelabonne Thanks a lot :)

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@altryne @nisten no problem! my pic is def gender neutral ^^"

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@giffmana @huggingface Thanks a lot, I'm super excited about it :D
(so much to do, so little time ^^)

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@TheOkosisi @huggingface Feel free to cite it as you need! :)

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@latkins Hahahahahaha 💯 my mood when writing the tweet XD

[Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) @clefourrier]

@nisten @altryne I hope you'll be in a year ^^ (she or they btw XD)