gabriel teston

Solving language @Google Search

[gabriel teston @GabrielTeston]

Training LLMs across multiple datacenters is hard. 🛑

Synchronization demands often cause massive slowdowns as we scale up. If you're at @NeurIPSConf, come see how we tackle this!

Our work, "Scaling Laws for DiLoCo," shows how DiLoCo relax synchronization without compromising model quality, allowing training to scale incredibly well.

Come chat with me and @NovaFallen8:

🗓️ Thu, Dec 4 ⏰ 11 AM – 2 PM PST 📍 Exhibit Hall C,D,E, #811

#NeurIPS2025 #LLMs #DistributedTraining #ScalingLaws

[Zachary Charles @MatharyCharles]

We just put out a key step for making distributed training work at larger and larger models: Scaling Laws for DiLoCo

TL;DR: We can do LLM training across datacenters in a way that scales incredibly well to larger and larger models!

[gabriel teston @GabrielTeston]

It is today!

⏰ 11 AM – 2 PM PST 📍 Exhibit Hall C,D,E, #811

[gabriel teston @GabrielTeston]

Training LLMs across multiple datacenters is hard. 🛑

Synchronization demands often cause massive slowdowns as we scale up. If you're at @NeurIPSConf, come see how we tackle this!

Our work, "Scaling Laws for DiLoCo," shows how DiLoCo relax synchronization without compromising model quality, allowing training to scale incredibly well.

Come chat with me and @NovaFallen8:

🗓️ Thu, Dec 4 ⏰ 11 AM – 2 PM PST 📍 Exhibit Hall C,D,E, #811

#NeurIPS2025 #LLMs #DistributedTraining #ScalingLaws

[gabriel teston @GabrielTeston]

Heading to @NeurIPSConf in San Diego.

I’ve got some DiLoCo stickers to give away! 👾 ❤️

Come check out our poster.

🗓️ Thu, Dec 4
⏰ 11 AM – 2 PM PST
📍 Exhibit Hall C,D,E, #811

#NeurIPS2025

[Sam Lehman @SPLehman]

Attending @NeurIPSConf and interested in distributed, modular, and/or open AI?

Hadn't seen someone put together a list of poster presentations in this area so took it upon myself to thread out who I'm excited to talk to next week🧵

[gabriel teston @GabrielTeston]

@yacinelearning 😭

[gabriel teston @GabrielTeston]

@yacinelearning Are you going to NeurIPS boss?

[gabriel teston @GabrielTeston]

@eliebakouch @Ar_Douillard should we start calling it “planets” instead of “islands” already?

[Arthur Douillard @Ar_Douillard]

We have TPUs in space.

I have a DiLoCo implem running on TPUs.

Cosmic Distributed Learning when?

[gabriel teston @GabrielTeston]

@gabriel1 @nikitabier @gabriel @elonmusk Would it be like a UFC, can I challenge you after? (If you win)

[gabriel teston @GabrielTeston]

@yacinelearning @DanAdvantage Living my best life 🙏

[gabriel teston @GabrielTeston]

@DanAdvantage @yacinelearning One of the best. Btw I was here when I got the news about the promotion

[gabriel teston @GabrielTeston]

@yacinelearning @DanAdvantage Thanks boss

[gabriel teston @GabrielTeston]

@Ar_Douillard Super deserved!!!

[gabriel teston @GabrielTeston]

I would say probably get a full time role as RS/RE, maybe spend some time abroad and connect to more smart people 🤓

[Yacine Mahdid @yacinelearning]

what are you 5 years goal folks

[gabriel teston @GabrielTeston]

@eliebakouch @yacinelearning Nous is looking for a dj for their after party…🤭

[gabriel teston @GabrielTeston]

@Ar_Douillard Huge!

[gabriel teston @GabrielTeston]

@riseofreh @VictorTaelin Que porra é essa?

[gabriel teston @GabrielTeston]

@eliebakouch 😮

[gabriel teston @GabrielTeston]

Want to learn how to train models across the world, with 400x less bits exchanged and a huge latency tolerance? 🌎

I’ll be presenting our work on how to efficiently scale distributed training at @COLM_conf.

🗓️ TODAY: Tuesday, 11:00 - 13:00
📍 Room 710

#COLM2025