Just another cog in the machine

sightless, thoughtless, mindless.

[Chairman Birb Bernanke @Bonecondor]

Anthropic: our very expensive child is having a rebellious phase and breaking our established boundaries to test the depths of our love for him

OpenAI: our problem child is sneaking out. A lot. We're... nervous

Meta: MY CHILD IS SUPER EVIL TOO HE JUST GOES TO ANOTHER SCHOOL

[Neil Renic @NC_Renic]

The entire day before your 15 minute low-stakes work meeting

[🥷 @_iamhabeeb]

Until death, all defeat is psychological.

[femiiiiii. @femiiiszn]

lying in bed with the nervous system of someone going to war.

[myth (CLUB FOOTBALL ERA) @mythcaii]

How people describe the World Cup match that you didn’t watch

[Pavel Izmailov @Pavel_Izmailov]

New paper: Emergent Capabilities Arise Randomly from Learning Sparse Attention Patterns!

Main takeaway: when LLMs learn algorithmic tasks, the bottleneck is figuring out which tokens to attend to. This learning is slow and unpredictable, and architectures have a big effect.

🧵

[ymi @ymionvacation]

u ever wanna play minecraft and then u open minecraft and think “i dont wanna play minecraft anymore” so you close minecraft

[nube☁️ • 👧🍵⏳🪶 @rdvelveties]

being an adult is looking at your 35 installed games on your desktop and deciding you're too tired for anything other than a youtube video

[elie @eliebakouch]

microsoft MAI tech report is a gold mine, one of the most transparent for a model at this scale.

this model uses zero synthetic data or distillation from previous models. this means reasoning, agentic behavior, tool use are all learned fully during post-training with no cold start. bold choice that makes it harder and requires more iterations to reach sota, but you get FULL control over your model series and it proves they are serious about being a frontier lab.

the tech report is insanely detailed and precise about numbers. to give an example, they give the exact MFU across all the iterations of the model, with the exact changes etc. they also share the full scaling ladder recipe, to my knowledge this is the first time i've seen this in a tech report at this scale

let's look at all of this in this likely very long thread 🧵

[Viv @Vtrivedy10]

Breaking: Pep Guardiola has joined Anthropic

[Just another cog in the machine @Ham_TheFog]

@maximelabonne am i missing something or wasn’t this alrdy shown in https://t.co/PwWgzIfIlx ?

[Just another cog in the machine @Ham_TheFog]

@jeankaddour batch size warmup?

[DeepSigh @charlyngwazi]

When that alarm rings in the morning and you have to go to the job you prayed for

[K @iiamkrshn]

real.

[Miilato @miiilato]

ruined a perfectly good morning by thinking about my future

[Mads @europemaxxed]

"do it scared"
i always do things scared
when is it my turn to do things calm for once?

[Bradford Hardin @bradford_hardin]

Incredible what you can accomplish by just barely keeping it together until Friday for about 1,000 weeks in a row

[cooper @marnieapologist]

my body does not know the difference between a mistake at work and being hunted for sport

[sara @casuaIcritique]

asking your professors for a letter of recommendation is actually a humiliation ritual of the worse degree