whyoverfitting

Machine Learning Engineer at Big Tech (@HP). Physicist. Mathematician. All opinions are my own.

[Marc Lelarge 🌻 @marc_lelarge]

New hands-on course: implement KV Cache (faster inference) and LoRA (cheap fine-tuning) from scratch on top of @karpathy minGPT. You write the code, benchmark the speedups:
https://t.co/yteUHy4cLH

[whyoverfitting @whyoverfitting]

Rock climbing and fine tuning is such a blessed early morning routine

[whyoverfitting @whyoverfitting]

@gpu_thief Totally all the pros of it in a sentence haha

[whyoverfitting @whyoverfitting]

@ominousEureka Wow, attending NeurIPS is a huge milestone to be proud of :) Congrats!
O feel like sometimes we get so focused on chasing goals that we forget to celebrate what we’re doing.
Be proud of being part of something that cool and have fun!
I want to attend sooner or later 🤞

[whyoverfitting @whyoverfitting]

How’s your weekend going, anon?

[whyoverfitting @whyoverfitting]

@realmartiam Oh! Hello hello :)

[whyoverfitting @whyoverfitting]

Are we still in the timeline where anime pfps grind ML together and become cracked? Looking for mutuals fr fr 🙏🔥

[whyoverfitting @whyoverfitting]

Goated repo for understanding MoE in a detailed fashion https://t.co/rfRht5gPrV

[whyoverfitting @whyoverfitting]

https://t.co/ch8o0OoIFv

[whyoverfitting @whyoverfitting]

Weightlifting + cardio + retinol + hyaluronic acid = staple routine tbh

[whyoverfitting @whyoverfitting]

Gonna post a bit too about lifestyle and looksmaxxing, since I’ve been working my ass off till I have become pretty decent (will keep improving - gua sha red vaseline etc).
Even though I sometimes wish I’d stayed sub-3 so I wouldn’t be this distracted by love life as I am 💀

[whyoverfitting @whyoverfitting]

@mervenoyann Love seeing AI refs getting into running too. The long run + ML grind morning weekend routine has been a blast for me ngl!

[whyoverfitting @whyoverfitting]

Current state: grinding MoE papers and implementations 💪

[whyoverfitting @whyoverfitting]

@starrylights71 Weirdly enough, my followers increased the most when I stopped tweeting for like a year lol

[whyoverfitting @whyoverfitting]

Taking a minute to admire @cwolferesearch and @rasbt for crafting absolute banger blog posts/books on SOTA architectures

[whyoverfitting @whyoverfitting]

@rodmarkun Happy Bday!

[whyoverfitting @whyoverfitting]

Ok fr this time: back on the TPOT grind.
Switched teams to a more LLM fine-tuning oriented role within the company, grabbed a Master’s in Education for no reason (always have a backup plan), and got in decent shape (sub-40 10k + 100kg bench).
We ball again. ML updates soon.

[whyoverfitting @whyoverfitting]

@teknium Autoregressive Zuckerberg