RepresentAI helps upskill women and under represented groups in AI. We share daily AI news, training and events. We’ve upskilled over 1700 since 2025. Join us!
llm.c by hand ✍️ C meets Transformer
This combination is perhaps as low as we can get to explain how the Transformer works.
Special thanks to @Andrej Karpathy
--
Part 1: gpt2_forward
Karpathy's llm.c implements the transformer forward step as the following sequence.
(skip)layernorm_forward
1. matmul_forward
2. attention_forward
3. matmul_forward
(skip) residual_forward
(skip) layernorm_forward
4. matmul_forward
5. gelu_forward
6. matmul_forward
(skip)residual_forward
--
Part 2: matmul_forward
B: Batches (of Tokens)
T: Tokens
C: Input Channels
OC: Output Channels
--
C programming and matrix multiplication are two of the most important topics. But it is often difficult to get people excited by these topics.
I hope this exercise can help people see further into the LLM black box, and appreciate C programming and matrix multiplication by hand. 😀
---
100% original, made by hand ✍️
Join 56K+ readers of my newsletter: https://t.co/fFt8roc8D9
Glamorous Networking & Mentoring event sponsored by @BcsLgbtq 🎉
The event brings together #womenintech, non-binary individuals and allies to celebrate, and exceed their career goals
Register here: https://t.co/YGYTpnzdwY
@MintEventsLDN @avanadeuki @diversecxo
@British_Airways This is ridiculous. @British_Airways@HeathrowAirport.
It’s been a 10hr+ flight to LHR. Now stuck on a plane for 1hr 45 mins as you can’t park the plane due to fuel & logistic errors. Finally you get somewhere for us to park & you stop the plane too soon! #stillstuckonaplane
@British_Airways@HeathrowAirport - we are stuck on a plane. It’s not ok to make people wait for 1.15 hr on top of a 10/11 hour flight when this could have been avoided if you’d checked all the fuel and logistics properly. I was also charged 13k for this flight! Shameful.
@British_Airways We landed nearly 1.5 hrs ago. You should just let us off the plane or at least give us food/ refreshments/ further updates or a refund! If it gets to 2 hours of waiting on the tarmac that means 1/5 of my whole journey time as been stuck on tarmac on the ground - not flying!
Brilliant to be at the #PowerofWomen#TV's Late Late Show- Phenomenal Women event tonight which is a serie which unites some of the world's most philanthropic, powerful, extraordinary women from a selection of industries @TheNedLondon
Well done amazing host, actress @JulieGraham & global talent expert, @GillHardy plus women's rugby star, @PoppyCleall & Chief Marketing Officer of @SportsDirectUK, Beckie Stanion & jockey, @GayKelleway & portrait photographer, @SaneSeven (shout out from our @WomenInDataUK pics!)
UtterBerry is currently taking part in the @Swisspower_CH event "Decarbonising Cities", aiming to tackle climate change with technology. #decarbonisingcities
@Borderlands@Borderlands3Key please help we installed a hotfix and now it’s made the view on the two player split game terrible. See below - now we can’t see out in entire as it’s tiny
Thank you to the Bessemer Society for publishing this Members Profile on UtterBerry CEO and Founder Heba Bevan, and on how UtterBerry is working to shape the future.
https://t.co/O1XVmCyIyB
Heba Bevan UtterBerry's CEO gives evidence to Parliament on #Telecoms Security Bill, discussing diversification strategies for #5g and #photonics , along with fellow expert witnesses Dr. Andy Sellars, and Dr. Nick Johnson.
Acquisition of Slack by Salesforce -- makes total sense for both parties, and they're both good companies. BUT ... this whole trend toward centralized oligopolization of tech (as tech's criticality/reach increases) ... there's only one word for it ... https://t.co/gaxQLSgynN
1975: Microsoft founded
~22 years later~
1997: US v Microsoft filed
———————————-
1998: Google founded
~22 years later~
2020: US v Google filed
***************************
Apparently being sued for antitrust is like graduating from college for tech companies.