Marco Pesco

Aerospace Engineer, Change Leader, Production Manager and Project Manager • Only my personal opinions here • Following and retweets are not endorsement

[Marco Pesco @MarcoPesco]

Ricordi il tuo primo giorno su X? Io sì! #IlMioAnniversarioDiX

[Marco Pesco @MarcoPesco]

Eccezionale articolo di @AlBrambilla

[Marco Pesco @MarcoPesco]

Sul ⁦@Corriere.⁩ Il 60% degli italiani non paga le tasse: le verità non dette su fisco, pensioni e sanità.
https://t.co/2q1FCVFLVf

[Marco Pesco @MarcoPesco]

@elonmusk In fact, I agree 😃

[Marco Pesco @MarcoPesco]

@naval Knowledge is disorder.

[Andrej Karpathy @karpathy]

These 94 lines of code are everything that is needed to train a neural network. Everything else is just efficiency.

This is my earlier project Micrograd. It implements a scalar-valued auto-grad engine. You start with some numbers at the leafs (usually the input data and the neural network parameters), build up a computational graph with operations like + and * that mix them, and the graph ends with a single value at the very end (the loss). You then go backwards through the graph applying chain rule at each node to calculate the gradients. The gradients tell you how to nudge your parameters to decrease the loss (and hence improve your network).

Sometimes when things get too complicated, I come back to this code and just breathe a little. But ok ok you also do have to know what the computational graph should be (e.g. MLP -> Transformer), what the loss function should be (e.g. autoregressive/diffusion), how to best use the gradients for a parameter update (e.g. SGD -> AdamW) etc etc. But it is the core of what is mostly happening.

The 1986 paper from Rumelhart, Hinton, Williams that popularized and used this algorithm (backpropagation) for training neural nets:
https://t.co/f52IcDNitR
micrograd on Github: https://t.co/GaTd16jRnB
and my (now somewhat old) YouTube video where I very slowly build and explain:
https://t.co/EPGG6kd5Yz

[Cass Sunstein @CassSunstein]

On a day of unfathomable grief, with the loss of Danny Kahneman, here's a happy moment. He was so, so, so happy when @R_Thaler got the Nobel.

[Wisdom Theory @wisdom_theory]

Daniel Kahneman, who changed psychology and economics forever, dies at 90.

Thanks for everything.

We remember him in 10 great quotes:

[Richard H Thaler @R_Thaler]

I was so lucky to be able to have Danny Kahneman as a best friend and collaborator for decades. He usually ended our conversations with "to be continued..." but I now have to simulate his part which is impossible. My favorite image of us "working".

[Andrej Karpathy @karpathy]

Sleep is beautiful because it makes your training jobs advance

[Marco Pesco @MarcoPesco]

@ceciliasala Grazie! Mi piacciono tanto le tue Storie!

[Yuri Sagalov @yuris]

Founders, if you're in the fortunate position to have AWS/etc credits, don't treat them as "free money."

Instead, treat it as extra cash on your balance sheet that you can only use for one purpose, and count your AWS usage as part of your burn. Don't wait until they run out.

[Pete @nonmayorpete]

Stanford just released a MASSIVE 386-page report on the state of AI.

Here are the 12 most interesting trends that you should know.

[Marco Pesco @MarcoPesco]

Today is a wonderful day!

[Giacomo Risitano @GiacomoRisitano]

Sono 18 anni che cerco di scoprire se esiste davvero il limite di fatica dei materiali. Con quel “davvero” indico l’essenza stessa del suo significato fisico-chimico-meccanico. Ho scritto più di 60 paper sul tema; non so quante tesi.👇🏻

[Jeff Bezos @JeffBezos]

Slide decks hide can shallow thinking. Narratively structured memos are harder to write because they require better thinking. It’s worth it.

[Dr. Marcell Vollmer #StaySafe #CES2026 @mvollmer1]

The Humanity Globe 🌏: World Population Density per 30km^2

A stunning #data visualization by Tyler Morgan v/ @pascal_bornet

#analytics #population #economy #FutureofWork

@PawlowskiMario @Shi4Tech @JeroenBartelse @FrRonconi @globaliqx @chboursin

[Marco Pesco @MarcoPesco]

@elonmusk Wow 😃

[Marco Pesco @MarcoPesco]

@waitbutwhy I like people that buy books twice 😃

[Marco Pesco @MarcoPesco]

@fortelabs Congratulations!!!