Patrick David

🕳️ Physics 🕳️ Hardware 🕳️ AI Research 🕳️ Code 🕳️ Design 🕳️Recovering Quant

[Patrick David @pdquant]

my new product https://t.co/1LSvVF9zfA 🏝️launches today on product hunt

𝗚𝗣𝗧 𝗜𝘀𝗹𝗮𝗻𝗱 🏝️ 𝘪𝘴 𝘵𝘩𝘦 𝘮𝘰𝘴𝘵 𝘣𝘦𝘢𝘶𝘵𝘪𝘧𝘶𝘭 𝘸𝘢𝘺 𝘵𝘰 𝘤𝘩𝘢𝘵 𝘸𝘪𝘵𝘩 𝘺𝘰𝘶𝘳 𝘈𝘐

https://t.co/xV0w7m7q3l

[Patrick David @pdquant]

@Scholars_Stage Govt institutions are Lindy but nobody wants to admit it cc @nntaleb

[Patrick David @pdquant]

@Jordan_W_Taylor The amount of hurdles to overcome to get even a new winglet design into production these days,tells me the chance of it reaching production is the same as uss enterprise!

[Patrick David @pdquant]

@martinmbauer I don’t know how you have the patience and fortitude to reply so diligently to these glorified flat-earth accounts

[Patrick David @pdquant]

@johnrushx I’m gonna unfollow everyone because your all I need

[Patrick David @pdquant]

The covariance between rock climbing and being a physics phd is 90%
Iykyk

[Patrick David @pdquant]

@balajis I still find context window to be the main bottle neck - how large can it grow?

[Patrick David @pdquant]

@nntaleb ‘Hosting an audience with my blokees’ is such a Nassim thing to do !

[Patrick David @pdquant]

@NikoMcCarty These weekly updates are a godsend 🙏 I wish more people did this for their topic of expertise, thank you!

[Patrick David @pdquant]

Roger federer is now a billionaire and made more money from his footwear deal than his tennis career. Are there any other examples of this - making more from something other than their main career?

I can think of a few:
1. Bono - Private Equity
2. Michael Jordan - Nike
3. George Clooney - Casamigos Tequila
4. Dr. Dre - Beats any others ?

any others ?
https://t.co/oOwf09ea4p

[Patrick David @pdquant]

@rasbt Sadly I think these new positions will only be a temporary reprieve, before they are made obsolete too - the rate of progress is too strong

[Patrick David @pdquant]

@bronzeagepapi Ride XOR die only

[Patrick David @pdquant]

@FrnkNlsn I add so many of your recommendations to my book list! Cheers 🙏

[Patrick David @pdquant]

@maxhenningsson Ahh gotcha, yeah I’m finding CapCut too TikToky as well

[Patrick David @pdquant]

@peterrhague It’s cynicism not pessimism- ask any advertising exec, they will tell you brits are the most cynical audience cc @rorysutherland

[Patrick David @pdquant]

What’s your biggest AI regret?

Back in the day there was a lot of low hanging fruit to be picked in improving the algebraic subroutines on GPU’s -
Before Nvidia cornered the industry.
BLAS CUBLAS LAPACK etc

Were talking in the weeds algebra stuff like
Matrix-matrix operations, SVD, eigenvalue decomposition etc. Some of the maths was (marginally) inefficient but as things have scaled those percentage points began to matter!

I ignored this problem because all the cool shiny stuff was at the model architecture layer and above.

If I could go back, I would have worked on this unglamorous largely unappreciated foundational part of our modern world.

I don’t know how active an area this is anymore - I assume Nvidia has the best people working on it.

So next time you ask ChatGPT to generate a meme about a toad, spare a thought for all the unsung algebrists making sure those pixels get forward propagated as efficiently as possible. We salute thee 🫡 @karpathy @demishassabis @DarioAmodei @ClementDelangue

[Patrick David @pdquant]

@brianbondy Agreed

https://t.co/SCLNQnB7RV

[Patrick David @pdquant]

Acquiescence will be the death of us

[Patrick David @pdquant]

@geoffreylitt I haven’t tried it but the email-as-feed reminds me of ‘hey’ from @37signals from a few years back.

[Patrick David @pdquant]

@c_valenzuelab Isn’t the finite nature of a story, what makes it special? - it captures a moment in time, a place, a feeling?