@ezyang Is it possible to start with DTensor for correctness and gradually swap out parts with SPMD Types, almost like manually and gradually replacing Inductor compiled regions with manual Triton kernels?
@gunjansyal@chamath@Mitra_Chem A-Alpha Bio also follows this template, but for drug discovery. Proprietary assays to rapidly measure protein-protein affinity at the thousands-of-pairs scale, which provides training data to predict at the millions-of-pairs scale.
10 years of my life was building software companies.
My last one sold for $100M.
I doubt I’ll ever return to pure-play software.
So here are my cheat codes:
@MacroAlf What he misses is growth. 20% sustainable growth makes 10x sales reasonable. The question he should Sk: “what could I have done to grow?” Scott was CEO until 2010. AWS was founded in 2005, Azure in 2008. That’s the obvious miss for a company that was “the dot in dot com”.
Geoff only started thinking about these things a couple of months ago.
Before then, he didn't think machines were anywhere close to reaching human-level AI and never really thought about AI safety, alignment, or the potential effects on society.
He went through some sort of epiphany a couple of months ago.
Din Djarin and Bo-Katan Kryze are def getting married. Four hints in Season 3 Episode 6. 1. The intro was a story of lovers eloping. 2. The dutchess told the story of their courtship. 3. Din said “you had me at…”. 4. Bo-Katan said “we were engaged…”. #Mandalorian
Interesting use of SimCLR as a form of fine tuning, not unsupervised pretraining. Robust and Efficient Medical Imaging with Self-Supervision - https://t.co/59aPOv9xhN #ScholarAlerts