@163fighter@dwarkesh_sp There’s a phenomenal book summarizing the research on this topic called The Master Builder by Alfonso Arias. The view is increasingly changing to the cell being what truly encodes this information, and the DNA being just a helper
Inspired by “minimal implementation“ projects in AI such as @karpathy’s nanoGPT, I worked to bring this concept to the HPC world!
I’ve built a minimal implementation of an MPI library called nanoMPI, which focuses on clarity, simplicity, and easy installation.
@JosephMarella I’m not an expert myself but as far as I understand, the literature on scaling laws says that right now we’re constrained by dataset size rather than model size. There’s just not enough training code for it to saturate the model to where you wouldn’t need an expert to fix it up
IMPACT SUCCESS! Watch from #DARTMIssion’s DRACO Camera, as the vending machine-sized spacecraft successfully collides with asteroid Dimorphos, which is the size of a football stadium and poses no threat to Earth.
@shoyer@ID_AA_Carmack 1) Is something like DALL-E-2 not evidence of composable reasoning? The model takes text and generates an image based on the text.
2) Moore’s law may be over, but I’m not convinced overall perf has hit a wall. Multicore CPUs, GPUs, TPUs, etc are the most obvious example of why
@shoyer@ID_AA_Carmack I’m not an AI expert but I do wonder why John’s tweet is worthy of a “LOL” from a staff level ML engineer at google. @shoyer, is it really 100% (not just 99.99…%) certain that an AGI model does not exist somewhere?
The MVAPICH team is pleased to announce the release of MVAPICH2-Azure 2.3.2 targeted for Microsoft Azure cloud with optimized support for InfiniBand.
MVAPICH2-Azure-2.3.2 delivers excellent performance: https://t.co/CPyRDrySeG
To learn more, visit: https://t.co/oGGQ7224oM
@drericcole Hi Dr. Cole, I am wondering about your take on the “no password reuse” policy many organizations have. If they store all of a user’s past passwords, doesn’t that increase risk?
@KHodgess@sara14jillian You would think that an omnipotent god would just not create people who “choose to be gay” if he really wanted there to be no gay people