How to decide what to work on?
So many exciting ideas, so little time! How can one narrow down to a specific idea to work on? 🤔
Sharing some strategies I found useful. 🧵
Understanding Deep Learning
If you are looking for a comprehensive deep learning book with some of the more recent trends ( transformers, diffusion models, GNNs,...), this looks like a great option.
https://t.co/CAbT2vy67G
Transformer Catalog ( 2023 Edition)
Really neat timeline of Transformer models by @xamat. A great reference to track and find the latest notable Transformer models.
https://t.co/i74nI2FsuM
🔥 New (1h56m) video lecture: "Let's build GPT: from scratch, in code, spelled out."
https://t.co/2pKsvgi3dE
We build and train a Transformer following the "Attention Is All You Need" paper in the language modeling setting and end up with the core of nanoGPT.