I transformed hand-written notes from the other two courses I've taught into web lecture notes.
Intro to optimization: https://t.co/cZVz7J3LMU
Advanced optimization: https://t.co/1tjpuxmq7g
AI-generated figures still need careful human review โ titles overlapping plots, perpendicular lines that aren't actually perpendicular, etc. But Claude can finally get things right after a few trials.
And it can simple interactive demos on webpages, e.g., comparing convergence of first-order methods on Beale Function.
Video lectures, Purdue ECE 695 Optimization for Deep Learning (OPT4DL) fall 2025, by Abolfazl Hashemi
https://t.co/gZuJ463qiK
https://t.co/kffhjghI3S
.
๐MIT Flow Matching and Diffusion Lecture 2026 Released (https://t.co/bKgs2wghvY)!
We just released our new MIT 2026 course on flow matching and diffusion models! We teach the full stack of modern AI image, video, protein generators - theory and practice. We include:
๐บ Videos: Step-by-step derivations.
๐ Notes: Mathematically self-contained lecture notes
๐ป Coding: Hands-on exercises for every component
We fully improved last yearsโ iteration and added new topics: latent spaces, diffusion transformers, building language models with discrete diffusion models.
Everything is available here: https://t.co/bKgs2wghvY
A huge thanks to Tommi Jaakkola for his support in making this class possible and Ashay Athalye (MIT SOUL) for the incredible production! Was fun to do this with @RShprints!
#MachineLearning #GenerativeAI #MIT #DiffusionModels #AI
๐ข @CVPR 2026 Tutorial
Weโre turning our book ใThe Principles of Diffusion Modelsใ into a live tutorial at #CVPR2026๏ผ
Part I ยท Continuous Diffusion โ by me ๐
๐ฏ First-principles & intuitive view of diffusion
๐ฏ Fast generators & flow maps
๐ฏ Audio-visual content creation & protection โ by @mittu1204
๐ Link to our book: https://t.co/BRjPh6eF8q
Part II ยท Discrete Diffusion โ by @ssahoo_
๐ฏ The first tutorial crafted for discrete diffusion
Co-organizers: @StefanoErmon@DrYangSong@gimdong58085414
Full schedule + details ๐
Entropy is one of those formulas that many of us learn, swallow whole, and even use regularly without really understanding.
(E.g., where does that โlogโ come from? Are there other possible formulas?)
Yet there's an intuitive & almost inevitable way to arrive at this expression.
AI is physics. As someone who has been working on AI+Science before it was considered even possible it is fulfilling to see the Nobel prize committee highlight the impact to scientific domains. We built the first high-resolution AI-based weather models with Neural Operators. It lays a foundation for learning multiscale phenomena.
Two great books that I recommend on information theory:
* "Information theory, inference and learning algorithms" by Sir MacKay
Available at: https://t.co/wc62Wli1y3
* "Information Theory: From Coding to Learning" by Y. Polyanskiy and Y. Wu
Available at:
https://t.co/M9g5AAuAK4
To help explain the weirdness of LLM Tokenization I thought it could be amusing to translate every token to a unique emoji. This is a lot closer to truth - each token is basically its own little hieroglyph and the LLM has to learn (from scratch) what it all means based on training data statistics.
So have some empathy the next time you ask an LLM how many letters 'r' there are in the word 'strawberry', because your question looks like this:
๐ฉ๐ฟโโค๏ธโ๐โ๐จ๐ป๐ง๐ผ๐คพ๐ปโโ๏ธ๐โโ๏ธ๐งโ๐ฆผโโก๏ธ๐ง๐พโ๐ฆผโโก๏ธ๐ค๐ปโ๐ฟ๐ด๐ง๐ฝโโ๏ธ๐๐โโ๏ธ๐งโ๐ฆฝ๐งโโ๐๐
Play with it here :)
https://t.co/pFQGZIAW1k