We discovered a surprising, training-free way to generate images: no GANs or diffusion models, but a ✨secret third thing✨! Standard models like CLIP can already create images directly, with zero training. We just needed to find the right key to unlock this ability = DAS
1/11
i keep hearing how good LLMs are and how much people generate code with them yet every single time i try to do something relevant it's absolute garbage, are you people just writing simple CRUD apps all day? wtf
Iman Mirzadeh from Apple @i_mirzadeh wrote the famous GSM-Symbolic paper a couple of months back which argued that LLMs are learning surface statistics and not genuinely reasoning due to their sensitivity to distractors and out of distribution examples.
I used to say LLM can't reason. But I am now convinced that tree search + LLMs can achieve results similar to reasoning. Like tree search can yield better chess players than reasoning players (a.k.a. humans)
Sora's video quality seems impossible so I dug into how it works under the hood
it uses both diffusion (starting with noise, refining towards a desired video) and transformer architectures (handling sequential video frames)
read on 🧵
A very interesting explanation of what LoRA is and how LoRA works by implementing one from scratch upon an existing DistilBERT model
https://t.co/YvqVq8YLlF