Excited to share this has now been accepted at #NeurIPS2025 as a position paper (<6% acceptance)!๐
We advocate for systematically studying entire model populations via weight-space learning, and argue that this requires charting them in a Model Atlas.
@NeurIPSConf#NeurIPS
๐งต๐
We are releasing a paper I'm very excited about. We know test-time scaling is a path to greatly improved results, and achieves reasoning in the case of LLMs. We present a new and promising way to amortize it into training using HyperNetworks for image generation models.
@karpathy Thanks for the inspiring talk (as always!). I'm the author of the Model Atlas. I'm delighted you liked our work, seeing the figure in your slides felt like an "achievement unlocked"๐Would really appreciate a link to our work in your slides/tweet https://t.co/rJjBhMmRjf
When we "erase" a concept from a diffusion model, is that knowledge truly gone? ๐ค
We investigated, and the answer is often 'no'!
Using simple probing techniques, the knowledge traces of the erased concept can be easily resurfaced ๐
Here is what we learned ๐งต๐
In our #ICLR2025 paper, we introduce WIND ๐ฌ๏ธ
A method that embeds a distortion watermark directly in the diffusion noise! Our method ensures that the watermark in one image does not reveal information about the watermark in other images ๐คซ
๐ https://t.co/jmEw4g3scN
(1/5)
๐จ New paper alert! ๐จ
Millions of neural networks now populate public repositories like Hugging Face ๐ค, but most lack documentation. So, we decided to build an Atlas ๐บ๏ธ
Project: https://t.co/1JpsC6dCeg
Demo: https://t.co/4Xy7yLdIZY
๐งต๐๐ป Here's what we found:
5/5 For object insertion, we leveraged an ObjectDrop (https://t.co/qqmKcCLsZP) data synthesis stage, where we remove objects with their shadows/reflections. This creates high-quality background images for supervised training, leading to SOTA results with either 1 or 3 references.
I'm sharing something unique we've been making at Google (w/ UNC). We are releasing our work on a new class of interactive experiences that we call generative infinite games, essentially video games where the game mechanics and graphics are fully subsumed by generative models ๐งต
With friends at @Google we announce ๐ Magic Insert ๐ - a generative AI method that allows you to drag-and-drop a subject into an image with a vastly different style achieving a style-harmonized and realistic insertion of the subject (Thread ๐งต)
web: https://t.co/lL7WYUqCDd