(1/n) What if you could teach a vision model about 3D structure without a single 3D label and just a tiny fraction of its pretraining compute? ποΈ Thatβs 3DPoV. β¨ Heading to #ICML2026 in Seoul π°π· to share it π
(5/n) Come find me at ICML!
πTuesday 2PM -> Hall A, poster #1309
Happy to talk 3D, self-supervised learning, or vision transformers β¨
Huge thanks to my amazing co-authors @MrzSalehi@shawshank_v@cgmsnoek@y_m_asano π
Very excited about our work on finding the right drifting direction π
We tackle a core open question in drifting: when does βno drift leftβ mean the model really matched the data?
Kernel-gradient drifting is the answer (with natural extensions to manifolds + discrete data)!
Discrete diffusion β but fast? β‘οΈ Test-time inference β but for discrete data? π§
Categorical Flow Maps: continuous transport toward the simplex, turning discrete generation into a single-step problem. Built on Variational FM (CatFlow), we obtain (self-)distillation from scratch.
Language, molecules, and test-time steering β one framework.
Scaling to LLMs and foundation models next. Watch this space π
π¨ New paper accepted at @ICCVConference
As video foundation models gain momentum, we introduce MoSiCβa method that leverages motion as supervision to learn dense, temporally consistent representations.
Full details in the thread! β¨
New paper out - accepted at
@ICCVConference
We introduce MoSiC, a self-supervised learning framework that learns temporally consistent representations from video using motion cues.
Key idea: leverage long-range point tracks to enforce dense feature coherence across time.π§΅
π NeCo is accepted to @iclr_conf#ICLR25
TL;DR: Self-supervised patch-level neighbor consistency boosts dense features of foundation models like DINOv2βin just 19 GPU hours.
π Tomorrow,10:00β12:30@Hall3+Hall2B#133
π Paper: https://t.co/er8Y47trVI
Wait, we can just ask? π
Here's what we do at @FunAILab in Nuremberg: research on self-supervised learning from images and videos and building /improving (M)LLMs. @nvidia@LambdaAPI@CohereForAI :)? Happy to provide more info.
π Excited to present SIGMA at @eccvconf ! π We upgrade VideoMAE with Sinkhorn-Knopp on patch-level embeddings, pushing reconstruction to more semantic features. With @mdorkenw.
Letβs connect at today's poster session at 4:30 PM, poster number 256, or send us a DM.
SO happy to announce our work on Variational Flow Matching for Graph Generation has been accepted to π³ #NeurIPS2024 π³!
Thanks again to the amazing @GrigoryBartosh , @canaesseth , @wellingmax , and @jwvdm β€οΈ
See you in π¨π¦ for the next edition of @NeurIPSConf
First time organising a Tutorial with an amazing team and am very excited π! The topic is learning from videos, which I think will be the new 'Big' paradigm for new vision foundation models. Come to learn, chat and discuss @eccvconf!
π° blogpost:
https://t.co/9OWML2JPkX
πΉοΈ google colab:
https://t.co/vBxnTWhALp
I tried to make the blog post more accessible than the paper and added a lot of supporting visualizations.
Please check it out if you are curious about spacetime-equivariant CNNs π