DeepThink Lab

[DeepThink Lab @DeepthinkUmich]

https://t.co/86DhEqcbAy

[Siyi Chen @ChenSiyich]

🎉 Accepted to #CVPR2026

🔎 VLMs fall short on complex spatial reasoning.
They struggle with:
• Precise geometric perception
• Multi-step reasoning grounded in 3D
• Adapting perception dynamically to task and context

🚀 We propose a solution: visual tool-augmented spatial reasoning —
bridging perception and multi-step reasoning through diverse, error-aware, adaptive vision tool use.
And we go one step further:
🤖 enabling robot control by treating robots themselves as tools.

Our framework is powered by:
⚡ Double Interactive RL (DIRL), a new training framework combining demonstrations + real exploration
🛠 Real interaction with specialized computer vision models during RL
🤖 Toolshed, a scalable, asynchronous system for multimodal execution of vision tools and robots-as-tools

🔗 Project: https://t.co/xNLUjiNG4j
</> Code: https://t.co/MT3wd3MeF6
Toolshed is released with frontier-model demos.
Full training & evaluation release coming soon.

Done during my internship @NVIDIA — big thanks to the amazing collaborators! 🙌

#CVPR2026 #EmbodiedAI #ComputerVision #Robotics #ReinforcementLearning #MultimodalAI

[DeepThink Lab @DeepthinkUmich]

@AndrewLampinen Wow! Understanding mem/gen through the implicit bias or 'abilities' of networks is truly exciting!

In our ICLR2026 paper (https://t.co/ExUmEa9KPa), we prove diffusion models also generalize when learning structures from data and memorize when they store&amp;match training samples.

[DeepThink Lab @DeepthinkUmich]

#AISTATS #incontextlearning

[DeepThink Lab @DeepthinkUmich]

We’re excited to share our paper, “Out-of-Distribution Generalization of In-Context Learning: A Low-Dimensional Subspace Perspective,” has been accepted to AISTATS 2026! Congratulations, Soo Min and Alec!

[DeepThink Lab @DeepthinkUmich]

Experiments indicate our results hold in nonlinear Transformers (GPT-2) and nonlinear function classes, which is beyond our simplified theoretical setting.

Link to arXiv version: https://t.co/57L8TFzf57

[DeepThink Lab @DeepthinkUmich]

Experiments on synthetic and real data show similar conclusions hold beyond our theoretical setting.

Link to arXiv version: https://t.co/jydBsHzuc1

[DeepThink Lab @DeepthinkUmich]

We’re excited to share our paper, “Linearly Separable Features in Shallow Nonlinear Networks: Width Scales Polynomially with Intrinsic Data Dimension,” has been accepted to AISTATS 2026! Congratulations, Alec!

[DeepThink Lab @DeepthinkUmich]

Notably, our result states a network width that is polynomial with the intrinsic dimension suffices, bridging the gap between previous theoretical guarantees and empirical observations.

[DeepThink Lab @DeepthinkUmich]

Let’s congratulate Dr. Li on this tremendous milestone! We are incredibly proud of his achievements and wish him all the very best as he begins this new chapter at The University of Hong Kong.

[DeepThink Lab @DeepthinkUmich]

We are delighted to announce that Xiao Li has successfully defended his PhD dissertation. Congratulations, Dr. Li! 🎓

[DeepThink Lab @DeepthinkUmich]

Dr. Li is the first PhD graduate of our lab and one of the most dedicated, charismatic, and resilient students we have had. Over the past five years, Xiao has been an integral part of our DeepThink Lab, contributing significantly to our work on representation learning.

[Journal of Machine Learning Research @JmlrOrg]

'Understanding Deep Representation Learning via Layerwise Feature Compression and Discrimination', by Peng Wang, Xiao Li, Can Yaras, Zhihui Zhu, Laura Balzano, Wei Hu, Qing Qu.

https://t.co/hEWqZG8h3e

#classification #deep #features

[DeepThink Lab @DeepthinkUmich]

💥 We’re excited to share our DeepThink Lab's "year-end" work on the generalization of diffusion models by opening the black box of their neural network backbones.

[DeepThink Lab @DeepthinkUmich]

🔷 Learned representations can indicate whether the model is learning underlying data structures (with balanced, informative representations) or memorizing training data (with spiky representations). We elaborate below.

Read the full paper on arXiv: https://t.co/V0b62aVVqC