I’m happy to share that I’ve completed my PhD 🎓
I’m sincerely grateful to Prof. Issei Sato and everyone who supported me along the way.
I have started a position as a Special Postdoctoral Researcher (基礎特研) at RIKEN, working at the intersection of AI and science.
But the Bitter Lesson from AlphaFold & EVO2 is that scaling is actually very challenging in biology & even today models that incorporate domain specific constraints & inductive biases are still very hard to beat. 8/
🎉 Thrilled to announce our paper, "Understanding Generalization in Physics Informed Models through Affine Variety Dimensions," has been accepted to #NeurIPS2025!
paper link: https://t.co/f17PuhXOPR
A huge thanks to my supervisor, Issei Sato(@issei_sato)
We're excited to welcome 28 new AI2050 Fellows! This 4th cohort of researchers are pursuing projects that include building AI scientists, designing trustworthy models, and improving biological and medical research, among other areas. https://t.co/8oY7xdhxvF
Solving control problems can be hard. This is why we introduce trust region methods, approaching them iteratively in a systematic way. In fact, this can be understood as a geometric annealing from prior to target with adaptive steps. More at @NeurIPSConf, https://t.co/YS1VkDYBEB.
We’re announcing a major advance in the study of fluid dynamics with AI 💧 in a joint paper with researchers from @BrownUniversity, @nyuniversity and @Stanford.
🎉 Thrilled to announce our paper, "Understanding Generalization in Physics Informed Models through Affine Variety Dimensions," has been accepted to #NeurIPS2025!
paper link: https://t.co/f17PuhXOPR
A huge thanks to my supervisor, Issei Sato(@issei_sato)
We show the generalization of Physics-Informed Linear Regression depends on the affine variety dimension from the physical constraints, rather than its parameter count, explaining why 'physics' can prevent overfitting.
🎉 Our paper on "the expressive power of Looped Transformers" was accepted at #ICML2025 !
To the best of our knowledge, this is the first study to analyze their function approximation capabilities, including approximation rates and universality.
https://t.co/i90Z7KujbI
The following paper has been accepted to ICML 2025!
On Expressive Power of Looped Transformers: Theoretical Analysis and Enhancement via Timestep Encoding
Kevin Xu, Issei Sato
https://t.co/uYfe1vaApm
The following paper has been accepted to ICML 2025!
Benign Overfitting in Token Selection of Attention Mechanism
Keitaro Sakamoto, Issei Sato
https://t.co/nqdKAZIQD8
Our paper on Neural Operator: 'Understanding the Expressivity and Trainability of Fourier Neural Operator: A Mean-Field Perspective' was accepted at #NeurIPS2024 🎉 🇨🇦
paper link: https://t.co/hBB0JnM0dn
Huge thanks to @fujisawa0211 , @yusuk_et , @issei_sato