Zhanxing Zhu

Associate Prof. at University of Southampton @unisouthampton. Working on machine learning.

[Zhanxing Zhu @Zhanxing]

The paper is here for information. https://t.co/tzTo66WLkf

[Zhanxing Zhu @Zhanxing]

Due to a collaboration meeting, I cannot attend this year's ICML.

But we do have nice work to present!
Check out our paper to demystify how Transformers solve reasoning tasks using SFT and RL with CoT.

My student Bochen will present the poster, 8 July at 2:30pm #4609! 😃

[Zhanxing Zhu @Zhanxing]

@weijie444 Big Congratulations, Weijie!

[Zhanxing Zhu @Zhanxing]

@umutsimsekli Great! Umut, you should bring your guitar:)

[Zhanxing Zhu @Zhanxing]

Current Neural Scaling Laws for Transformer of LLMs rely on intensive empirical model training & curve fitting.

🚀 We present the first tractable, analytical Neural Scaling Law of linear self-attention for multitask sparse feature regression. See our #ICLR2025 paper: https://t.co/NO7lShDPYK

Just summarise several🔑 Key Contributions:
• Reformulated in-context learning dynamics as Riccati ODEs
• Analytical scaling laws for time, model size & data
• Insight into the effect of context sequence length

[Zhanxing Zhu @Zhanxing]

@songandyliu Haha why not distribute this game to colleagues? It is good time for showing Chinese kongfu 😁

[Zhanxing Zhu @Zhanxing]

@songandyliu @YiMXxxxx @laurence_ai Congrats! @YiMXxxxx

[Zhanxing Zhu @Zhanxing]

@simonbatzner Cool! Thanks! I will look into it. 😜

[Zhanxing Zhu @Zhanxing]

I heard a lot from friends that Tweeter is a good platform for sharing and discussing research works. So I returned. :) 😉

[Zhanxing Zhu @Zhanxing]

@mblondel_ml hey! followed you @twitter. keep in contact!

[Zhanxing Zhu @Zhanxing]

New to Twitter! Amounts useful information for me. Great!