Sam Duffield

[Sam Duffield @Sam_Duffield]

New open source: cuthbert 🐛

State space models with all the hotness: (temporally) parallelisable, JAX, Kalman, SMC

[Sam Power @sp_monte_carlo]

@Sam_Duffield https://t.co/NneaRdH8nA are all very good! I would guess that Adrien has some nice talks on YouTube also.

[Sam Duffield @Sam_Duffield]

@sp_monte_carlo 🔥 can you point to a good paper/resource to get up to speed?

[Sam Power @sp_monte_carlo]

Maybe a good time to look inwards a bit, and clarify for oneself what makes { a good proof, a useful construction, an effective bound, ... } and so on. I guess that we will be 'complaining' for some time (who knows how long), and it seems healthy to articulate our standards well.

[Sam Duffield @Sam_Duffield]

@canaesseth Makes sense, big fan of SDE matching! I am wondering whether similar techniques could be used to learn the unique scalar ϕ(x,t) in the decomposition

[Sam Duffield @Sam_Duffield]

Looped transformer: Calling the model only once is very bad, we need to call it many times

Consistency model: Calling the model many times is very bad, we need to call it only once

[Hanchen Li @lihanc02]

Wait how is looped transformer different from diffusion?

[Sam Duffield @Sam_Duffield]

@mblondel_ml How are you defining local vs global here? Token vs sequence?

[Max Welling @wellingmax]

My new book written with @sirui_lu97 and @HoldijkLars is ready to be ordered!

Major societal and economic shifts have always been anchored in foundational physics.
During the 1st Industrial Revolution, thermodynamics showed us how to harness energy to power steam engines.

[Sam Duffield @Sam_Duffield]

Which is more poorly named the transformer or the transformer?

[Sam Duffield @Sam_Duffield]

Which is the better invention the transformer or the transformer?

[Keller Jordan @kellerjordan0]

Ok I do want to soften my statement a bit. I wouldn’t claim that the numerical majority of papers in these conferences are overclaiming or fraudulent. It’s more like, as a reader, if you select for the papers that seem most exciting, then those ones will be majority overclaims.

[Normal Computing 🧠🌡️ @NormalComputing]

CN101 - A Digital Thermodynamic Computer for Generative AI is now live on arXiv.

Conventional chips spend energy suppressing noise to compute deterministically; CN101 is a noisy system engineered so its settling behavior is the computation, implemented in digital CMOS and evaluated on generative AI workloads from image generation across six chips to molecular free-energy estimation.

In a companion post, @ColesThermoAI, our Chief Scientist, shares reflections on the journey and why AI inference needs hardware built for its physics.

Paper: https://t.co/nD1SEQxwxB

Patrick's post: https://t.co/i5TPHDSoxQ

Quanta article: https://t.co/rfX20SKRyf
#ThermodynamicComputing #AIHardware

[Sam Duffield @Sam_Duffield]

@sp_monte_carlo beautiful

[Sam Duffield @Sam_Duffield]

Surely the best lineup in Newcastle since Demba Ba + Papiss Cisse

[ryan tan @ryantjx53]

cuthberto-carlos predictions for the final 2 games of the world cup!

I for one am excited for these games. model pits all teams at around the same skill levels, so it will be an interesting to see who comes out on top!

https://t.co/wlaOGz1aaT

[Sam Duffield @Sam_Duffield]

@irfnali1 Oh yeah it smashed the market in the semis, not the same margin in the earlier rounds though

But what does it matter anyway, it's not coming home 😿😿😿

[Sam Duffield @Sam_Duffield]

cuthberto predictions for the semi-finals are out!

As the games get tighter and more difficult to predict, the difference to the market increases

I sure hope it's wrong on the England game though 👀🏴󠁧󠁢󠁥󠁮󠁧󠁿

https://t.co/DcMdRtpPTT

[Sam Duffield @Sam_Duffield]

cuthberto this is all your fault

[Sam Duffield @Sam_Duffield]

cuthberto predictions for the semi-finals are out!

As the games get tighter and more difficult to predict, the difference to the market increases

I sure hope it's wrong on the England game though 👀🏴󠁧󠁢󠁥󠁮󠁧󠁿

https://t.co/DcMdRtpPTT

[Lars Holdijk @HoldijkLars]

Our book "Generative AI and Stochastic Thermodynamics: A Tale of Free Energies" is out this month. Over the coming weeks @sirui_lu97, @wellingmax and I will post about some of the topics it covers.

Starting it off: heat and work in latent variable models and variational EM.