Pol Puigdemont

ml phd student @EPFL

[Pol Puigdemont @polpuigdemont]

@LucaViano4 @CevherLIONS @neu_rips @arkrause @NicoloCB @canondetortugas congrats Luca!!

[Pol Puigdemont @polpuigdemont]

@kimbochen systems decision more than a modeling decision? see challenges in https://t.co/UZ5jYRDp6j

[Pol Puigdemont @polpuigdemont]

xW >> Wx

[Arshia Afzal @rshia_afz]

I will be traveling to 🇰🇷 for @icmlconf 2026 and presenting Violin 🎻!

A cute old project that comes from a simple idea: can we improve ViTs by redefining each patch’s neighbors?🐱

It turns out the answer is yes, by simply processing image patches in a different order, defined by Space-Filling Curves (SFCs), and using a decayed distance in SSMs for each curve! 🐍

[Arshia Afzal @rshia_afz]

I recently wrote a blog post on how the forget gate in SSMs can lead to different position embeddings in softmax transformers. The takeaway is summarized in the table below 📚!
Special thanks to @avivbick and @polpuigdemont for reviewing!
Link 👇
https://t.co/F6H9qpbZAE

[Pol Puigdemont @polpuigdemont]

contextfiles are the new dotfiles

[Pol Puigdemont @polpuigdemont]

:):)

[Roy Rinberg @RoyRinberg]

LLMs know how to make a bioweapon! 🦠
But, when we *un*learn harmful knowledge about anthrax, the model underperforms on related concepts.

It is difficult to detect what “ripple effects” a model-edit has on an LLM.

We found a solution🧵👇(Spotlight at MechInterp Workshop)

[Pol Puigdemont @polpuigdemont]

Thanks to my co-authors Ioannis Mavrothalassitis, Noam Levi (https://t.co/eMOdHbAOTC), @CevherLIONS

paper link :) https://t.co/swb0Hraz1n

[Pol Puigdemont @polpuigdemont]

𝗔𝘀𝗰𝗲𝗻𝘁 𝗙𝗮𝗶𝗹𝘀 𝘁𝗼 𝗙𝗼𝗿𝗴𝗲𝘁 (@ NeurIPS 2025)

Contrary to popular belief, we show that gradient ascent-based methods frequently fail to perform machine unlearning. Some thoughts on what this means:

[Pol Puigdemont @polpuigdemont]

We will be presenting at

NeurIPS San Diego, Fri 11:00-2:00, #1308: https://t.co/WlhJ45SZjj

EurIPS (presented by Ioannis Mavrothalassitis): https://t.co/wDXHeBkehm

Deep Learning Barcelona Symposium 17 Dec. (talk + poster):
https://t.co/4n9h0aoJlS

[Pol Puigdemont @polpuigdemont]

@rshia_afz @abad_rocamora san diego 11:00-2:00 exhibit hall C,D,E #3504 🙌

[Arshia Afzal @rshia_afz]

I am attending EuRIPS ✈️ and presenting LION 🦁 tomorrow at 10:30, stand 43!
Also, amazing @abad_rocamora and @polpuigdemont will be at #NeurIPS2025 and presenting the paper in San Diego! Check it out and DM me here to chat and hang-out!🔥