✨New Preprint ✨ Ever thought that reconstructing masked pixels for image representation learning seems sub-optimal?
In our new preprint, we show how masking principal components—rather than raw pixel patches— improves Masked Image Modelling (MIM).
Find out more below 🧵
Anthropic gave me $30,000 in Claude credits to research my own tumor I wrote what I built since March. I’m looking for someone who can manufacture a personalized vaccine, and a hospital that can give it https://t.co/bkJ1AI4m9g
Continuous Diffusion LMs went from niche to contender this year, but the recipe is shaky: why self-conditioning? How to embed tokens? 🤨
Our new work takes your one-hot flow from 4% to 50% on TinyGSM without self-conditioning, and explores the design space of CDLMs. 🔥🚀 (1/6)
Say hi to PUMBA! 🐗
Masked diffusion language models are trained one way and sampled another.
Our new paper studies how to make MDM training more aware of the trajectories followed at inference, and how this can lead to more efficient text generation.
Paper link below 🧵
What we're looking for:
• A track record of publishing at top-tier ML conferences and journals
• Hands-on experience across every stage of a research project
If this sounds interesting:
Know someone who'd be a great fit? Tag them or share this post. 🙏
The Apple MLR team in Barcelona is hiring!
I joined 3 months ago and I'm really excited about my job: open science, an experienced team, enough GPUs to keep you busy & research freedom.
Feel free to reach out or apply here: https://t.co/EDpFk5Teui
We're hiring at Apple MLR in Barcelona 🦎
Work on cutting-edge problems in robustness, interpretability, and next-gen archs. Publish at top venues. Contribute to open-source and push the field forward.
Apply: https://t.co/UrvouX5pk3
Or meet us at our booth at ICML 2026🇰🇷
🚀 The MLX team is growing!
If you love writing blazing-fast GPU kernels or implementing foundational models in Python & Swift, we want you.
Drop a DM or apply below! 👇 #MachineLearning#AppleSilicon
https://t.co/s9gWbzqSp9
https://t.co/QzsYdZPfnh
In a multimodal context, even the discrete/continuous divide is a distraction.
The real challenge is bridging the semantic gap between inherently high-level language tokens, and the very low-level representations we tend to use for perceptual signals.
(I couldn't resist😆)
🎨Activation steering can reliably push a text-to-image generator toward a visual concept, but at a cost: each concept needs its own estimation.
⚡HyperTransport (HT) predicts the intervention directly, matching per-concept SOTA at 3–4 orders of magnitude less cost.
[1/6]
Introducing the OpenAI Safety Fellowship, a new program supporting independent research on AI safety and alignment—and the next generation of talent.
https://t.co/vAQKvf8KyO
𝗣𝗮𝗿𝗮𝗥𝗡𝗡: 𝗨𝗻𝗹𝗼𝗰𝗸𝗶𝗻𝗴 𝗣𝗮𝗿𝗮𝗹𝗹𝗲𝗹 𝗧𝗿𝗮𝗶𝗻𝗶𝗻𝗴 𝗼𝗳 𝗡𝗼𝗻𝗹𝗶𝗻𝗲𝗮𝗿 𝗥𝗡𝗡𝘀 𝗳𝗼𝗿 𝗟𝗟𝗠𝘀
For years, we’ve given RNNs for doomed, and looked at Transformer as 𝘁𝗵𝗲 LLM—but we just needed better math
📄https://t.co/lFQrUEfEvZ
💻https://t.co/Lg7gbcwgFU
🚀 Excited to share LinEAS, our new activation steering method accepted at NeurIPS 2025! It approximates optimal transport maps e2e to precisely guide 🧭 activations achieving finer control 🎚️ with ✨ less than 32 ✨ prompts!
💻https://t.co/IdZOpwtFXC
📄https://t.co/sfPHk5sT2B
We’re excited to share our new paper: Continuously-Augmented Discrete Diffusion (CADD) — a simple yet effective way to bridge discrete and continuous diffusion models on discrete data, such as language modeling. [1/n]
Paper: https://t.co/fQ8qxx4Pge
🚨 Machine Learning Research Internship opportunity in Apple MLR! We are looking for a PhD research intern with a strong interest in world modeling, planning or learning video representations for planning and/or reasoning. If interested, apply by sending an email to me at [email protected]. Applications will be reviewed until the position is filled.
Super excited to share l3m 🚀, a library for training large multimodal models, which we used to build AIM and AIMv2. Massive thanks to @alaa_nouby@DonkeyShot21 Michal Klein @MustafaShukor1@jmsusskind and many others.
Had a great time speaking at @NECLabsEU about using activation steering for better instruction-following in LLMs!
Check out the talk 🗣️: https://t.co/nFcy1wBbuM
and paper 📜: https://t.co/ujMWHdzmXG
This work that I did at @MSFTResearch shows how interpretability-based approaches can improve LLM controllability, connecting model understanding with practical utility.
We hosted an insightful talk by @alesstolfo, PhD student at @ETH and doctoral fellow at the Swiss CYD Campus, on improving instruction-following in language models via activation steering. Watch here: https://t.co/zn9g6Ex70y. #NECLabs#LLM