#CFDip course in @ParisDiderot:
My #PhD project is about finding a way so that a cooperative team of #Robots (potentially #UAVs) can distribute tasks between them, in a decentralized, robust manner to the environment dynamism without losing performance #AI#MultiAgentSystems
What if you could take three completely different model families… and distill them into one tiny model? 🤯
📜 Paper: https://t.co/K2iKD4xFvp
MOPD (Multi-Teacher On-Policy Distillation) has become a standard procedure in post-training. We already distill multiple specialized variants of the same model into a single set of weights.
But what if we could go further - and distill models from entirely different families? Turns out, it is possible.
Today we’re releasing a paper on cross-tokenizer distillation - our first steps in this exciting direction. 📄
We distilled Qwen3-4B, Phi-4-Mini, and Llama-3B into Llama-3.2-1B.
MMLU jumped from 32.05 → 46.32 when using multiple teachers. 📈
The team is now working on Nemo-RL integration so the community can try this method in their own settings. Plus, we are scaling experiments up. 🚀
@CVPR Roses are red, violets are blue,
In suspense we wait, but let not worry
ensue.
For every paper pending, under sky so blue,
A chance to shine, in CVPR's view.
🎉 Celebrating the Grand Opening of the African Women in Tech & AI Program!
What a momentous day it was! On August 22nd, we had the privilege of inaugurating the African Women in Tech & AI Program with an awe-inspiring Opening Day event.
@UM6P_officiel@ocpgroup#AWITAI
The world of #AI is moving fast and transforming our lives in amazing ways. At #IJCAI2023 you get the chance to feel the pulse of the artificial intelligence community. 🙌Full programme 👉 https://t.co/hk6on4qLgT with a selected highlights in the article on #AIHUB@aihuborg 👇
On my way to Macao for this year’s @IJCAIconf. Super excited to attend
the keynotes and presentations I have chosen (it wasn’t at all easy to personalize a schedule, everything is super interesting !) 🥳
@jroundiHamza@MarineAmericas Qu’est-ce qui est illogique ? Qu’il y a eu 4 plaintes dans 3 pays différents, une plainte retirée au Maroc et des preuves solides dans celle actuelle, et c’est toujours illogique ?
Glad to have attended the #ConfianceAIdays organized by the @ConfianceAI collective at @centralesupelec. Advanced technologies and industrial systems are being conceived with trustworthy #AI in the objective. Interesting talks and high-quality posters on the subject!