Edouard Grave

large language models @kyutai_labs

[Omar Sanseviero @osanseviero]

Gemma 4 is here!

🧠 31B and 26B A4B for models with impressive intelligence per parameter
🤏E2B and E4B for mobile and IoT
🤗Apache 2.0
🤖Base and IT checkpoints available

Available in AI Studio, Hugging Face, Ollama, Android, and your favorite OS tools 🚀Download it today!

[Edouard Grave @EXGRV]

@giffmana This reminds me of the XLNet paper: https://t.co/uIFx0trt7D

[kyutai @kyutai_labs]

Unmute meets Moshi 🫂💖

Talk to https://t.co/CpQTspHXbi!

[Edouard Grave @EXGRV]

Today, we release our 🇫🇷 to 🇬🇧 simultaneous speech-to-speech translation system, called Hibiki. It runs on-device & the model, inference code and tech report are available. This is built using the same audio LLM as Moshi, showing its versatility. 🟢

[kyutai @kyutai_labs]

Meet Hibiki, our simultaneous speech-to-speech translation model, currently supporting 🇫🇷➡️🇬🇧.
Hibiki produces spoken and text translations of the input speech in real-time, while preserving the speaker’s voice and optimally adapting its pace based on the semantic content of the source speech.
Based on objective and human evaluations, Hibiki outperforms previous systems for quality, naturalness and speaker similarity and approaches human interpreters. 🧵

[Edouard Grave @EXGRV]

Excited to release a preview of Helium-1, our 2B LLM targeting edge and mobile devices. 🚀

More to come in the future: training code, support for more languages, data pipeline, tech report & more… 🟢

[kyutai @kyutai_labs]

Meet Helium-1 preview, our 2B multi-lingual LLM, targeting edge and mobile devices, released under a CC-BY license. Start building with it today!
https://t.co/X4Dbx2T1cJ

[kyutai @kyutai_labs]

Meet Helium-1 preview, our 2B multi-lingual LLM, targeting edge and mobile devices, released under a CC-BY license. Start building with it today!
https://t.co/X4Dbx2T1cJ

[Edouard Grave @EXGRV]

Local voice models FTW 🚀

[kyutai @kyutai_labs]

Talking to Moshi locally on a Macbook M series (python 3.12) in 2 lines:
pip install moshi_mlx
python -m moshi_mlx.local_web -q 4

[Edouard Grave @EXGRV]

Moshi goes to #ICML2024 in Vienna! Try the demo at https://t.co/weFG6cmhDT

[Edouard Grave @EXGRV]

I am at ICML in Vienna! Let me know if you want to chat about (or to) Moshi, multimodal LLMs, Kyutai & more.

[Edouard Grave @EXGRV]

@soumithchintala @kyutai_labs Thank you Soumith!

[Edouard Grave @EXGRV]

@Thom_Wolf @kyutai_labs Thanks Thomas!

[Edouard Grave @EXGRV]

@giffmana Thanks Lucas!

[Alexandre Défossez @honualx]

Looking forward to discuss open research at @kyutai_labs. If you want to work on large scale multimodal LLMs, come and talk to us, this is what we look like 👇☕️

[Edouard Grave @EXGRV]

✈️ I will be attending #NeurIPS2023: let me know if you want to chat about the future of LLMs, and how to democratize them.

🌐 We are also hiring members of technical staff and interns @kyutai_labs. Happy to talk about the lab and our mission.

[Edouard Grave @EXGRV]

@ylecun Merci Yann !

[Edouard Grave @EXGRV]

/kyutai has landed! Super excited to build this new research lab. Pure focus on research. As open as it gets.

[kyutai @kyutai_labs]

Announcing Kyutai: a non-profit AI lab dedicated to open science. Thanks to Xavier Niel (@GroupeIliad), Rodolphe Saadé (@cmacgm) and Eric Schmidt (@SchmidtFutures ), we are starting with almost 300M€ of philanthropic support. Meet the team ⬇️

[Edouard Grave @EXGRV]

@soumithchintala Thanks for the kind words Soumith! Really excited by this new lab.

[Edouard Grave @EXGRV]

@abacaj Yes, we have a couple of papers on that exact topic with @gizacard and @PSH_Lewis. Combining these advances lead to the Atlas language model (paper: https://t.co/SJd9yOG23g, code: https://t.co/9iK030WDLV).

[Edouard Grave @EXGRV]

@francoisfleuret @elonmusk The posters definitely deserve more than 6 likes (or 28 now)!

[Edouard Grave @EXGRV]

@yoavgo The idea is cute, but I would not take the experimental results too seriously as the baseline numbers seem to be off.