OpenEuroLLM

A series of foundation models for transparent AI in Europe

[OpenEuroLLM @OpenEuroLLM]

"Sovereign AI: Must We Own the Model to Own Our AI Future?"

Tomorrow, 28th Oct. at #EMNLP26, represented by Andrey Kutuzov, we will be sharing the OpenEuroLLM perspective on sovereign AI at this very interesting panel within the @WiNLPWorkshop.

Join the discussion at 11:00!

[OpenEuroLLM @OpenEuroLLM]

Today at @emnlpmeeting, @maxidahl & @TiedemannJoerg & Andrey Kutuzov presented MultiSynt, a multilingual synthetic dataset to support low-resource EU languages on behalf of OpenEuroLLM and EuroLLM supported by the AI Factories initiative. 🫶🇪🇺

Just in case you missed our poster:

[OpenEuroLLM @OpenEuroLLM]

Hello Budapest! We are at #EMNLP2026!

If you're around, we'd be more than happy to chat about the interesting nuances of building open, multilingual foundation models.

Say 👋 to the #OpenEuroLLM team!🇪🇺

📸 Anna, Amaru, Zihao, Jörg, Tomazs, Andrey, Jan, Max, Otto and Niclas

[OpenEuroLLM @OpenEuroLLM]

A series of technical reports from our project, like the one just posted by our colleague @kleiaaro, will try to provide answers to the many questions that LLM training teams cope with around the globe.

This one is about training recipes 👇

[Aaron Klein @kleiaaro]

🚀 How do you choose the right LLM training recipe? We just released a tech report on the scaling-law pipeline of @OpenEuroLLM 🇪🇺, along with the corresponding checkpoints, data, and code.
https://t.co/mFEqWSvH7Q 1/N 🧵

[OpenEuroLLM @OpenEuroLLM]

Our 9B experimental WIP model now named

🎼 PRELUDE

is still training but we are sharing intermediate checkpoints for transparency:

🛑 WIP research artifact.
🛑 NOT cooled down yet.
✔️Include validation across 36 languages.

Full WIP model card👇https://t.co/nhcL2kJmOa

[OpenEuroLLM @OpenEuroLLM]

Open models matter, we can't agree more!

Open weights is surely a necessary step.

The OpenEuroLLM project extends this view also to the data, training and evaluation aspects of current AI development.

#transparentAI #openScience

@HajicJan

[Jensen Huang @JensenHuang]

For my first post, I’m sharing a letter @NVIDIA signed on why open models matter.

AI will transform every industry, power every company, and be built by every country.

Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty.

The world needs both frontier closed models and frontier open models.

https://t.co/AUKzoQ5Ikb

[OpenEuroLLM @OpenEuroLLM]

We are at 1/3 of training our 9B model! 🏃🏃🏃

✨Follow progress here: https://t.co/giG0CyYU2i

🪇See our public Weights & Biases training workspace here: https://t.co/lRp0YmpoFN

More soon!

#TransparentAI #OpenScience #goOpenEuroLLM

[OpenEuroLLM @OpenEuroLLM]

As of this morning:

🧠 425.49B tokens seen
📊 4.25% completed

This eager reader wants more input, one token at a time.

Follow along. 🔍

#PreTraining #LLM #MultilingualAI #TransparentAI

#goOpenEuroLLM

[OpenEuroLLM @OpenEuroLLM]

Input, more input 🤖⚡

Just like Jonny 5 in Short Circuit, our baby model is reading every single token from its pretraining dataset.

So far: 10 trillion tokens, 36 languages + code & math as their own "languages" 📚🌍💻

We’re tracking progress & sharing it openly 👇
(1/2)

[OpenEuroLLM @OpenEuroLLM]

Pretraining launched!🚀

Our 9B/10TT baby model is making its first steps in Leonardo (CINECA). 🐣

All people involved are eager to see the results of the effort it took to get here and share them. 👀

And advancing to push hard for the next cycle. 🦾

#goOpenEuroLLM

[OpenEuroLLM @OpenEuroLLM]

Wrapping up our 3rd general meeting, hosted by @AISweden in sunny Stockholm ☀️

A full room makes the final decisions before training the first OpenEuroLLM model. Sharing updates, ideas, and future plans.

Two more days of tight collaboration.
Full speed mode. 🚀
#goOpenEuroLLM

[OpenEuroLLM @OpenEuroLLM]

HPLT is of the datasets we are sharing in our world-readable catalogue across HPCs. Interesting talk!

[HPLT @hplt_eu]

We are at #LREC2026 presenting HPLT v3 Datasets, monolingual, parallel, massive, highly curated. For depth info and analysis, please:

Join us in room Menorca 1 at 16:20!!!

[OpenEuroLLM @OpenEuroLLM]

All ready to share information about #OpenEuroLLM with the #LREC2026 crowd. Let's talk data, infra, evals and open multilingual LLM models together! Come to booth #5 at the poster area 1, Elyxir Building.

#multingualLLMs #openLLMs #diverseLLMs #safeLLMs

[OpenEuroLLM @OpenEuroLLM]

Also, today, know more about bechmark contamination impact goint to the poster of our colleagues from the unversities of Helsinki and Turku and the ELLIS Institute Finland.

[OpenEuroLLM @OpenEuroLLM]

Quite a nice "representation" of the OpenEuroLLM crowd will be at the International Conference on Learning Representations (ICLR) this week.
On Friday 24, come to poster "OpenThoughts: Data Recipes for Reasoning Models", work partially supported by our project, and meet us!👋

[OpenEuroLLM @OpenEuroLLM]

Experimenting with model-based annotation for better data selection? A candidate to consider is propella-1, a multi-property annotator partially funded by #OpenEuroLLM which is fully open-source.

🔓Code, annotations and paper available! https://t.co/oemVhuO8pR

[ellamind @ellamindAI]

We released propella-1, a small model for advanced pre-training data annotation 🙃.

Work led by @maxidahl within the @OpenEuroLLM project. Link to model + annotations for important pre-training datasets below 👇

[OpenEuroLLM @OpenEuroLLM]

🎉 One year of OpenEuroLLM!

🇪🇺We’re building Europe’s next-gen open-source LLMs to boost digital sovereignty.

More about our achievements and next steps for infrastructure, data, models and evaluation at https://t.co/ldZBYE9oDA.

Year 2 = full speed ahead. 🚀

Go #OpenEuroLLM

[OpenEuroLLM @OpenEuroLLM]

First OpenEuroLLM Winter School in collaboration with the @CircleU_eu Alliance 🧑‍🎓and the Nordic Language Processing Laboratory 🧑‍💻

Focus on Multilinguality in LLM Development and Evaluation with speakers from world organisations, academia and industry.

https://t.co/uDQokvCivN

[OpenEuroLLM @OpenEuroLLM]

Strategic access to EuroHPC resources granted to OpenEuroLLM!!!

-first AI project granted strategic access across multiple EuroHPC centres
-for over 10 million GPU hours

Thanks @EUComission and @EuroHPC_JU!

[Jan Hajic @HajicJan]

Proud to present the @OpenEuroLLM project and its results so far, with Sampo Pyysalo (@UniTurku) at the 1st Workshop on Open Source Sovereign LLMs in Berlin https://t.co/gMalOuRGm3 Great opportunity to talk to many OS LLM developers! @CharlesUniPRG @hplt_eu