EuroLLM

weights

open(Apache-2.0, BF16 safetensors, ungated)

data

documented-not-released(EuroWeb-2512 web subset released, remaining parallel/curated/synthetic and long-context components documented in the report but withheld)

code

closed(only deep-spin/eurollm-eval evaluation harness is EuroLLM-specific, deep-spin/Megatron-LM-pretrain a generic year-stale Megatron-LM fork with no EuroLLM configs)

checkpoints

open(intermediate Megatron-Core checkpoints per pretraining phase, eurollm-22b/9b/1.7b-mcore-phase1/2/3)

license

Apache-2.0(OSI)

Open weights under an OSI license, but not a full open-source release, so the ladder lands at 3 rather than 5. The weights ship as ungated Apache-2.0 BF16 safetensors and the family publishes intermediate Megatron-Core checkpoints for every pretraining phase (eurollm-22b/9b/1.7b-mcore-phase1/2/3), which is the checkpoints:open leg both OLMo and Apertus record. But the two legs that would lift the score above the category's open-weights centre both fall short. Data: only the EuroWeb-2512 multilingual web subset is released; the technical report itemizes parallel, code, math, 1.7M synthetic-math, Wikipedia, ArXiv, Books, Apollo and Cosmopedia sources plus ~60B long-context tokens that are described but not shipped, so the corpus as a whole is documented-not-released rather than open (the peers at the 4/5 rungs released the whole corpus or full reconstruction scripts). Code: the only EuroLLM-specific code published is the deep-spin/eurollm-eval evaluation harness, and the rubric classes an evaluation harness alone as closed; the report also cites deep-spin/Megatron-LM-pretrain as the pre-training codebase, but that repository is a generic fork of NVIDIA/Megatron-LM whose last commit predates the 2512 release by about a year and carries no EuroLLM training configs, so it contributes nothing to this dimension and no pretraining recipe actually ships. Weights open, data documented, code closed and an OSI license fall through the recipe to 3, open_weights. Apache-2.0 covers the weights only: the released datasets carry no license tag, eurollm-eval has no LICENSE file, and the Megatron fork is NVIDIA-licensed.

• https://huggingface.co/api/models/utter-project/EuroLLM-22B-2512 recorded 2026-09-04

  `private: false`, `gated: false`, `license: apache-2.0`, `safetensors.total` 22,637,328,384 BF16 parameters, LlamaForCausalLM. Establishes that the weights are downloadable, ungated and OSI-licensed.

• https://huggingface.co/utter-project/EuroLLM-22B-2512 recorded 2026-09-04

  Model card "Model Card for EuroLLM-22B": "License: Apache License 2.0"; 22B parameter multilingual transformer trained from scratch on ~4T tokens; describes the three pretraining phases (initial 3.6T, annealing 400B, annealing-to-zero 100B) and the data sources (web, parallel, Wikipedia, Arxiv, books, math, code, Apollo) without releasing the non-web components.

• https://arxiv.org/pdf/2602.05879 recorded 2026-09-04

  Technical report lists the pretraining corpus components (web, parallel, code, math, synthetic math, Wikipedia, ArXiv, Books, Apollo, Cosmopedia, ~60B long-context) and cites github.com/deep-spin/Megatron-LM-pretrain (pre-training) and github.com/deep-spin/eurollm-eval (evaluation) as codebases. Only the web subset (EuroWeb-2512) and the eval harness are actually released; the pretraining repo is a generic Megatron-LM fork (independently verified: last commit 2025-01-06, no EuroLLM configs).

• https://huggingface.co/api/datasets/utter-project/EuroWeb-2512 recorded 2026-09-04

  `private: false`, `gated: false`, size category 1B<n<10B, no license tag; the released multilingual web pretraining subset for the 2512 release. Establishes that a documented subset of the corpus is released while the remainder is not.

• https://huggingface.co/api/models/utter-project/eurollm-22b-mcore-phase1 recorded 2026-09-04

  `private: false`, `gated: false`; a public Megatron-Core intermediate checkpoint for the 22B model's first pretraining phase, one of the eurollm-22b/9b/1.7b-mcore-phase1/2/3 series. Establishes checkpoints:open.