Belebele
MetaBelebele is a multiple-choice reading comprehension benchmark in 122 language variants, with 900 questions per variant written about short FLORES-200 passages. Every question has four answers, one correct, and the set is fully parallel so scores compare directly across languages. Annotators wrote the questions in English under quality checks before translation. Meta FAIR released it.
Openness
5 high confidence- license
- cc-by-sa-4.0(Covers the benchmark
- access
- public(Ungated on Hugging Face and as a zip from Meta's file server.)
- dataset_card
- present
The benchmark carries a share-alike license and downloads without a gate. The optional English training set assembled from other datasets is mostly non-commercial, but that part is not the benchmark.
- https://huggingface.co/api/datasets/facebook/belebele recorded 2026-09-24
gated: false; license tag cc-by-sa-4.0.
- https://raw.githubusercontent.com/facebookresearch/belebele/main/README.md recorded 2026-09-24
"The Belebele dataset is licensed under the license found in the LICENSE_CC-BY-SA4.0 file"; "The majority of the training set (data and code) is licensed under CC-BY-NC".
Adoption
3 high confidenceHugging Face downloads over the trailing month for the Belebele repository. Downloads of the zip from Meta's file server are not counted.
- https://huggingface.co/api/datasets/facebook/belebele recorded 2026-09-24
84563 downloads in the trailing 30 days for facebook/belebele
Capability
5 medium confidenceBelebele asks the same 900 questions in 122 language variants, so reading comprehension scores compare directly across languages, and no other open reading test here reaches that many. It is documented in its paper and ships as a task in EleutherAI's evaluation harness.
- https://raw.githubusercontent.com/EleutherAI/lm-evaluation-harness/main/lm_eval/tasks/README.md recorded 2026-09-24
Task table row: "belebele ... Language understanding tasks in a variety of languages and scripts ... Multiple (122 languages)".
- https://raw.githubusercontent.com/facebookresearch/belebele/main/README.md recorded 2026-09-24
"900 questions per language variant"; "122 language/language variants"; "900 x 122 = 109,800 total questions".
Verified 2026-09-24