University of Oregon NLP (UONLP)

license

follows mC4 + OSCAR-2301 terms

gated

auto(contact-info agreement)

card

present

Dataset card is rich but downloads require agreeing to share contact information (auto gate).

• https://huggingface.co/datasets/uonlp/CulturaX recorded 2026-09-29

  Dataset page for uonlp/CulturaX states "The licence terms for CulturaX strictly follows those of" mC4 and OSCAR, and the gate reads "You need to agree to share your contact information to access this dataset".

Adoption is measured by Hugging Face downloads of the dataset over the trailing month, the only usage channel on record for CulturaX.

• https://huggingface.co/api/datasets/uonlp/CulturaX recorded 2026-08-13

  13,746 downloads in the trailing 30 days for uonlp/CulturaX

CulturaX merges and cleans mC4 and OSCAR into one multilingual corpus, but the FineWeb-2 dataset card reports that FineWeb-2 outperforms it, along with CC-100, mC4 and HPLT, on FineTasks ablations across nine languages.

• https://arxiv.org/abs/2309.09400 recorded 2026-09-29

  CulturaX paper abstract page describes a dataset of "6.3 trillion tokens in 167 languages, tailored for LLM development".

• https://huggingface.co/datasets/HuggingFaceFW/fineweb-2 recorded 2026-08-13

  FineWeb-2 outperforms CulturaX across diverse languages on FineTasks

• https://huggingface.co/datasets/HuggingFaceFW/fineweb-2/raw/main/README.md recorded 2026-09-29

  FineWeb2 card says it "outperforms other popular pretraining datasets covering multiple languages (such as CC-100, mC4, CulturaX or HPLT" in its ablations.

• https://huggingface.co/datasets/uonlp/CulturaX recorded 2026-08-13

  CulturaX is a 6.3T-token, 167-language corpus built from mC4+OSCAR