Model components / Training & synthetic datasets

OpenWebMath

OpenWebMath is a 14.7B-token corpus of mathematical web text extracted from Common Crawl with LaTeX preserved, released under ODC-BY by researchers from the University of Toronto and collaborators. It appears in Proof-Pile-2 (Llemma), OLMoE, Nemotron 3, and StarCoder2's math supplements.

Openness

5 high confidence

5.0

license: ODC-BY
gated: false
dataset_card: present

ODC-BY 1.0, ungated, full dataset card.

https://huggingface.co/datasets/open-web-math/open-web-math recorded 2026-07-04
ODC-BY 1.0 license, ungated, dataset card

Adoption

3 high confidence

3.0

31,502 monthly downloads on Hugging Face, graded on the training-corpus bands.

https://huggingface.co/api/datasets/open-web-math/open-web-math recorded 2026-07-04
downloads field = 31,502 (30-day)

Capability

3 high confidence

3.0

Proven math corpus (Llemma/Proof-Pile-2, OLMoE, StarCoder2 math supplement) but Oct-2023 vintage and now the baseline that FineMath, MegaMath, and Nemotron-CC-Math beat in ablations.

https://arxiv.org/html/2508.15096v1 recorded 2026-07-04
Nemotron-CC-Math surpasses all prior open math datasets including OpenWebMath
https://huggingface.co/datasets/HuggingFaceTB/finemath recorded 2026-07-04
FineMath-3+ outperforms OpenWebMath on GSM8k and MATH

Unchanged since 2026-07-04 (last edited, not re-checked)