Back to Gap Map Model components / Dataset Processing Tools

NeMo Curator

NVIDIA
open source / Overall score: 2.6

GPU-accelerated toolkit for curating LLM training data across text, image, video, and audio: extraction, language ID, exact/fuzzy/substring deduplication, quality classification, and synthetic data generation. NVIDIA uses it for the Nemotron-4 pretraining data (8+ trillion tokens of multilingual web data) and the Nemotron-CC curation pipeline.

Openness

5 high confidence
5.0
license
Apache-2.0(OSI)
source
public(NVIDIA/NeMo-Curator)
core features withheld
no

Fully OSI-licensed (Apache-2.0), full source public. Vendor-backed but not gated.

Adoption

1 high confidence
1.0

PyPI downloads for the declared nemo-curator package are the usage signal recorded for this tool.

Capability

5 high confidence
5.0

NeMo Curator is judged through Nemotron-CC, the corpus built with it, since the toolkit has no benchmark of its own. The Nemotron-CC paper reports its high-quality subset improving MMLU over DCLM, which puts the toolkit level with DCLM.

  • https://arxiv.org/abs/2412.02595 recorded 2026-09-29

    Nemotron-CC abstract: "a high-quality subset of our data improves MMLU by 5.6 over DCLM" and its full dataset has "four times more unique real tokens than DCLM".

Verified 2026-09-24