datamap-rs

license

Apache-2.0(OSI)

source

public(allenai/datamap-rs)

governance

Allen Institute for AI

core-gated

ungated

Fully OSI-licensed (Apache-2.0), full source public.

• https://github.com/allenai/datamap-rs/blob/main/LICENSE recorded 2026-08-13

  Apache License Version 2.0 text

• https://raw.githubusercontent.com/allenai/datamap-rs/main/README.md recorded 2026-08-13

  README documents the whole pipeline building and installing from the published repo; no paid tier, enterprise edition or license key appears anywhere in it, so nothing is withheld from the source

56 GitHub stars on allenai/datamap-rs, read from the repository API, which bands at <1K stars, level 1 on the stars fallback scale. That scale caps at level 3, because a star is not a use. A recent single-purpose Rust CLI used in the Dolma 3 pipeline: real, but niche.

• https://api.github.com/repos/allenai/datamap-rs recorded 2026-08-13

  stargazers_count = 56 for allenai/datamap-rs

Covers one stage of the Dolma 3 toolchain, cleaning, rather than a full pipeline.

• https://raw.githubusercontent.com/allenai/datamap-rs/main/README.md recorded 2026-08-13

  README documents a Rust JSONL map/filter/annotate pipeline with configurable per-document processors, still one cleaning stage rather than a full pipeline