decon

license

Apache-2.0(OSI)

source

public(allenai/decon)

governance

Allen Institute for AI

core-gated

ungated

Fully OSI-licensed (Apache-2.0), full source public.

• https://github.com/allenai/decon/blob/main/LICENSE recorded 2026-08-13

  Apache License Version 2.0 text

• https://raw.githubusercontent.com/allenai/decon/main/README.md recorded 2026-08-13

  README documents the whole pipeline building and installing from the published repo; no paid tier, enterprise edition or license key appears anywhere in it, so nothing is withheld from the source

36 GitHub stars on allenai/decon, read from the repository API, which bands at <1K stars, level 1 on the stars fallback scale. That scale caps at level 3, because a star is not a use. A recent single-purpose Rust CLI used in the Dolma 3 pipeline, and a niche one.

• https://api.github.com/repos/allenai/decon recorded 2026-08-13

  stargazers_count = 36 for allenai/decon

Covers one stage of the Dolma 3 toolchain, decontamination, rather than a full pipeline.

• https://raw.githubusercontent.com/allenai/decon/main/README.md recorded 2026-08-13

  README documents token-based detection of training documents overlapping eval instances, producing contamination reports and cleaned datasets