Model components / Dataset Processing Tools

decon

Decontamination tool that flags and removes training documents overlapping evaluation benchmarks. The decontamination stage of the Dolma 3 pipeline.

Ai2 decon; repo active (pushed 2026-03), Apache-2.0 confirmed live 2026-07-21. Train/eval decontamination stage of the Dolma 3 pipeline behind OLMo 3.

Openness

5 high confidence

5.0

license: Apache-2.0(OSI)
source: public(allenai/decon)
governance: Allen Institute for AI
core-gated: ungated

Fully OSI-licensed (Apache-2.0), full source public.

https://github.com/allenai/decon/blob/main/LICENSE recorded 2026-07-21
Apache License Version 2.0 text

Adoption

1 medium confidence

1.0

New (2026) single-purpose Rust CLI, ~35 GitHub stars; niche, used in the Dolma 3 pipeline.

https://github.com/allenai/decon recorded 2026-07-21
35 stars

Capability

3 medium confidence

3.0

One capability slot (decontamination) of the Dolma 3 toolchain.

https://github.com/allenai/decon recorded 2026-07-21
decon repo feature set confirmed

Unchanged since 2026-07-30 (last edited, not re-checked)