Back to Gap Map Model components / Dataset Processing Tools

decon

Allen Institute for AI
open source / Overall score: 1.8

Decontamination tool that flags and removes training documents overlapping evaluation benchmarks. The decontamination stage of the Dolma 3 pipeline.

Openness

5 high confidence
5.0
license
Apache-2.0(OSI)
source
public(allenai/decon)
core features withheld
no

Fully OSI-licensed (Apache-2.0), full source public.

Adoption

1 medium confidence
1.0

GitHub stars are the only usage signal published for this repository, and a star is not a use. It is a single-purpose Rust tool that covers one stage, decontamination, of the Dolma 3 pipeline behind OLMo 3, so its natural audience is small.

Capability

3 medium confidence
3.0

Covers a single task, decontamination, rather than a full pipeline.

Verified 2026-09-27