bigcode-dataset

license

Apache-2.0(OSI)

source

public(bigcode-project/bigcode-dataset)

core features withheld

no

Fully OSI-licensed (Apache-2.0), full source public.

• https://github.com/bigcode-project/bigcode-dataset/blob/main/LICENSE recorded 2026-09-22

  Apache License Version 2.0 text

• https://raw.githubusercontent.com/bigcode-project/bigcode-dataset/main/README.md recorded 2026-09-22

  README documents the whole pipeline building and installing from the published repo; no paid tier, enterprise edition or license key appears anywhere in it, so nothing is withheld from the source

GitHub stars are the only usage signal published for this repository, and a star is not a use. It underpins the filtering and PII pipeline behind The Stack and StarCoder, so its role in those corpora matters more than the star count suggests, even though the repository is no longer actively maintained.

• https://api.github.com/repos/bigcode-project/bigcode-dataset recorded 2026-08-12

  stargazers_count = 497 for bigcode-project/bigcode-dataset

Solid code-corpus curation coverage, specialized to code.

• https://raw.githubusercontent.com/bigcode-project/bigcode-dataset/main/README.md recorded 2026-09-29

  README contents list names "code for running PII detection and anonymization on code datasets", "script to remove files that match test-samples from code generation benchmarks" and a preprocessing filter on "line length and percentage of alphanumeric characters (basic filter)".