Back to Gap Map Model components / Training & synthetic datasets

The Stack v2

BigCode Project
gated / Overall score: 3.0

Source-code dataset of 3.28 billion unique files, 67.53TB uncompressed, drawn from 104.2 million GitHub repositories across 658 programming languages and sourced through Software Heritage. It was created by the BigCode project and used to train the StarCoder2 models.

Openness

3 high confidence
3.0
license
permissive(SPDX)
gated
terms-acceptance+contact-info
dataset_card
yes

Requires acceptance of terms and sharing contact info before download, so access is gated.

Adoption

2 high confidence
2.0

Adoption is measured by Hugging Face downloads of the dataset over the trailing month, the only usage channel on record for The Stack v2.

Capability

4 high confidence
4.0

The Stack v2 trained StarCoder2, is the code base behind SmolLM3, and is the source dataset for Stack-Edu. It spans 619 programming languages and is four times the size of the original StarCoder dataset, but as raw code it loses to its own education-filtered slice, Stack-Edu, in ablations.

  • https://arxiv.org/abs/2402.19173 recorded 2026-09-29

    The StarCoder2 paper abstract says the dataset "results in a training set that is 4x larger than the first StarCoder dataset" and that the repositories span "619 programming languages".

  • https://huggingface.co/blog/smollm3 recorded 2026-09-29

    The SmolLM3 blog lists a stage 1 mix with "Code: 12% - The Stack v2 (16 programming languages)" among its sources.

Verified 2026-09-29, except some scores, still awaiting re-confirmation