The Pile (pipeline)

license

MIT(OSI)

source

public(EleutherAI/the-pile)

governance

EleutherAI

core-gated

ungated

Fully OSI-licensed (MIT), full source public.

• https://github.com/EleutherAI/the-pile/blob/master/LICENSE recorded 2026-08-13

  MIT License text

• https://raw.githubusercontent.com/EleutherAI/the-pile/master/README.md recorded 2026-08-13

  README documents the whole pipeline building and installing from the published repo; no paid tier, enterprise edition or license key appears anywhere in it, so nothing is withheld from the source

1,674 GitHub stars on EleutherAI/the-pile, read from the repository API, which bands at 1K-10K stars, level 2 on the stars fallback scale. That scale caps at level 3, because a star is not a use. The repo has been frozen since April 2023, but it is the canonical documented-corpus construction pipeline behind GPT-Neo, GPT-J and Pythia, so the level is directional.

• https://api.github.com/repos/EleutherAI/the-pile recorded 2026-08-13

  stargazers_count = 1674 for EleutherAI/the-pile

Origin-node construction pipeline; not actively developed.

• https://raw.githubusercontent.com/EleutherAI/the-pile/master/README.md recorded 2026-08-13

  README is replication code for the 22-component Pile, with the per-component weight and epoch table; it directs dataset users elsewhere