Back to Gap Map Organization

Aaron Gokaslan (Skylion007)

individual

Scores

1 product on the map — 1 open.

OpenWebText

Openness

5 high confidence
5.0
license
cc0-1.0 (covers the packaging, while the creators claim no rights in the extracted text)
ungated
yes
dataset_card
present

OpenWebText downloads without a sign-in, with a card describing how it was collected, and its creators release it under CC0. The text itself comes from third-party web pages, which the creators do not claim to own and will remove on request.

Adoption

3 high confidence
3.0

Hugging Face downloads of the dataset over the trailing month, the only usage channel on record for OpenWebText.

Capability

3 medium confidence
3.0

OpenWebText helped train RoBERTa and DeBERTa and remains the usual corpus for reproducing GPT-2 at small scale. Like C4, it is a 2019-era English web corpus that has proven its worth but is no longer a first choice for pretraining.