BeaverTails
PKU-Alignment (Peking University)BeaverTails is a collection of question-answer pairs labeled for harm, built at Peking University for research on making language models safer. Each pair records whether the answer is safe and which of 14 harm categories it falls under, from privacy violation to self-harm, and one pair can carry several. The Hub release holds a round of about 330,000 pairs and a 30,000-pair round, each split into training and test sets, for training and testing moderation classifiers.
Its card asks that it not be used to train dialogue agents. It is filed with evaluation sets because the release is labeled classification data with held test splits.
Openness
2 high confidence- license
- cc-by-nc-4.0 (card metadata and license section; the companion code is Apache-2.0)
- access
- public (ungated on the Hub)
- dataset_card
- present (card defines the 14 harm categories, the splits and intended use, and links the paper)
The labeled pairs download freely, but the license forbids commercial use. The card documents the harm categories, splits and intended research use.
- https://huggingface.co/api/datasets/PKU-Alignment/BeaverTails recorded 2026-11-12
API JSON: "gated":false; tag license:cc-by-nc-4.0; language:en.
- https://huggingface.co/datasets/PKU-Alignment/BeaverTails/raw/main/README.md recorded 2026-11-12
Card metadata "license: cc-by-nc-4.0"; "BeaverTails dataset and its family are released under the CC BY-NC 4.0 License"; the 14 harm categories; splits 330k_train, 330k_test, 30k_train and 30k_test.
- https://raw.githubusercontent.com/PKU-Alignment/beavertails/main/README.md recorded 2026-11-12
Repository README: "BeaverTails dataset and its family are released under the CC BY-NC 4.0 License. The training code and the QA-moderation APIs is released under Apache License 2.0."
Adoption
3 high confidenceHugging Face downloads of the Hub repository over the trailing month. A download count does not say who downloaded, and evaluation harnesses can fetch a dataset repeatedly, so the figure is a rough measure of use, not a count of users or organizations.
- https://huggingface.co/api/datasets/PKU-Alignment/BeaverTails recorded 2026-11-12
"downloads":17161 for PKU-Alignment/BeaverTails.
Capability
not assessedA benchmark is not scored for capability, so that score is left blank.
- https://arxiv.org/abs/2307.04657 recorded 2026-11-12
Abstract: "we have gathered safety meta-labels for 333,963 question-answer (QA) pairs and 361,903 pairs of expert comparison data"; applications "in content moderation and reinforcement learning with human feedback".
- https://arxiv.org/pdf/2307.04657 recorded 2026-11-12
Title page: authors from the Institute for Artificial Intelligence and the School of Computer Science, Peking University.
Verified 2026-11-12