LiveBench
companyOpenness profile
1 product on the map — 1 open.
Openness
5 high confidence- questions
- public
- answers
- public(ground_truth released)
- license
- Apache-2.0/MIT(repo LICENSE is Apache-2.0, carried over from FastChat
- datasheet
- present(docs/DATASHEET.md, a full datasheets-for-datasets questionnaire covering motivation, composition, collection and distribution)
- access
- ungated(HF datasets download without a gate)
All questions, answers, and code are released openly; rotation is for freshness, not access control. The documentation is a full datasheets-for-datasets questionnaire in the repository rather than a Hugging Face card, and it states the distribution license outright.
- https://huggingface.co/datasets/livebench/reasoning recorded 2026-06-17
public ground_truth column, release/removal dates
- https://huggingface.co/datasets/livebench/reasoning/raw/main/README.md recorded 2026-08-12
card describing the benchmark and linking the paper, leaderboard and datasheet; the declared features include a `ground_truth` string column alongside `turns`, so the answers ship with the questions; no gate and no license field in the card metadata
- https://raw.githubusercontent.com/LiveBench/LiveBench/main/docs/DATASHEET.md recorded 2026-08-12
the datasheets-for-datasets questionnaire, covering motivation, composition, collection, preprocessing, uses, distribution and maintenance; under "When will the dataset be released/first distributed? What license (if any) is it distributed under?": "The benchmark suite is public as of June 12, 2024, distributed under the Apache License 2.0."
- https://raw.githubusercontent.com/LiveBench/LiveBench/main/LICENSE recorded 2026-08-12
Apache License 2.0, prefaced "The original LICENSE from https://github.com/lm-sys/FastChat is copied below"