GAIA (General AI Assistants)

license

not-clearly-stated-on-card(the Hub API cardData carries no license key and no license tag

questions

public(val)

answers

held-out(300-Q test,private)

access

HF-gated(accept-terms,anti-resharing)

No license is stated on GAIA's dataset card, its API metadata, or the paper, and the corpus requires Hugging Face access-gating with a no-resharing condition. Answers to 300 of the questions are held out entirely, which keeps the score gated regardless of the missing license.

• https://huggingface.co/api/datasets/gaia-benchmark/GAIA recorded 2026-09-29

  The dataset API reports gating as auto and carries the prompt "To avoid contamination and data leakage, you agree to not reshare this dataset outside of a gated or private repository on the HF hub."; searched cardData and the tags array for a license key or license tag: none.

• https://huggingface.co/datasets/gaia-benchmark/GAIA recorded 2026-09-29

  The page shows the access gate "You need to agree to share your contact information to access this dataset", and the card reads "Each level is divided into a fully public dev set for validation, and a test set with private answers and metadata".

Adoption is measured by Hugging Face downloads of gaia-benchmark/GAIA. GAIA remains widely cited across agent-evaluation harnesses, though its download volume has fallen sharply from its peak.

• https://huggingface.co/api/datasets/gaia-benchmark/GAIA recorded 2026-08-12

  17,975 downloads in the trailing 30 days for gaia-benchmark/GAIA

A dataset is not 'capable' the way software or a model is, so capability is left unscored. GAIA is an end-to-end agentic-assistant benchmark: 466 real-world questions across three difficulty levels that require multi-step tool use, live browsing and multimodal files, each graded against one checkable answer.

• https://arxiv.org/abs/2311.12983 recorded 2026-09-29

  The abstract page is titled "GAIA: a benchmark for General AI Assistants" and reads "we devise 466 questions and their answer. We release our questions while retaining answers to 300 of them to power a leader-board"; searched the body for a leaderboard score table or usage figures: none.