Sierra

license

MIT(repository LICENSE body read on both repos

access

open(tasks and domain data ship in the repository, plain git clone, no gate)

answers

released(task definitions include the evaluation criteria

datasheet

yes(documents itself in the repository — domains README (structure, data format, available domains) plus arXiv:2506.07982

MIT over the whole repository, ungated, with repository documentation standing in for a Hub card as the category already accepts for mt-bench and livebench. Ladder walk: license_tier open_data (MIT) + documentation present → 5/open. Confidence medium because the answer-state reading (no held-out split) rests on the README and harness design rather than an explicit statement.

• https://raw.githubusercontent.com/sierra-research/tau2-bench/main/LICENSE recorded 2026-09-01

  MIT License body, "Copyright (c) 2025 Sierra Research", standard text with no data carve-out

• https://raw.githubusercontent.com/sierra-research/tau-bench/main/LICENSE recorded 2026-09-01

  MIT License body, "Copyright (c) 2024 Sierra", for the τ¹ repo

• https://raw.githubusercontent.com/sierra-research/tau2-bench/main/README.md recorded 2026-09-01

  title "τ-Bench:A Benchmark for Tool-Agent-User Interaction in Real-World Domains"; τ³-bench v1.0.0/v1.0.1 announcement; arXiv:2506.07982 badge; taubench.com leaderboard; git-clone install with data in-repo; domains README link documenting domain structure and data format; backward-compatibility note naming the base split as the original τ-bench task set