Back to Gap Map Model components / Fine-tuned / chat models

Tulu 3

Allen Institute for AI
open weights / Overall score: 2.4

Ai2's open post-training model family at 8B, 70B and 405B, applying a fully reproducible recipe on top of Meta's Llama 3.1 base: open supervised and preference data, the open-instruct training code, and reinforcement learning with verifiable rewards. The evaluation framework is released alongside it.

Openness

3 high confidence
3.0
weights
open(downloadable)
license
Llama-3.1-Community(non-OSI
post-training-data
open(Apache-2.0/ODC-BY)
code
open(open-instruct Apache-2.0)
recipe
open(SFT->DPO->RLVR)
evals
open(OLMES)

The released weights inherit Meta's Llama 3.1 Community License, non-OSI and capped at 700 million monthly active users for commercial use, governing the checkpoint regardless of what Ai2 adds. The post-training layer above it is fully open under Apache-2.0: the data, the open-instruct code, the SFT-DPO-RLVR recipe and the OLMES eval framework, which keeps this at open weights rather than open source.

Adoption

1 high confidence
1.0

Adoption sums Hugging Face downloads across Tulu's three declared model checkpoints, 8B, 70B and 405B, most of the volume on the 8B. The tulu-3-sft-mixture dataset the product also declares is scored separately as its own entry among the training and synthetic datasets, rather than added to the model count.

Capability

3 high confidence
3.0

Tulu 3 is a 2025 post-training recipe on a Llama 3.1 base. Its 405B results table gives MMLU 87.0, GSM8K 95.5, IFEval 86.0, HumanEval 95.9 and MATH 67.3, against a GPT-4o (11-24) column at 87.9, 91.7, 84.8, 97.0 and 68.8, and it sits below the current frontier.

Verified 2026-09-29, except some scores, still awaiting re-confirmation