Back to Gap Map Model components / Language-specific evaluation sets

ThaiExam

SCB 10X
open / Overall score: 2.7

ThaiExam is a Thai knowledge benchmark of multiple-choice questions taken from real examinations in Thailand: the grade-12 O-NET, the Investment Consultant licensing exam, TGAT, TPAT-1 and A-Level. It holds 590 questions in total, and each exam includes five worked examples for few-shot prompting. The Typhoon team built it to evaluate the Typhoon Thai language models.

Openness

5 high confidence
5.0
license
apache-2.0 (card metadata)
access
public (ungated, answers included)
dataset_card
present (per-exam description, versions and HELM note)

The questions and answers download without a gate under Apache-2.0, and the card describes each exam and the dataset's revisions. Nothing is held back for private scoring.

Adoption

2 high confidence
2.0

Adoption is Hugging Face downloads of the repository. Leaderboards that bundle the test, such as HELM and SEA-HELM, may run it from their own copies, which this count does not see.

Capability

3 medium confidence
3.0

In its one target language, ThaiExam's deepest test has four hundred to sixteen hundred items that count toward depth. An item count says how much a set can test, not how precisely it ranks models.

Verified 2026-09-24