MILU
AI4BharatMILU (Multi-task Indic Language Understanding Benchmark) is an evaluation set of about 80,000 multiple-choice questions in 10 Indic languages and English, spanning 8 domains and 41 subjects. Its questions come largely from regional and state examinations, about a quarter of them translated, and cover India-specific topics such as local history, arts and law. AI4Bharat publishes it with an lm-evaluation-harness setup for running it.
Openness
3 high confidence- license
- cc-by-4.0(card metadata and README "License" section
- access
- auto(Hugging Face gated: auto)
- dataset_card
- present(card gives per-language statistics, subjects and splits)
The benchmark carries CC BY 4.0, and the Hugging Face copy needs an access request that is approved automatically. The MIT license file in the GitHub repository belongs to the EleutherAI harness code, not the questions.
- https://huggingface.co/api/datasets/ai4bharat/MILU recorded 2026-09-24
"gated": "auto"; cardData license "cc-by-4.0".
- https://huggingface.co/datasets/ai4bharat/MILU recorded 2026-09-24
Per-language table: 79,617 questions, 19,915 translated; 8,933-sample validation set for few-shot use.
- https://raw.githubusercontent.com/AI4Bharat/MILU/master/LICENSE.md recorded 2026-09-24
"MIT License / Copyright (c) 2020 EleutherAI".
- https://raw.githubusercontent.com/AI4Bharat/MILU/master/README.md recorded 2026-09-24
README: "This dataset is released under the CC BY 4.0." Code evaluates models "using the lm-eval-harness framework".
Adoption
2 high confidenceHugging Face downloads of the MILU repository. Evaluation runs through the harness also fetch from here, but a download does not show which published results used it.
- https://huggingface.co/api/datasets/ai4bharat/MILU recorded 2026-09-24
1343 downloads in the trailing 30 days for ai4bharat/MILU
Capability
3 medium confidenceMILU is a documented knowledge benchmark built from Indian exam questions in 11 languages, and its paper evaluates more than 40 models on it. No leaderboard or model report outside that paper was found, whereas IndicXTREME was released with the IndicBERT v2 models it tests.
- https://arxiv.org/abs/2411.02538 recorded 2026-09-24
Abstract: "MILU spans 8 domains and 41 subjects across 11 Indic languages ... We evaluate over 42 LLMs".
Verified 2026-09-24