Back to Gap Map Model components / Language-specific datasets

Multilingual Indic RAG Suite

AI4Bharat
open / Overall score: 1.7

The Multilingual Indic RAG Suite is a synthetic question-answering dataset of about 21.4 million examples in 17 Indian languages and English, built for retrieval-augmented generation. Llama 3.3 70B wrote each question, answer and reasoning trace from a Wikipedia paragraph, which is kept in the row with its title and URL. AI4Bharat publishes it on Hugging Face as one configuration per language.

Openness

5 medium confidence
5.0
license
mit (card metadata and API tag; the rows carry Wikipedia paragraphs, which Wikipedia publishes under CC BY-SA, and answers written by Llama 3.3 70B)
access
public (ungated on the Hub)
dataset_card
present (card lists the languages, fields, sample count and the generator model; no paper)

The suite downloads without a gate under MIT, and its card says what each row holds and which model wrote it. The MIT label sits over Wikipedia text, whose own license asks for attribution and share-alike, so a reuser should treat the paragraphs as Wikipedia content rather than as MIT-licensed.

Adoption

1 high confidence
1.0

Hugging Face downloads of the one repository over the trailing month. Users who load a single language configuration are counted the same as those who load all of them.

Capability

2 medium confidence
2.0

The suite is large and covers low-resource languages such as Santali, Manipuri and Kashmiri, but every question and answer is model-written and nothing beyond its card describes how they were made or checked. Updesh is judged the same way, for the same reason.

Verified 2026-11-17, except some scores, still awaiting re-confirmation