AI Potluck
Back to Gap Map Model components / Embeddings & retrieval models

Granite Embedding

IBM
open weights / Overall score: 3.3

Granite Embedding is IBM's retrieval model line for enterprise RAG, currently in its R2 generation. The R2 release ships two English bi-encoders on a ModernBERT backbone (47M and 149M parameters, 8192-token context), two multilingual bi-encoders (97M and 311M) and an English cross-encoder reranker. IBM's pitch is provenance as much as accuracy: the models are trained on permissively licensed open datasets plus IBM-collected data, and evaluated on enterprise-shaped retrieval - tables, long documents, conversational multi-turn and code - as well as BEIR and MTEB.

Scored on the R2 generation; the R1 checkpoints it replaces are still distributed but are the superseded release. Verified 2026-09-11 via the R2 model card, the five Hub API records and the ibm-granite repository.

Openness

3 high confidence
3.0
weights
open(four ungated Apache-2.0 R2 embedding checkpoints, 47M to 311M)
data
closed(permissively licensed public datasets plus select proprietary IBM data, neither enumerated nor shipped)
code
partial(usage and documentation in ibm-granite/granite-embedding-models
license
Apache-2.0(OSI)

Apache-2.0 on every R2 checkpoint, ungated. IBM leans hard on data provenance in its own prose - permissively licensed public sources, enterprise-friendly - but the claim stops short of the ladder's test: the mixture is characterized rather than enumerated, it includes proprietary IBM data, and no dataset or script ships. The product repository is documentation and usage, so code is partial and the family lands at the open-weights rung.

Adoption

4 high confidence
4.0

6,764,831 downloads in the trailing 30 days across the granite-embedding R2 embedding checkpoints. granite-embedding-reranker-english-r2 is excluded - every other vendor in this category has its reranker scored as a separate product, and counting it here would apply a different rule to IBM. It adds about 24K and moves no band. The superseded R1 line is also excluded.

Capability

3 high confidence
3.0

Rung 3, the solid workhorse. The numbers are credible and published per checkpoint, and R2 genuinely leads its size class on the enterprise-shaped tasks IBM built the line for - table retrieval, long documents, conversational multi-turn. But the scope is narrower than the frontier by design: the strongest checkpoint is 149M and English-only at 62.8 MTEB-v2, against the anchor's 74.3 multilingual, and the multilingual R2 models are smaller still. Placed against the rung definition rather than a peer: no single measurement reports this product and a category peer together - MTEB v2 English over 41 tasks against the anchor's MMTEB v2 multilingual mean - and rule (d) forbids an edge without one.

Verified 2026-09-11