AI Potluck
Back to Gap Map Model components / Embeddings & retrieval models

Granite Embedding

IBM
open weights / Overall score: 3.3

Granite Embedding is IBM's retrieval model line for enterprise RAG, currently in its R2 generation. The R2 release ships two English bi-encoders on a ModernBERT backbone (47M and 149M parameters, 8192-token context), two multilingual bi-encoders (97M and 311M) and an English cross-encoder reranker. IBM's pitch is provenance as much as accuracy: the models are trained on permissively licensed open datasets plus IBM-collected data, and evaluated on enterprise-shaped retrieval - tables, long documents, conversational multi-turn and code - as well as BEIR and MTEB.

Openness

3 high confidence
3.0
weights
open(four ungated Apache-2.0 R2 embedding checkpoints, 47M to 311M)
data
closed(permissively licensed public datasets plus select proprietary IBM data, neither enumerated nor shipped)
code
partial(usage and documentation in ibm-granite/granite-embedding-models
license
Apache-2.0(OSI)

Every R2 checkpoint ships under Apache-2.0, ungated. The training mixture -- permissively licensed public sources plus proprietary IBM data -- is described only by category and ships no dataset or script, and the public repository holds documentation and usage examples rather than a training pipeline.

Adoption

4 high confidence
4.0

Adoption is measured as Hugging Face downloads across the granite-embedding R2 checkpoints, led by the small English model. The R2 reranker checkpoint is excluded because every other vendor in this category has its reranker scored as a separate product, and the earlier R1 line is excluded as a prior generation.

Capability

3 high confidence
3.0

Granite Embedding R2 leads its size class on the enterprise-shaped tasks IBM built it for -- table retrieval, long documents and conversational multi-turn -- but its scope stays narrow: the strongest checkpoint is 149M parameters and English-only, scoring 62.8 on a 41-task benchmark, and the multilingual checkpoints are smaller still.

Verified 2026-09-11