Back to Gap Map Model components / Inference code

LiteRT-LM

Google
open source / Overall score: 2.5

LiteRT-LM is Google's orchestration layer for running language models with LiteRT on edge devices, engineered for cross-platform on-device execution rather than datacenter serving. It is distributed as a command-line tool and as prebuilt C API shared libraries.

Openness

5 medium confidence
5.0
license
Apache-2.0(OSI)
source
public(the published repository is the engine)
core features withheld
no — no enterprise path in the repository root and no paid build of the engine in the README

LiteRT-LM's LICENSE is the stock Apache-2.0 text with no added restriction, and the public repository is the engine itself rather than a wrapper around closed code. Its root carries no enterprise or commercial directory, and the README describes no license-gated build, so nothing in the published source is held back.

Adoption

2 medium confidence
2.0

PyPI downloads of the litert-lm package are the adoption signal for this runtime. The package resolves to this repository, so the figure is the product's own rather than borrowed from a dependency.

Capability

3 medium confidence
3.0

LiteRT-LM sits two tiers below vLLM. It runs models on edge hardware rather than serving them from a datacenter, so it carries none of the batching, parallelism or multi-tenant serving that the higher-rated engines are built around.

Verified 2026-09-24