Back to Gap Map Model components / Inference code

RTP-LLM

Alibaba Cloud
open source / Overall score: 3.0

RTP-LLM is an LLM inference acceleration engine developed by Alibaba's Foundation Model Inference Team, built on work from the FasterTransformer project.

A NOTICE file records that the engine is based on the FasterTransformer project.

Openness

5 medium confidence
5.0
license
Apache-2.0(OSI)
source
public(the published repository is the engine)
core features withheld
no — no enterprise path in the repository root and no paid build of the engine in the README

RTP-LLM's LICENSE is the Apache-2.0 text with no appended condition, and the public repository is the engine itself rather than a wrapper around closed code. Its root carries no enterprise or commercial directory, and the README describes no license-gated build, so nothing in the published source is held back.

Adoption

2 low confidence
2.0

No package artifact is declared for RTP-LLM, so GitHub stars are the only adoption signal available. The count should be read as a floor rather than a full measure of use.

Capability

4 medium confidence
4.0

RTP-LLM sits one tier below vLLM. It accelerates inference the same way vLLM does, but over a narrower published surface: it documents no multi-node serving record and no OpenAI-compatible API server.

Verified 2026-09-27