RTP-LLM
Alibaba CloudRTP-LLM is an LLM inference acceleration engine developed by Alibaba's Foundation Model Inference Team, built on work from the FasterTransformer project.
A NOTICE file records that the engine is based on the FasterTransformer project. Verified 2026-08-31 via GitHub, the LICENSE body and the repository README.
Openness
5 medium confidence- license
- Apache-2.0(OSI)
- source
- public(the published repository is the engine)
- core-gated
- ungated(no enterprise path in the repository root and no paid build of the engine in the README)
The LICENSE body is the Apache-2.0 text, read in full rather than taken from the API's label, and carries no appended condition. The repository is public and unarchived and builds the engine itself. Its root tree carries no enterprise, ee or commercial directory and its README describes no licence-gated build, so the core reads as ungated. Confidence is medium because that is a repository-and-README read rather than a pricing-page read.
- https://raw.githubusercontent.com/alibaba/rtp-llm/main/LICENSE recorded 2026-08-31
LICENSE body, read in full: the stock Apache-2.0 text with the copyright placeholder unfilled and no appended condition.
- https://api.github.com/repos/alibaba/rtp-llm recorded 2026-08-31
Repo metadata for alibaba/rtp-llm - archived false, 1,321 stars.
- https://raw.githubusercontent.com/alibaba/rtp-llm/main/README.md recorded 2026-08-31
README, read for a paid tier, an enterprise edition or a licence-gated build beside the published source, and for whether any component is stated to be private.
Adoption
2 low confidence1,321 GitHub stars, which lands in the 1K-10K stars band of the stars scale, where the scale caps at 3. No package artifact is declared for this record, so stars are the only instrument available and the band should be read as a floor.
- https://api.github.com/repos/alibaba/rtp-llm recorded 2026-08-31
Repo metadata - stargazers_count = 1,321 - for alibaba/rtp-llm.
Capability
4 medium confidenceOne band below the vllm anchor. It accelerates inference as the anchor does, but over a narrower published surface: no multi-node serving record and no OpenAI-compatible API server is documented.
- https://raw.githubusercontent.com/alibaba/rtp-llm/main/README.md recorded 2026-08-31
README, read for the engine's feature set: LLM inference acceleration, derived from FasterTransformer and maintained for Alibaba's own serving.
Verified 2026-08-31