Back to Gap Map Infrastructure / Compilers & Model Optimization

Torch-TensorRT

PyTorch Foundation (Linux Foundation)
open source / Overall score: 3.0

Torch-TensorRT is PyTorch's official compiler that lowers PyTorch, TorchScript and FX models into NVIDIA TensorRT engines, accelerating inference on NVIDIA GPUs while staying inside the PyTorch runtime.

Openness

5 high confidence
5.0
license
BSD-3-Clause(OSI)
source
public
core features withheld
no

BSD-3-Clause license body confirmed. The repository is public and unarchived and builds the whole product, and the README describes no paid tier, enterprise edition or license-gated build beside it, so source is public and the core ungated.

  • https://api.github.com/repos/pytorch/TensorRT recorded 2026-09-02

    Repo metadata for torch-tensorrt's canonical repository - private false, archived false, fork false.

  • https://github.com/pytorch/TensorRT/blob/main/LICENSE recorded 2026-10-07

    LICENSE body is the verbatim three-clause BSD text under an NVIDIA copyright line ("Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.").

  • https://github.com/pytorch/TensorRT/blob/main/README.md recorded 2026-10-07

    README describes Torch-TensorRT as bringing "the power of TensorRT to PyTorch" to "achieve the best inference performance for any PyTorch model on the NVIDIA platform", through torch.compile or an ahead-of-time export workflow; it names no paid tier, enterprise edition or license-gated build beside the published source.

Adoption

2 high confidence
2.0

Adoption is measured from PyPI downloads of the `torch-tensorrt` package. NVIDIA also ships Torch-TensorRT preinstalled inside its PyTorch NGC containers, a channel with no published download count, so the measured figure is a floor.

Capability

4 medium confidence
4.0

Torch-TensorRT compiles PyTorch, TorchScript and FX graphs through TensorRT's optimizing builder, narrowed to one framework and one vendor's hardware. That scope places it one step below Apache TVM's broader reach.

  • https://github.com/pytorch/TensorRT/blob/main/README.md recorded 2026-10-07

    README describes Torch-TensorRT as bringing "the power of TensorRT to PyTorch" to "achieve the best inference performance for any PyTorch model on the NVIDIA platform", through torch.compile or an ahead-of-time export workflow; it names no paid tier, enterprise edition or license-gated build beside the published source.

Verified 2026-09-24