AI Potluck
Infrastructure / Compilers & Model Optimization

Torch-TensorRT

PyTorch Foundation (Linux Foundation)

Torch-TensorRT is PyTorch's official compiler that lowers PyTorch, TorchScript and FX models into NVIDIA TensorRT engines, accelerating inference on NVIDIA GPUs while staying inside the PyTorch runtime.

Verified 2026-09-02 via the GitHub API and the LICENSE body.

Openness

5 high confidence
5.0
license
BSD-3-Clause(OSI)
source
public
core-gated
ungated

BSD-3-Clause license body confirmed. The repository is public and unarchived and builds the whole product, and the README describes no paid tier, enterprise edition or license-gated build beside it, so source is public and the core ungated.

Adoption

2 high confidence
2.0

33,392 PyPI downloads of `torch-tensorrt` in the trailing 30 days, which lands in the 10K-100K band of the software usage scale, level 2. The package is published from pytorch/TensorRT and `pip install torch-tensorrt` is the README's install path. Torch-TensorRT also ships preinstalled in NVIDIA's PyTorch NGC containers, a channel that publishes no count, so the band is a floor.

Capability

4 medium confidence
4.0

One band below the apache-tvm anchor, the same level as mlc-llm, coremltools, nvidia-model-optimizer, intel-neural-compressor and torchao: a full compilation toolchain narrowed to one framework and one vendor's hardware targets.

  • https://github.com/pytorch/TensorRT/blob/main/README.md recorded 2026-09-02

    README describes Torch-TensorRT as bringing the power of TensorRT to PyTorch to accelerate inference for any PyTorch model on the NVIDIA platform, with no paid tier, enterprise edition or license-gated build beside the published source.

Verified 2026-09-02