Back to Gap Map Infrastructure / Classic ML & computer vision

SegFormer

NVIDIA
restricted / Overall score: 3.0

SegFormer is a semantic segmentation model line from NVIDIA Research that pairs a hierarchical Transformer encoder, in sizes B0 to B5, with a lightweight all-MLP decoder. The encoders are pretrained on ImageNet-1K and the released checkpoints are fine-tuned on ADE20K and Cityscapes, with training and evaluation code built on MMSegmentation. NVIDIA's checkpoints are also on the Hugging Face Hub in Transformers format.

Openness

2 high confidence
2.0
weights
open (B0 to B5 ADE20K and Cityscapes checkpoints on the Hub, ungated)
data
open (ImageNet-1K for the encoders, then ADE20K or Cityscapes, all public benchmarks)
code
open (training and evaluation code and configs, built on MMSegmentation)
license
NVIDIA-Source-Code-License (code and checkpoints; research or evaluation use only, commercial use reserved to NVIDIA)

SegFormer's code and checkpoints are under the NVIDIA Source Code License, which allows use only for research or evaluation and reserves commercial use to NVIDIA. The public training data and the published training code do not lift that restriction.

Adoption

3 high confidence
3.0

Hugging Face downloads over the trailing 30 days for the five declared checkpoints, most of them for the smallest ADE20K model. The other NVIDIA SegFormer checkpoints add comparatively little.

Capability

3 high confidence
3.0

Each SegFormer checkpoint labels pixels with the classes of the benchmark it was fine-tuned on, so a new set of classes needs a training run, as with RT-DETR's COCO detectors.

Verified 2026-11-12