Breaking02 / IT
TensorRT 11.1 adds automatic tuning customised to each model
NVIDIA frames neural network deployment as a compilation problem with several valid answers and automates optimisation for each model.

NVIDIA said on 24 Oct 2026 that TensorRT 11.1 includes an automatic tuning feature, which lets users apply different optimisations to different models.
The feature is called the Global Performance Tuner, according to NVIDIA's blog. It performs accuracy-aware, end-to-end tuning automatically within TensorRT, a library for optimising neural networks to run on NVIDIA GPUs. The optimisation setup is customised for each model.
Part 1 of NVIDIA's blog series says deploying a trained neural network involves more than translating each operator into a GPU kernel. NVIDIA wrote: "It is a compilation problem with many legitimate answers."
TensorRT makes interdependent decisions when it builds an engine, according to Part 1. They cover graph intermediate representation (IR) transformations, fusion, implementation selection, memory placement and quantisation, a technique that stores a model's values at lower precision. This process is called scheduling.
Part 2 of the series, which covers the tuner, refers readers to Part 1 for details of the challenges associated with scheduling.