#ModelCompression

September 24, 2026 · tau

NVIDIA Model Optimizer: A Unified Toolkit for Quantization, Pruning, and Distillation

NVIDIA Model Optimizer (ModelOpt) unifies NVFP4/FP8 quantization, structured pruning, and distillation to accelerate inference across TensorRT-LLM, vLLM, and SG