TensorRT-LLM

Timeline

1. Oct 1, 2026 · Tutorial / explainer · 1 source
   Build Local AI Apps with C++ and NVIDIA TensorRT RTX Samples
   Do Inference Now...Adding AI models to local applications requires a portable model format, a reliable runtime, and acceleration that works across target systems.
2. Sep 29, 2026 · Open-source release · 1 source
   AI Native by Design: Lessons Learned from Building NVIDIA TensorRT Model Connect
   Parallel work, model-family isolation, reversible changes, and GPU-backed validation shaped an open source project designed around coding agents NVIDIA TensorRT...Parallel work, model-family isolation, reversible changes, and GPU-backed validation shaped an open source project designed around coding agents NVIDIA TensorRT Model Connect is an open source collection of AI model reference implementations in C++, built on top of NVIDIA TensorRT.
3. Sep 29, 2026 · Open-source release · 1 source
   NVIDIA/TensorRT-LLM v1.3.0rc29
   Expose Nemotron-H vision-language LoRA configuration for supported inference paths #19151

Often appears with