TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference…
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference…
TensorRT LLM =========================== TensorRT LLM optimizes inference for LLMs and Visual Gen models with specialized kernels for common operations, an efficient runtime, and a pythonic framework that enables you to customize and extend the system.
Architecture | Performance | Examples | Documentation | Roadmap
Description and README excerpt from NVIDIA/TensorRT-LLM on GitHub ↗.
NVIDIA/TensorRT-LLM was first seen on GitHub · Trending Python today on Nov 6, 2026. Since then it has appeared in 8 checks on 2 different days. Its best position was #4 of 20, reached on Nov 6, 11:49 UTC. It dropped off the list after Nov 7, 08:49 UTC.
Position on GitHub · Trending Python today at every check (lower is better).
Best rank per day (UTC).
Platform metric as reported by GitHub.
Archived daily, weekly and monthly lists that include this entry.
Not at the moment. It was last on the list on Nov 7, 08:49 UTC, after 2 days of trending.
#4 on GitHub · Trending Python today, on Nov 6, 11:49 UTC. Trendoday checks this list every 180 minutes.
It was first seen on Nov 6, 2026 and has been on the list on 2 days (8 checks) since.
Mostly Python; it is licensed under Other. It has 15.0k stars and 2913 forks.