Pinned Loading

1. NVIDIA/TensorRT NVIDIA/TensorRT Public

   NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

   C++ 12.3k 2.3k

2. tensorrt-insight tensorrt-insight Public

   Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda

   C++ 19 1

3. xinfer xinfer Public

   AI infer engine

   C++ 9

4. llm-deploy llm-deploy Public

   AI Infra LLM infer/ tensorrt-llm/ vllm

   Python 20 1

5. auto_qat auto_qat Public

   auto qat for nv tensorrt

   Jupyter Notebook