Top 62 tensorrt open source projects

Tengine is a lite, high performance, modular inference engine for embedded device

✭ 4,012

c C++assembly CMake python Cuda machine-learning pytorch tensorflow artificial-intelligence cnn cuda arm x86-64 acl onnx mips container riscv tensorrt nvdla npu supperedge

Tnn

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and …

✭ 3,257

C++Objective-C++python c assembly Cuda ocr deep-learning tensorflow inference pytorch tengine face-detection tensorrt mnn coreml ncnn openvino hairsegmentaion

Deepdetect

Deep Learning API and Server in C++14 support for Caffe, Caffe2, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

Torch2trt

An easy to use PyTorch to TensorRT converter

✭ 2,974

python C++shell Dockerfile pytorch classification inference tensorrt jetson-tx2 jetson-xavier jetson-nano

Tensorrtx

Implementation of popular deep learning networks with TensorRT network definition API

✭ 3,456

C++python Cuda CMake c shell resnet yolov3 mobilenetv2 crnn vgg resnext alexnet squeezenet inceptionv3 googlenet tensorrt senet arcface shufflenetv2 mnasnet retinaface mobilenetv3 yolov3-spp yolov4 yolov5

Berrynet

Deep learning gateway on Raspberry Pi and other edge devices

✭ 1,529

python javascript shell deep-learning tensorflow raspberry-pi iot mqtt edge-computing tensorrt edge-devices aiot openvino edge-ai

Tensorflow Yolov4 Tflite

YOLOv4, YOLOv4-tiny, YOLOv3, YOLOv3-tiny Implemented in Tensorflow 2.0, Android. Convert YOLO v4 .weights tensorflow, tensorrt and tflite

✭ 1,881

python java shell android tensorflow object-detection yolov3 tf2 tensorrt tflite yolov3-tiny yolov4

Jetson Inference

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

Tensorrt

TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.

✭ 4,644

C++python Jupyter Notebook Cuda CMake Dockerfile deep-learning nvidia tensorrt

Pytorch Yolov4

PyTorch ,ONNX and TensorRT implementation of YOLOv4

✭ 3,690

python C++pytorch yolov3 onnx tensorrt yolov4 pytorch-yolov4 darknet2pytorch yolov4-tiny darknet2onnx

Torch-TensorRT

PyTorch/TorchScript compiler for NVIDIA GPUs using TensorRT

✭ 1,216

Jupyter Notebook C++python Starlark c Dockerfile machine-learning deep-learning cuda pytorch nvidia jetson tensorrt libtorch

flexible-yolov5

More readable and flexible yolov5 with more backbone(resnet, shufflenet, moblienet, efficientnet, hrnet, swin-transformer) and (cbam，dcn and so on), and tensorrt

✭ 282

python Jupyter Notebook Dockerfile backbone pytorch resnet object-detection se tensorrt neck shufflenet cbam efficientnet hrnet dcnv2 yolov5 moblienet swin-transformer

onnx2tensorRt

tensorRt-inference darknet2onnx pytorch2onnx mxnet2onnx python version

✭ 14

python mxnet pytorch darknet tensorrt onnx yolov4

RepVGG TensorRT int8

RepVGG TensorRT int8 量化，实测推理不到1ms一帧！

✭ 35

python Makefile C++c CMake tensorrt int8 repvgg

tensorrt-examples

TensorRT Examples (TensorRT, Jetson Nano, Python, C++)

✭ 31

Jupyter Notebook python C++CMake computer-vision deep-learning segmentation object-detection super-resolution pose-estimation jetson tensorrt

yolov5 deepsort tensorrt cpp

This repo is a C++ version of yolov5_deepsort_tensorrt. Packing all C++ programs into .so files, using Python script to call C++ programs further.

✭ 21

python minimalist tensorrt deepsort yolov5

YoloV5 JDE TensorRT for Track

A multi object tracking Library Based on tensorrt

✭ 39

C++Makefile c CMake Cuda python detection tensorrt multiple-object-tracking

TensorRT-LPR

车牌识别，基于HyperLPR实现，修改模型调用方法，使用caffe+tensorRT实现GPU加速，修改了车牌检测模型

✭ 14

C++Cuda CMake caffe deep-learning yolo plate-recognition tensorrt lpr

AI-LAB

This repository contains a docker image that I use to develop my artificial intelligence applications in an uncomplicated fashion. Python, TensorFlow, PyTorch, ONNX, Keras, OpenCV, TensorRT, Numpy, Jupyter notebook... 🐋🔥

✭ 44

Dockerfile docker dockerfile data-science machine-learning ai computer-vision deep-learning ubuntu tensorflow jupyter-notebook pytorch artificial-intelligence tensorrt onnx

TensorRT yolo3 module

You can import this module directly

✭ 58

python pytorch tensorrt yolov3 tx2-jetpack

tensorRT Pro

C++ library based on tensorrt integration

✭ 857

C++c HTML Cuda Jupyter Notebook python deep-learning pytorch object-detection tensorrt yolov5 yolox

TensorRT-solo-python

TensorRT for SOLO(use python)

✭ 23

python tensorrt solov2

person-detection

TensorRT person tracking RFBNet300

✭ 30

C++CMake Cuda c detection tensorrt tracking-by-detection onnx

ONNX-Runtime-with-TensorRT-and-OpenVINO

Docker scripts for building ONNX Runtime with TensorRT and OpenVINO in manylinux environment

✭ 15

C++python shell Cuda cuda nvidia tensorrt onnx openvino onnxruntime

Yolov3-TensorRT-py

Yolov3 on tensorflow2.0 and tensorrt7.0

✭ 15

python tensorflow tensorrt yolov3

InferenceHelper

C++ Helper Class for Deep Learning Inference Frameworks: TensorFlow Lite, TensorRT, OpenCV, OpenVINO, ncnn, MNN, SNPE, Arm NN, NNabla, ONNX Runtime, LibTorch, TensorFlow

✭ 142

C++CMake opencv deep-learning tensorflow inference deeplearning tensorrt mnn nnabla ncnn

ROS-Object-Detection-2Dto3D-RealsenseD435

Use the Intel D435 real-sensing camera to realize object detection based on the Yolov3-5 framework under the Opencv DNN(old version)/TersorRT(now) by ROS-melodic.Real-time display of the Pointcloud in the camera coordinate system.

✭ 45

C++Cuda CMake opencv dnn ros object-detection pointcloud tensorrt ros-melodic realsense-camera yolov5

YOLOX

YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/

✭ 6,570

python C++shell deep-learning pytorch yolo object-detection tensorrt ncnn onnx yolov3 openvino megengine yolox

play with tensorrt

Sample projects for TensorRT in C++

✭ 39

C++Jupyter Notebook CMake shell deep-learning nvidia jetson tensorrt

vs-mlrt

Efficient ML Filter Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2, and Real-CUGAN)

✭ 34

C++python CMake ai deep-learning neural-network gpu cuda ml waifu2x artificial-intelligence vapoursynth tensorrt onnx openvino onnxruntime real-esrgan dpir real-cugan

FAST-Pathology

⚡ Open-source software for deep learning-based digital pathology

✭ 54

C++machine-learning opengl deep-learning deployment tensorflow opencl inference pytorch software convolutional-neural-networks digital-pathology tensorrt computational-pathology openvino free-to-use

yolov4-triton-tensorrt

This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server

✭ 224

C++python Cuda CMake docker deep-learning object-detection tensorrt yolov4 triton-inference-server yolov4-tiny

yolov5 tensorrt int8 tools

tensorrt int8 量化yolov5 onnx模型

✭ 105

python tensorrt int8 onnx yolov5

yolov5-deepsort-tensorrt

A c++ implementation of yolov5 and deepsort

✭ 207

C++Cuda CMake c camera detection class nvidia head tensorrt deepsort jetson-xavier jetson-nano jetson-xavier-nx yolov5

Scaled-YOLOv4-TensorRT

Got 100fps on TX2. Got 500fps on GeForce GTX 1660 Ti. If the project is useful to you, please Star it.

✭ 169

C++Cuda CMake python pytorch yolo tensorrt tx2 yolov4-tiny yolov4-large scaled-yolov4 yolov4-csp yolov4-tiny-tensorrt yolov4-csp-tensorrt yolov4-large-tensorrt scaled-yolov4-tenosrrt

YOLOv5-Lite

🍅🍅🍅YOLOv5-Lite: lighter, faster and easier to deploy. Evolved from yolov5 and the size of model is only 930+kb (int8) and 1.7M (fp16). It can reach 10+ FPS on the Raspberry Pi 4B when the input size is 320×320~

✭ 1,230

python C++Makefile c CMake shell pytorch transformer android-app tensorrt mnn mobilenet ncnn tflite shufflenetv2 onnxruntime yolov5 repvgg pplcnet openvivo picodet

watsor

Object detection for video surveillance

✭ 203

python mqtt video stream camera ffmpeg surveillance gpu detection realtime cuda ip mpegts hardware-acceleration zones homeassistant coral tensorrt tensrflow person-detector

libdeepvac

Use PyTorch model in C++ project

✭ 98

C++CMake pytorch tensorrt ncnn libtorch deepvac libdeepvac

tensorflow-tensorrt

Tensorflow to TensorRT Model Converter

✭ 30

C++python json tensorflow conversion tensorrt tensorrt2

keras-tensorrt-jetson

Example of loading a Keras model into TensorRT C++ API

✭ 51

Jupyter Notebook C++deep-learning tensorflow keras tensorrt jetson-tx2

flexinfer

A flexible Python front-end inference SDK based on TensorRT

✭ 83

python C++Cuda classification convolutional-neural-networks object-detection semantic-segmentation tensorrt scene-text-recognition python-front inference-sdk

tensorrt-zoo

openpose, yolov3 with tiny-tensorrt

✭ 84

Cuda C++CMake tensorrt

MutualGuide

Localize to Classify and Classify to Localize: Mutual Guidance in Object Detection

✭ 97

python shell deep-learning pytorch object-detection knowledge-distillation tensorrt

mtomo

Multiple types of NN model optimization environments. It is possible to directly access the host PC GUI and the camera to verify the operation. Intel iHD GPU (iGPU) support. NVIDIA GPU (dGPU) support.

✭ 24

Dockerfile shell mxnet tensorflow models pytorch tensorrt myriad onnx tensorflowlite tflite tensorflowjs openvino models-converter edgetpu depthai tf-trt

self-driving-ish computer vision system

This project generates images you've probably seen in autonomous driving demo. Object Detection, Lane Detection, Road Segmentation, Depth Estimation using TensorRT

✭ 254

C++Jupyter Notebook CMake shell deep-learning tensorflow autonomous-driving tensorrt

pnn

pnn is Darknet compatible neural nets inference engine implemented in Rust.

✭ 17

rust C++Cuda cuda yolo cudnn darknet tensorrt

yolov5 tensorrt int8

TensorRT int8 量化部署 yolov5s 模型，实测3.3ms一帧！

✭ 112

C++c CMake tensorrt int8 yolov5

InsightFace-REST

InsightFace REST API for easy deployment of face recognition services with TensorRT in Docker.

✭ 308

python shell docker gpu face-recognition face-detection fp16 tensorrt onnx arcface insightface fastapi retinaface centerface mask-detection tensorrt-conversion scrfd yolov5-face

yolov4 trt ros

YOLOv4 object detector using TensorRT engine

✭ 89

python C++Cuda shell jetson tensorrt yolov3 yolov3-tiny ros-melodic yolov4 yolov4-tiny

mediapipe plus

The purpose of this project is to apply mediapipe to more AI chips.

ros-yolo-sort

YOLO v3, v4, v5, v6, v7 + SORT tracking + ROS platform. Supporting: YOLO with Darknet, OpenCV(DNN), OpenVINO, TensorRT(tkDNN). SORT supports python(original) and C++. (Not Deep SORT)

✭ 162

C++python CMake yolo tensorrt openvino yolov4 yolov5 yolov6 yolov7

torch-model-compression

针对pytorch模型的自动化模型结构分析和修改工具集，包含自动分析模型结构的模型压缩算法库

✭ 126