This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
-
Updated
Jun 2, 2022 - C++
#
triton-inference-server
Here are 11 public repositories matching this topic...
Serving Inside Pytorch
deployment inference pytorch ray serve tensorrt serving pipeline-parallelism torch2trt triton-inference-server llm-serving
-
Updated
Mar 28, 2025 - C++
Deep Learning Deployment Framework: Supports tf/torch/trt/trtllm/vllm and other NN frameworks. Support dynamic batching, and streaming modes. It is dual-language compatible with Python and C++, offering scalability, extensibility, and high performance. It helps users quickly deploy models and provide services through HTTP/RPC interfaces.
-
Updated
Mar 25, 2025 - C++
The Triton backend for the ONNX Runtime.
-
Updated
Mar 14, 2025 - C++
NVIDIA-accelerated DNN model inference ROS 2 packages using NVIDIA Triton/TensorRT for both Jetson and x86_64 with CUDA-capable GPU
ai deep-learning gpu dnn ros nvidia triton deeplearning tao jetson ros2 tensorrt triton-inference-server tensorrt-inference ros2-humble
-
Updated
Feb 28, 2025 - C++
C++ application to perform computer vision tasks using Nvidia Triton Server for model inference
-
Updated
Mar 2, 2025 - C++
TensorFlow Lite backend with ArmNN delegate support for Nvidia Triton
-
Updated
Sep 3, 2024 - C++
MLModelService wrapping Nvidia's Triton Server
cxx robotics tensorflow gpu cuda ml pytorch jetpack nvidia triton gpu-acceleration jetson tensorrt inference-engine nvidia-gpu onnx openvino triton-inference-server jetson-orin viam
-
Updated
Mar 5, 2025 - C++
A high-performance multi-object tracking system utilizing a quantized YOLOv11 model deployed on the Triton Inference Server, integrated with a CUDA-accelerated particle filter for robust tracking mutiple objects.
docker tracking machine-learning computer-vision deep-learning docker-compose cuda pytorch particle-filter yolo object-detection state-estimation object-tracking ensemble-model tensorrt gpu-programming onnx triton-inference-server bytetracker
-
Updated
Dec 30, 2024 - C++
Web Services for Machine Learning in C++
-
Updated
Mar 15, 2023 - C++
Cassandra plugin for NVIDIA DALI
-
Updated
Feb 3, 2025 - C++
Improve this page
Add a description, image, and links to the triton-inference-server topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the triton-inference-server topic, visit your repo's landing page and select "manage topics."