OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and …

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

Adlik: Toolkit for Accelerating Deep Learning Inference

A scalable inference server for models optimized with OpenVINO™

World's fastest ANPR / ALPR implementation for CPUs, GPUs, VPUs and NPUs using deep learning (Tensorflow, Tensorflow lite, TensorRT, OpenVX, OpenVINO). Multi-Charset (Latin, Korean, Chinese) & Multi-OS (Jetson, Android, Raspberry Pi, Linux, Windows) & Multi-Arch (ARM, x86).

Deep Learning Streamer (DL Streamer) Pipeline Framework is an open-source streaming media analytics framework, based on GStreamer* multimedia framework, for creating complex media analytics pipelines for the Cloud or at the Edge.

Efficient CPU/GPU ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet, ArtCNN and more!)

YOLOX + ROS2 object detection package (C++ only support)

用c++实现了yolov5使用openvino的部署

YOLO v3, v4, v5, v6, v7 + SORT tracking + ROS platform. Supporting: YOLO with Darknet, OpenCV(DNN), OpenVINO, TensorRT(tkDNN). SORT supports python(original) and C++. (Not Deep SORT)

Repository for OpenVINO's extra modules

⚡ Open-source software for deep learning-based digital pathology

Tutorial for Using Custom Layers with OpenVINO (Intel Deep Learning Toolkit)

A lightweight pure C++ Text-to-Speech (TTS) pipeline with OpenVINO, supporting multiple languages.

YOLOv10 C++ implementation using OpenVINO for efficient and accurate real-time object detection.

Aim to accelerate the image-animation-model inference through the inference frameworks such as onnx、tensorrt and openvino.

Create a smart video application using the Intel Distribution of OpenVINO toolkit. The toolkit uses models and inference to run single-class object detection.

This repository will demostrate how to deploy a offical YOLOv7 pre-trained model with OpenVINO runtime api