Git Stars Git Stars

#real-time-inference Repositories

Discover 43 active open source GitHub repositories tagged with #real-time-inference, accumulating 133,583 total stars (averaging 3,106 stars per project). Leading this topic is facebookresearch/sam2 with 20,204 stars.

43
Total Repositories
133,583
Total Stars
3,106
Avg Stars/Repo
1
facebookresearch/sam2

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

facebookresearch
โญ 20,204 Jupyter Notebook ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2026-05-30 ๐Ÿ“… Created 2024-07-29
2
tensorflow/tfjs-models

Pretrained models for TensorFlow.js

tensorflow
โญ 14,816 TypeScript ๐Ÿ‘ค tensorflow Organization ๐Ÿ• Updated 2026-06-23 ๐Ÿ“… Created 2018-04-03
3
THU-MIG/yolov10

YOLOv10: Real-Time End-to-End Object Detection [NeurIPS 2024]

THU-MIG
โญ 11,318 Python ๐Ÿ‘ค THU-MIG Organization ๐Ÿ• Updated 2025-03-14 ๐Ÿ“… Created 2024-05-23
4
CASIA-LMC-Lab/FastSAM

Fast Segment Anything

CASIA-LMC-Lab
โญ 8,215 Python ๐Ÿ‘ค CASIA-LMC-Lab Organization ๐Ÿ• Updated 2024-07-30 ๐Ÿ“… Created 2023-06-21
5
apple-aiml-research/ml-fastvlm

This repository contains the official implementation of "FastVLM: Efficient Vision Encoding for Vision Language Models" - CVPR 2025

apple-aiml-research
โญ 7,445 Python ๐Ÿ‘ค apple-aiml-research Organization ๐Ÿ• Updated 2026-09-11 ๐Ÿ“… Created 2025-05-01
6
eriklindernoren/PyTorch-YOLOv3

Minimal PyTorch implementation of YOLOv3

eriklindernoren
โญ 7,436 Python ๐Ÿ‘ค eriklindernoren User ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2018-05-21
7
neuphonic/neutts

On-device TTS model by Neuphonic

neuphonic
โญ 6,343 Python ๐Ÿ‘ค neuphonic Organization ๐Ÿ• Updated 2026-07-30 ๐Ÿ“… Created 2025-10-02
8
apple-aiml-research/ml-depth-pro

Depth Pro: Sharp Monocular Metric Depth in Less Than a Second.

apple-aiml-research
โญ 5,788 Python ๐Ÿ‘ค apple-aiml-research Organization ๐Ÿ• Updated 2026-09-11 ๐Ÿ“… Created 2024-08-26
9
ngxson/smolvlm-realtime-webcam

Real-time webcam demo with SmolVLM and llama.cpp server

ngxson
โญ 5,555 HTML ๐Ÿ‘ค ngxson User ๐Ÿ• Updated 2025-05-12 ๐Ÿ“… Created 2025-05-12
10
alibaba/x-deeplearning

An industrial deep learning framework for high-dimension sparse data

alibaba
โญ 4,306 PureBasic ๐Ÿ‘ค alibaba Organization ๐Ÿ• Updated 2024-09-25 ๐Ÿ“… Created 2018-12-12
โญ 3,876 Python ๐Ÿ‘ค HumanAIGC-Engineering User ๐Ÿ• Updated 2026-07-31 ๐Ÿ“… Created 2025-02-20
12
kyutai-labs/delayed-streams-modeling

Kyutai's Speech-To-Text and Text-To-Speech models based on the Delayed Streams Modeling framework.

kyutai-labs
โญ 3,055 Python ๐Ÿ‘ค kyutai-labs Organization ๐Ÿ• Updated 2026-01-26 ๐Ÿ“… Created 2025-06-16
13
anliyuan/Ultralight-Digital-Human

An ultra-lightweight, real-time runnable digital human model on mobile devices

anliyuan
โญ 2,675 Python ๐Ÿ‘ค anliyuan User ๐Ÿ• Updated 2026-07-22 ๐Ÿ“… Created 2024-10-10
14
microsoft/DirectML

โš ๏ธDirectML is in maintenance mode โš ๏ธ DirectML is a high-performance, hardware-accelerated DirectX 12 library for machine learning. DirectML provides GPU acceleration for common machine learning tasks across a broad range of supported hardware and drivers, including all DirectX 12-capable GPUs from vendors such as AMD, Intel, NVIDIA, and Qualcomm.

microsoft
โญ 2,591 C++ ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-04-27 ๐Ÿ“… Created 2019-03-12
15
xingyizhou/CenterTrack

Simultaneous object detection and tracking using center points.

xingyizhou
โญ 2,467 Python ๐Ÿ‘ค xingyizhou User ๐Ÿ• Updated 2024-06-17 ๐Ÿ“… Created 2020-04-02
16
THU-MIG/yoloe

YOLOE: Real-Time Seeing Anything [ICCV 2025]

THU-MIG
โญ 2,180 Python ๐Ÿ‘ค THU-MIG Organization ๐Ÿ• Updated 2025-06-26 ๐Ÿ“… Created 2025-03-10
17
Tencent/ObjectDetection-OneStageDet

Single-stage generic object detector

Tencent
โญ 1,979 Python ๐Ÿ‘ค Tencent Organization ๐Ÿ• Updated 2025-07-02 ๐Ÿ“… Created 2018-12-19
18
Standard-Intelligence/hertz-dev

first base model for full-duplex conversational audio

Standard-Intelligence
โญ 1,789 Python ๐Ÿ‘ค Standard-Intelligence Organization ๐Ÿ• Updated 2025-01-05 ๐Ÿ“… Created 2024-11-03
โญ 1,682 Python ๐Ÿ‘ค pipecat-ai Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2025-03-05
20
Junyi42/monst3r

Official Implementation of paper "MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motion"

Junyi42
โญ 1,370 Python ๐Ÿ‘ค Junyi42 User ๐Ÿ• Updated 2025-06-16 ๐Ÿ“… Created 2024-10-07
21
SullyChen/Autopilot-TensorFlow

A TensorFlow implementation of this Nvidia paper: https://arxiv.org/pdf/1604.07316.pdf with some changes

SullyChen
โญ 1,279 Python ๐Ÿ‘ค SullyChen User ๐Ÿ• Updated 2024-06-16 ๐Ÿ“… Created 2016-10-01
22
SakanaAI/self-adaptive-llms

A Self-adaptation Framework๐Ÿ™ that adapts LLMs for unseen tasks in real-time!

SakanaAI
โญ 1,215 Python ๐Ÿ‘ค SakanaAI Organization ๐Ÿ• Updated 2025-01-30 ๐Ÿ“… Created 2024-12-02
23
warmshao/FasterLivePortrait

Bring portraits to life in Real Time๏ผonnx/tensorrt support๏ผReal-Time Portrait Driver๏ผ

warmshao
โญ 1,152 Python ๐Ÿ‘ค warmshao User ๐Ÿ• Updated 2025-06-29 ๐Ÿ“… Created 2024-07-14
24
Geekgineer/YOLOs-CPP

Cross-Platform Production-ready C++ inference engine for YOLO models (v5-v12, YOLO26). Unified API for detection, segmentation, pose estimation, OBB, and classification. Built on ONNX Runtime and OpenCV. Optimized for CPU/GPU with quantization support.

Geekgineer
โญ 1,102 C++ ๐Ÿ‘ค Geekgineer User ๐Ÿ• Updated 2026-08-23 ๐Ÿ“… Created 2024-10-09
25
mit-han-lab/streaming-vlm

StreamingVLM: Real-Time Understanding for Infinite Video Streams

mit-han-lab
โญ 1,095 Python ๐Ÿ‘ค mit-han-lab Organization ๐Ÿ• Updated 2025-10-15 ๐Ÿ“… Created 2025-10-11
26
THU-MIG/RepViT

RepViT: Revisiting Mobile CNN From ViT Perspective [CVPR 2024] and RepViT-SAM: Towards Real-Time Segmenting Anything

THU-MIG
โญ 1,042 Jupyter Notebook ๐Ÿ‘ค THU-MIG Organization ๐Ÿ• Updated 2024-06-14 ๐Ÿ“… Created 2023-07-18
27
madebyollin/taesd

Tiny AutoEncoder for Stable Diffusion (and other image models)

madebyollin
โญ 1,002 Python ๐Ÿ‘ค madebyollin User ๐Ÿ• Updated 2026-10-22 ๐Ÿ“… Created 2023-04-16
28
wzzheng/StreamVGGT

[ICLR 2026] Streaming 4D Visual Geometry Transformer

wzzheng
โญ 988 Python ๐Ÿ‘ค wzzheng User ๐Ÿ• Updated 2025-10-27 ๐Ÿ“… Created 2025-07-14
29
ShiqiYu/libfacedetection.train

The training program for libfacedetection for face detection and 5-landmark detection.

ShiqiYu
โญ 852 Python ๐Ÿ‘ค ShiqiYu User ๐Ÿ• Updated 2026-07-10 ๐Ÿ“… Created 2020-03-05
30
yformer/EfficientTAM

Efficient Track Anything

yformer
โญ 802 Python ๐Ÿ‘ค yformer User ๐Ÿ• Updated 2025-01-06 ๐Ÿ“… Created 2024-12-02
31
espressif/esp-tflite-micro

TensorFlow Lite Micro for Espressif Chipsets

espressif
โญ 724 C++ ๐Ÿ‘ค espressif Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2021-10-25
32
toyxyz/ComfyUI_toyxyz_test_nodes

This is a custom node that collects the tools I use frequently.

toyxyz
โญ 710 Python ๐Ÿ‘ค toyxyz User ๐Ÿ• Updated 2026-10-17 ๐Ÿ“… Created 2023-11-22
33
showlab/videollm-online

VideoLLM-online: Online Video Large Language Model for Streaming Video (CVPR 2024)

showlab
โญ 690 Python ๐Ÿ‘ค showlab Organization ๐Ÿ• Updated 2025-11-26 ๐Ÿ“… Created 2024-06-17
34
leafqycc/rknn-cpp-Multithreading

A simple demo of yolov5s running on rk3588/3588s using c++ (about 142 frames). / A simple demo of yolov5s running on rk3588/3588s using c++ (about 142 frames).

leafqycc
โญ 687 C ๐Ÿ‘ค leafqycc User ๐Ÿ• Updated 2024-04-09 ๐Ÿ“… Created 2023-05-05
35
CAIC-AD/YOLOPv2

YOLOPv2: Better, Faster, Stronger for Panoptic driving Perception

CAIC-AD
โญ 647 Python ๐Ÿ‘ค CAIC-AD User ๐Ÿ• Updated 2024-06-30 ๐Ÿ“… Created 2022-08-23
36
aws-samples/amazon-personalize-samples

Notebooks and examples on how to onboard and use various features of Amazon Personalize

aws-samples
โญ 602 Jupyter Notebook ๐Ÿ‘ค aws-samples Organization ๐Ÿ• Updated 2026-03-14 ๐Ÿ“… Created 2018-11-23
37
yoxu515/aot-benchmark

An efficient modular implementation of Associating Objects with Transformers for Video Object Segmentation in PyTorch

yoxu515
โญ 595 Python ๐Ÿ‘ค yoxu515 User ๐Ÿ• Updated 2026-04-07 ๐Ÿ“… Created 2021-11-16
38
alex4727/MotionStream

MotionStream: Real-Time Video Generation with Interactive Motion Controls

alex4727
โญ 590 ๐Ÿ‘ค alex4727 User ๐Ÿ• Updated 2026-03-01 ๐Ÿ“… Created 2025-10-09
39
kleinlee/MiniMates

The fastest digital human algorithm, now on your desktop.

kleinlee
โญ 587 Python ๐Ÿ‘ค kleinlee User ๐Ÿ• Updated 2025-09-29 ๐Ÿ“… Created 2024-09-24
40
hellozhuo/pidinet

Code for the ICCV 2021 paper "Pixel Difference Networks for Efficient Edge Detection" (Oral).

hellozhuo
โญ 574 Python ๐Ÿ‘ค hellozhuo User ๐Ÿ• Updated 2024-07-02 ๐Ÿ“… Created 2021-07-26
41
ultralytics/yolo-ios-app

Ultralytics YOLO iOS app and Swift package for real-time Core ML inference across major computer vision tasks.

ultralytics
โญ 535 Swift ๐Ÿ‘ค ultralytics Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2024-02-11
42
wyf0912/SinSR

[CVPR 2024] SinSR: Diffusion-Based Image Super-Resolution in a Single Step

wyf0912
โญ 533 Python ๐Ÿ‘ค wyf0912 User ๐Ÿ• Updated 2024-09-12 ๐Ÿ“… Created 2023-11-23
43
ultralytics/yolo-flutter-app

Official Ultralytics YOLO Flutter plugin for real-time inference on Android and iOS across major vision tasks.

ultralytics
โญ 516 Dart ๐Ÿ‘ค ultralytics Organization ๐Ÿ• Updated 2026-11-08 ๐Ÿ“… Created 2024-03-12

Frequently Asked Questions

1

What is the most popular #real-time-inference repository on GitHub?

The top ranked open source #real-time-inference project on GitHub is facebookresearch/sam2 with 20,204 stars. The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

2

Which programming languages are most used in #real-time-inference repositories?

Among the top ranked #real-time-inference projects on GitHub, the most common programming languages are Python, Jupyter Notebook, C++, TypeScript.

3

How is the #real-time-inference repository ranking calculated?

We track 43 active open source repositories tagged with #real-time-inference (500+ stars), totaling 133,583 stars with an average of 3,106 stars per repository. Rankings update daily from the GitHub API.