Git Stars Git Stars

#low-latency-inference Repositories

Discover 14 active open source GitHub repositories tagged with #low-latency-inference, accumulating 56,906 total stars (averaging 4,064 stars per project). Leading this topic is alievk/avatarify-python with 16,551 stars.

14
Total Repositories
56,906
Total Stars
4,064
Avg Stars/Repo
Programming Languages: Python C++ Cuda
1
alievk/avatarify-python

Avatars for Zoom, Skype and other video-conferencing apps.

alievk
โญ 16,551 Python ๐Ÿ‘ค alievk User ๐Ÿ• Updated 2024-08-30 ๐Ÿ“… Created 2020-04-06
2
kyutai-labs/moshi

Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audio codec.

kyutai-labs
โญ 11,573 Python ๐Ÿ‘ค kyutai-labs Organization ๐Ÿ• Updated 2026-09-09 ๐Ÿ“… Created 2024-08-07
3
deepseek-ai/DeepEP

DeepEP: an efficient expert-parallel communication library

deepseek-ai
โญ 10,462 Cuda ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-02-17
4
MoonshotAI/Kimi-Audio

Kimi-Audio, an open-source audio foundation model excelling in audio understanding, generation, and conversation

MoonshotAI
โญ 4,654 Python ๐Ÿ‘ค MoonshotAI Organization ๐Ÿ• Updated 2025-06-21 ๐Ÿ“… Created 2025-04-25
5
turboderp-org/exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

turboderp-org
โญ 4,653 Python ๐Ÿ‘ค turboderp-org Organization ๐Ÿ• Updated 2026-03-04 ๐Ÿ“… Created 2023-08-30
6
microsoft/BlingFire

A lightning fast Finite State machine and REgular expression manipulation library.

microsoft
โญ 1,877 C++ ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2024-12-08 ๐Ÿ“… Created 2019-03-13
7
ModelTC/LightX2V-Qwen-Image-Lightning

Qwen-Image-Lightning: Speed up Qwen-Image model with distillation

ModelTC
โญ 1,368 Python ๐Ÿ‘ค ModelTC Organization ๐Ÿ• Updated 2026-08-31 ๐Ÿ“… Created 2025-08-09
8
Ksuriuri/index-tts-vllm

Added vLLM support to IndexTTS for faster inference.

Ksuriuri
โญ 1,244 Python ๐Ÿ‘ค Ksuriuri User ๐Ÿ• Updated 2026-04-13 ๐Ÿ“… Created 2025-05-03
9
dmlc/treelite

Universal model exchange and serialization format for decision tree forests

dmlc
โญ 833 C++ ๐Ÿ‘ค dmlc Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2017-06-28
10
Passer1072/RookieAI_yolov8

AI self-aiming project based on yolov8

Passer1072
โญ 831 Python ๐Ÿ‘ค Passer1072 User ๐Ÿ• Updated 2026-02-04 ๐Ÿ“… Created 2024-03-03
11
wenet-e2e/wekws

Production Ready End-to-End Keyword Spotting Toolkit

wenet-e2e
โญ 776 Python ๐Ÿ‘ค wenet-e2e Organization ๐Ÿ• Updated 2026-07-23 ๐Ÿ“… Created 2021-11-06
โญ 727 Python ๐Ÿ‘ค Tencent-Hunyuan Organization ๐Ÿ• Updated 2025-12-30 ๐Ÿ“… Created 2025-08-28
13
MDK8888/GPTFast

Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.

MDK8888
โญ 687 Python ๐Ÿ‘ค MDK8888 User ๐Ÿ• Updated 2024-08-22 ๐Ÿ“… Created 2024-02-18
14
VITA-MLLM/VITA-Audio

โœจโœจ[NeurIPS 2025] VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Model

VITA-MLLM
โญ 679 Python ๐Ÿ‘ค VITA-MLLM Organization ๐Ÿ• Updated 2025-05-24 ๐Ÿ“… Created 2025-04-23

Frequently Asked Questions

1

What is the most popular #low-latency-inference repository on GitHub?

The top ranked open source #low-latency-inference project on GitHub is alievk/avatarify-python with 16,551 stars. Avatars for Zoom, Skype and other video-conferencing apps.

2

Which programming languages are most used in #low-latency-inference repositories?

Among the top ranked #low-latency-inference projects on GitHub, the most common programming languages are Python, C++, Cuda.

3

How is the #low-latency-inference repository ranking calculated?

We track 14 active open source repositories tagged with #low-latency-inference (500+ stars), totaling 56,906 stars with an average of 4,064 stars per repository. Rankings update daily from the GitHub API.