Git Stars Git Stars

#distributed-inference Repositories

Discover 11 active open source GitHub repositories tagged with #distributed-inference, accumulating 76,339 total stars (averaging 6,939 stars per project). Leading this topic is exo-explore/exo with 48,516 stars.

11
Total Repositories
76,339
Total Stars
6,939
Avg Stars/Repo
1
exo-explore/exo

Run frontier AI locally.

exo-explore
โญ 48,516 Python ๐Ÿ‘ค exo-explore Organization ๐Ÿ• Updated 2026-11-06 ๐Ÿ“… Created 2024-06-24
2
flashinfer-ai/flashinfer

FlashInfer: Kernel Library for LLM Serving

flashinfer-ai
โญ 6,982 Cuda ๐Ÿ‘ค flashinfer-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-07-22
3
gpustack/gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

gpustack
โญ 6,097 Python ๐Ÿ‘ค gpustack Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-05-11
4
llm-d/llm-d

State-of-the-art inference performance with modern accelerators on Kubernetes

llm-d
โญ 5,325 Python ๐Ÿ‘ค llm-d Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-04-29
5
evilsocket/cake

Distributed inference for mobile, desktop and server.

evilsocket
โญ 3,141 Rust ๐Ÿ‘ค evilsocket User ๐Ÿ• Updated 2026-04-24 ๐Ÿ“… Created 2024-07-07
6
Robbyant/lingbot-va

[RSS 2026] Causal video-action world model for generalist robot control

Robbyant
โญ 1,989 Python ๐Ÿ‘ค Robbyant Organization ๐Ÿ• Updated 2026-07-09 ๐Ÿ“… Created 2026-01-29
7
sgl-project/sglang-omni

High-Performance Serving Runtime for Interactive Superintelligence Systems

sgl-project
โญ 1,882 Python ๐Ÿ‘ค sgl-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-01-07
8
Nehanth/pooled

Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.

Nehanth
โญ 658 JavaScript ๐Ÿ‘ค Nehanth User ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2026-09-01
9
MCG-NJU/SteadyDancer

SteadyDancer: Harmonized and Coherent Human Image Animation with First-Frame Preservation

MCG-NJU
โญ 652 Python ๐Ÿ‘ค MCG-NJU Organization ๐Ÿ• Updated 2025-12-23 ๐Ÿ“… Created 2025-11-21
10
nihalsid/mesh-gpt

MeshGPT: Generating Triangle Meshes with Decoder-Only Transformers

nihalsid
โญ 632 ๐Ÿ‘ค nihalsid User ๐Ÿ• Updated 2024-10-31 ๐Ÿ“… Created 2023-11-26
11
xingchensong/S3Tokenizer

Reverse Engineering of Supervised Semantic Speech Tokenizer (S3Tokenizer) proposed in CosyVoice

xingchensong
โญ 536 Python ๐Ÿ‘ค xingchensong User ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2024-09-09

Frequently Asked Questions

1

What is the most popular #distributed-inference repository on GitHub?

The top ranked open source #distributed-inference project on GitHub is exo-explore/exo with 48,516 stars. Run frontier AI locally.

2

Which programming languages are most used in #distributed-inference repositories?

Among the top ranked #distributed-inference projects on GitHub, the most common programming languages are Python, Cuda, Rust, JavaScript.

3

How is the #distributed-inference repository ranking calculated?

We track 11 active open source repositories tagged with #distributed-inference (500+ stars), totaling 76,339 stars with an average of 6,939 stars per repository. Rankings update daily from the GitHub API.