Git Stars Git Stars

#sglang Repositories

Discover 38 active open source GitHub repositories tagged with #sglang, accumulating 109,680 total stars (averaging 2,886 stars per project). Leading this topic is xorbitsai/inference with 9,667 stars.

38
Total Repositories
109,680
Total Stars
2,886
Avg Stars/Repo
1
xorbitsai/inference

Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

xorbitsai
โญ 9,667 Python ๐Ÿ‘ค xorbitsai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-06-14
2
THUDM/slime

slime is an LLM training framework for RL Scaling.

THUDM
โญ 8,856 Python ๐Ÿ‘ค THUDM Organization ๐Ÿ• Updated 2026-11-05 ๐Ÿ“… Created 2025-06-18
3
ai-dynamo/dynamo

A Datacenter Scale Distributed Inference Serving Framework

ai-dynamo
โญ 8,542 Rust ๐Ÿ‘ค ai-dynamo Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-03-03
4
zhaochenyang20/Awesome-ML-SYS-Tutorial

My learning notes for ML SYS.

zhaochenyang20
โญ 7,695 HTML ๐Ÿ‘ค zhaochenyang20 User ๐Ÿ• Updated 2026-10-21 ๐Ÿ“… Created 2024-11-09
5
kvcache-ai/Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

kvcache-ai
โญ 7,100 C++ ๐Ÿ‘ค kvcache-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-06-25
6
z-lab/dflash

DFlash: Block Diffusion for Flash Speculative Decoding

z-lab
โญ 6,254 Python ๐Ÿ‘ค z-lab Organization ๐Ÿ• Updated 2026-08-18 ๐Ÿ“… Created 2026-01-04
7
gpustack/gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

gpustack
โญ 6,097 Python ๐Ÿ‘ค gpustack Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-05-11
8
Gen-Verse/OpenClaw-RL

OpenClaw-RL: Train any agent simply by talking

Gen-Verse
โญ 5,750 Python ๐Ÿ‘ค Gen-Verse Organization ๐Ÿ• Updated 2026-05-23 ๐Ÿ“… Created 2026-02-26
10
CalvinXKY/InfraTech

Sharing AI Infra knowledge & code practice: PyTorch, vLLM/SGLang, slime/vime framework introduction โšก๏ธ, performance acceleration ๐Ÿš€, large model basics ๐Ÿง , AI software and hardware ๐Ÿ”ง, etc.

CalvinXKY
โญ 4,411 Jupyter Notebook ๐Ÿ‘ค CalvinXKY User ๐Ÿ• Updated 2026-09-20 ๐Ÿ“… Created 2025-11-14
11
ForceInjection/AI-fundamentals

AI Fundamentals - GPU architecture, CUDA programming, basics of large models, and knowledge related to AI Agents.

ForceInjection
โญ 3,515 HTML ๐Ÿ‘ค ForceInjection Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-09-23
12
radixark/miles

Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.

radixark
โญ 3,386 Python ๐Ÿ‘ค radixark Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-10-09
13
maitrix-org/llm-reasoners

A library for advanced large language model reasoning

maitrix-org
โญ 2,344 Python ๐Ÿ‘ค maitrix-org Organization ๐Ÿ• Updated 2025-06-10 ๐Ÿ“… Created 2023-06-01
14
datawhalechina/zero-to-sglang

Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.

datawhalechina
โญ 2,306 Python ๐Ÿ‘ค datawhalechina Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2026-08-27
15
SemiAnalysisAI/InferenceX

Open-Source Inference Research Platform

SemiAnalysisAI
โญ 2,074 Python ๐Ÿ‘ค SemiAnalysisAI Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-07-12
16
ovg-project/kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

ovg-project
โญ 2,051 Python ๐Ÿ‘ค ovg-project Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-05-27
17
sgl-project/sglang-omni

High-Performance Serving Runtime for Interactive Superintelligence Systems

sgl-project
โญ 1,882 Python ๐Ÿ‘ค sgl-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-01-07
18
sybil-solutions/local-studio

Control panel for VLLM, Sglang, llama.cpp, exllamav3

sybil-solutions
โญ 1,854 TypeScript ๐Ÿ‘ค sybil-solutions Organization ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2025-12-17
19
intel/auto-round

PTQ-Level Efficiency, QAT-Level Accuracy

intel
โญ 1,706 Python ๐Ÿ‘ค intel Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-01-04
โญ 1,677 Python ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2025-11-18 ๐Ÿ“… Created 2025-09-29
21
OpenMOSS/MOSS-TTSD

A multilingual model for long-form, multi-speaker dialogue synthesis with flexible speaker control and zero-shot voice cloning

OpenMOSS
โญ 1,423 Python ๐Ÿ‘ค OpenMOSS Organization ๐Ÿ• Updated 2026-09-06 ๐Ÿ“… Created 2025-06-17
22
XiaomiMiMo/MiMo-V2-Flash

MiMo-V2-Flash: Efficient Reasoning, Coding, and Agentic Foundation Model

XiaomiMiMo
โญ 1,399 ๐Ÿ‘ค XiaomiMiMo Organization ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2025-12-15
โญ 1,323 Python ๐Ÿ‘ค ChenmienTan User ๐Ÿ• Updated 2026-05-20 ๐Ÿ“… Created 2025-04-04
24
ModelCloud/GPTQModel

LLM model quantization (compression) toolkit with hardware acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU, Tenstorrent, Huawei Ascend NPU, and Intel/AMD/Apple CPUs via HF, vLLM, and SGLang.

ModelCloud
โญ 1,294 Python ๐Ÿ‘ค ModelCloud Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-06-17
25
sgl-project/SpecForge

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

sgl-project
โญ 1,291 Python ๐Ÿ‘ค sgl-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-06-09
26
patchy631/time-to-first-token

A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchmarking.

patchy631
โญ 1,245 HTML ๐Ÿ‘ค patchy631 User ๐Ÿ• Updated 2026-08-14 ๐Ÿ“… Created 2026-08-02
27
eagle-hq/EAGLE-4

Official Inference Code of EAGLE-4

eagle-hq
โญ 1,220 Python ๐Ÿ‘ค eagle-hq Organization ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2026-10-20
28
OpenMOSS/MOVA

A foundation model that generates synchronized video and audio in a single model

OpenMOSS
โญ 1,151 Python ๐Ÿ‘ค OpenMOSS Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-01-28
29
Tencent-Hunyuan/UniRL

UniRL is a Framework for Unified Multimodal Model Reinforcement Learning

Tencent-Hunyuan
โญ 1,051 Python ๐Ÿ‘ค Tencent-Hunyuan Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-06-08
30
MoonshotAI/checkpoint-engine

Checkpoint-engine is a simple middleware to update model weights in LLM inference engines

MoonshotAI
โญ 1,026 Python ๐Ÿ‘ค MoonshotAI Organization ๐Ÿ• Updated 2026-10-22 ๐Ÿ“… Created 2025-09-08
31
alvarobartt/hf-mem

A CLI to estimate inference memory requirements for Hugging Face models, written in Python.

alvarobartt
โญ 956 Python ๐Ÿ‘ค alvarobartt User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-12-22
32
XHToken/Spark-X2.6

Spark-x2.6 open model series. Pushing the Limits of Agentic Capabilities in On-Device Models

XHToken
โญ 927 ๐Ÿ‘ค XHToken Organization ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2026-08-24
33
smg-project/smg

Engine-agnostic LLM gateway in Rust. Full OpenAI and Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini, and more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant authentication.

smg-project
โญ 736 Rust ๐Ÿ‘ค smg-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-11-22
34
HuiResearch/FlashTTS

Provides high-quality Chinese speech synthesis and voice cloning services based on models such as SparkTTS and OrpheusTTS.

HuiResearch
โญ 603 Python ๐Ÿ‘ค HuiResearch User ๐Ÿ• Updated 2025-05-18 ๐Ÿ“… Created 2025-03-13
35
MoonshotAI/K2-Vendor-Verifier

Verify Precision of all Kimi K2 API Vendor

MoonshotAI
โญ 602 Python ๐Ÿ‘ค MoonshotAI Organization ๐Ÿ• Updated 2026-02-14 ๐Ÿ“… Created 2025-09-09
36
spark-arena/sparkrun

sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems. Live support: https://discord.com/invite/GH5kRgv6ZD

spark-arena
โญ 567 Python ๐Ÿ‘ค spark-arena Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2026-02-16
37
MemTensor/MemT-1.0

Official repository for MemT-1.0

MemTensor
โญ 545 Python ๐Ÿ‘ค MemTensor Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-10-19
38
ome-projects/ome

Open Model Engine (OME) โ€” Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

ome-projects
โญ 529 Go ๐Ÿ‘ค ome-projects Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-05-19

Frequently Asked Questions

1

What is the most popular #sglang repository on GitHub?

The top ranked open source #sglang project on GitHub is xorbitsai/inference with 9,667 stars. Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

2

Which programming languages are most used in #sglang repositories?

Among the top ranked #sglang projects on GitHub, the most common programming languages are Python, HTML, Rust, C++.

3

How is the #sglang repository ranking calculated?

We track 38 active open source repositories tagged with #sglang (500+ stars), totaling 109,680 stars with an average of 2,886 stars per repository. Rankings update daily from the GitHub API.