Git Stars Git Stars

#vllm Repositories

Discover 133 active open source GitHub repositories tagged with #vllm, accumulating 554,542 total stars (averaging 4,169 stars per project). Leading this topic is earendil-works/pi with 123,140 stars.

133
Total Repositories
554,542
Total Stars
4,169
Avg Stars/Repo
1
earendil-works/pi

AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI

earendil-works
โญ 123,140 TypeScript ๐Ÿ‘ค earendil-works Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-08-09
2
deepseek-ai/DeepSeek-Coder

DeepSeek Coder: Let the Code Write Itself

deepseek-ai
โญ 24,365 Python ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2025-11-11 ๐Ÿ“… Created 2023-10-20
3
deepseek-ai/DeepSeek-OCR

Contexts Optical Compression

deepseek-ai
โญ 24,180 Python ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2026-01-27 ๐Ÿ“… Created 2025-10-17
4
datalab-to/surya

OCR, layout analysis, reading order, table recognition in 90+ languages

datalab-to
โญ 21,608 Python ๐Ÿ‘ค datalab-to Organization ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2024-01-10
5
modelscope/FunASR

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

modelscope
โญ 21,091 Python ๐Ÿ‘ค modelscope Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-11-24
6
meta-llama/llama-cookbook

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

meta-llama
โญ 18,595 Jupyter Notebook ๐Ÿ‘ค meta-llama Organization ๐Ÿ• Updated 2026-05-19 ๐Ÿ“… Created 2023-07-17
7
budtmo/docker-android

Android in Docker solution with noVNC support, video recording, an MCP server, and an AI agent

budtmo
โญ 16,184 Python ๐Ÿ‘ค budtmo User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2016-12-22
8
Orchestra-Research/AI-Research-SKILLs

Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research.

Orchestra-Research
โญ 14,716 TeX ๐Ÿ‘ค Orchestra-Research Organization ๐Ÿ• Updated 2026-10-11 ๐Ÿ“… Created 2025-11-03
9
Jiayi-Pan/TinyZero

Minimal reproduction of DeepSeek R1-Zero

Jiayi-Pan
โญ 13,259 Python ๐Ÿ‘ค Jiayi-Pan User ๐Ÿ• Updated 2026-02-27 ๐Ÿ“… Created 2025-01-21
10
halfrost/Halfrost-Field

โœ๐Ÿป Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field: Source Code Analysis, System Design & Engineering Practice Notes

halfrost
โญ 13,259 Go ๐Ÿ‘ค halfrost User ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2017-04-02
11
datalab-to/chandra

OCR model that handles complex tables, forms, handwriting with full layout.

datalab-to
โญ 12,741 Python ๐Ÿ‘ค datalab-to Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2025-10-08
12
LMCache/LMCache

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

LMCache
โญ 12,405 Python ๐Ÿ‘ค LMCache Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-05-28
13
OpenRLHF/OpenRLHF

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

OpenRLHF
โญ 10,173 Python ๐Ÿ‘ค OpenRLHF Organization ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2023-07-30
14
xorbitsai/inference

Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

xorbitsai
โญ 9,667 Python ๐Ÿ‘ค xorbitsai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-06-14
15
ai-dynamo/dynamo

A Datacenter Scale Distributed Inference Serving Framework

ai-dynamo
โญ 8,542 Rust ๐Ÿ‘ค ai-dynamo Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-03-03
16
kvcache-ai/Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

kvcache-ai
โญ 7,100 C++ ๐Ÿ‘ค kvcache-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-06-25
17
simplescaling/s1

s1: Simple test-time scaling

simplescaling
โญ 6,656 Python ๐Ÿ‘ค simplescaling Organization ๐Ÿ• Updated 2025-06-25 ๐Ÿ“… Created 2025-02-01
18
vllm-project/semantic-router

An open, programmable decision layer for models and compute.

vllm-project
โญ 6,514 Go ๐Ÿ‘ค vllm-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-08-26
19
kserve/kserve

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

kserve
โญ 6,253 Go ๐Ÿ‘ค kserve Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2019-03-27
20
gpustack/gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

gpustack
โญ 6,097 Python ๐Ÿ‘ค gpustack Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-05-11
21
skyzh/tiny-llm

Learn LLM inference systems on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

skyzh
โญ 5,801 Python ๐Ÿ‘ค skyzh User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2025-04-19
22
OpenBMB/UltraRAG

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

OpenBMB
โญ 5,748 Python ๐Ÿ‘ค OpenBMB Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-01-16
23
PeterGriffinJin/Search-R1

Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL

PeterGriffinJin
โญ 5,575 Python ๐Ÿ‘ค PeterGriffinJin User ๐Ÿ• Updated 2025-11-13 ๐Ÿ“… Created 2025-02-28
24
xlite-dev/Awesome-LLM-Inference

๐Ÿ“šA curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.๐ŸŽ‰

xlite-dev
โญ 5,565 Python ๐Ÿ‘ค xlite-dev Organization ๐Ÿ• Updated 2026-10-20 ๐Ÿ“… Created 2023-08-27
25
katanaml/sparrow

Structured data extraction, instruction calling and agentic workflows with ML, LLM and Vision LLM

katanaml
โญ 5,234 Python ๐Ÿ‘ค katanaml Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2022-01-08
26
PrimeIntellect-ai/verifiers

Our library for RL environments + evals

PrimeIntellect-ai
โญ 4,797 Python ๐Ÿ‘ค PrimeIntellect-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-01-22
โญ 4,630 Python ๐Ÿ‘ค stepfun-ai Organization ๐Ÿ• Updated 2026-03-16 ๐Ÿ“… Created 2025-02-11
28
CalvinXKY/InfraTech

Sharing AI Infra knowledge & code practice: PyTorch, vLLM/SGLang, slime/vime framework introduction โšก๏ธ, performance acceleration ๐Ÿš€, large model basics ๐Ÿง , AI software and hardware ๐Ÿ”ง, etc.

CalvinXKY
โญ 4,411 Jupyter Notebook ๐Ÿ‘ค CalvinXKY User ๐Ÿ• Updated 2026-09-20 ๐Ÿ“… Created 2025-11-14
29
OSU-NLP-Group/HippoRAG

[NeurIPS'24] HippoRAG is a novel RAG framework inspired by human long-term memory that enables LLMs to continuously integrate knowledge across external documents. RAG + Knowledge Graphs + Personalized PageRank.

OSU-NLP-Group
โญ 4,138 Python ๐Ÿ‘ค OSU-NLP-Group Organization ๐Ÿ• Updated 2026-10-06 ๐Ÿ“… Created 2024-05-23
30
lemony-ai/cascadeflow

Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.

lemony-ai
โญ 3,922 Python ๐Ÿ‘ค lemony-ai Organization ๐Ÿ• Updated 2026-09-25 ๐Ÿ“… Created 2025-10-24
31
PaddlePaddle/FastDeploy

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

PaddlePaddle
โญ 3,722 Python ๐Ÿ‘ค PaddlePaddle Organization ๐Ÿ• Updated 2026-09-24 ๐Ÿ“… Created 2022-06-27
32
ForceInjection/AI-fundamentals

AI Fundamentals - GPU architecture, CUDA programming, basics of large models, and knowledge related to AI Agents.

ForceInjection
โญ 3,515 HTML ๐Ÿ‘ค ForceInjection Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-09-23
33
vllm-project/vllm-ascend

Community maintained hardware plugin for vLLM on Huawei Ascend

vllm-project
โญ 3,128 Python ๐Ÿ‘ค vllm-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-01-29
34
containers/ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

containers
โญ 3,116 Python ๐Ÿ‘ค containers Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2024-07-24
35
syv-ai/HyperQwen

Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.

syv-ai
โญ 2,778 Python ๐Ÿ‘ค syv-ai Organization ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2026-08-15
36
vllm-project/production-stack

vLLMโ€™s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

vllm-project
โญ 2,729 Python ๐Ÿ‘ค vllm-project Organization ๐Ÿ• Updated 2026-11-07 ๐Ÿ“… Created 2025-01-21
37
Unakar/Logic-RL

Reproduce R1 Zero on Logic Puzzle

Unakar
โญ 2,451 Python ๐Ÿ‘ค Unakar User ๐Ÿ• Updated 2025-03-20 ๐Ÿ“… Created 2025-02-02
38
zai-org/CodeGeeX4

CodeGeeX4-ALL-9B, a versatile model for all AI software development scenarios, including code completion, code interpreter, web search, function calling, repository-level Q&A and much more.

zai-org
โญ 2,347 Python ๐Ÿ‘ค zai-org Organization ๐Ÿ• Updated 2024-08-25 ๐Ÿ“… Created 2024-07-03
39
PrimeIntellect-ai/prime-rl

Agentic RL Training at Scale

PrimeIntellect-ai
โญ 2,268 Python ๐Ÿ‘ค PrimeIntellect-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-02-18
40
cfregly/ai-performance-engineering

Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and full-stack tuning.

cfregly
โญ 2,233 Python ๐Ÿ‘ค cfregly User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2025-04-21
41
Tencent-Hunyuan/HunyuanOCR

HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better

Tencent-Hunyuan
โญ 2,091 Python ๐Ÿ‘ค Tencent-Hunyuan Organization ๐Ÿ• Updated 2026-09-24 ๐Ÿ“… Created 2025-11-18
42
SemiAnalysisAI/InferenceX

Open-Source Inference Research Platform

SemiAnalysisAI
โญ 2,074 Python ๐Ÿ‘ค SemiAnalysisAI Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-07-12
43
ovg-project/kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

ovg-project
โญ 2,051 Python ๐Ÿ‘ค ovg-project Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-05-27
45
noamgat/lm-format-enforcer

Enforce the output format (JSON Schema, Regex etc) of a language model

noamgat
โญ 2,041 Python ๐Ÿ‘ค noamgat User ๐Ÿ• Updated 2026-04-04 ๐Ÿ“… Created 2023-09-21
46
vllm-project/vllm-metal

Community maintained hardware plugin for vLLM on Apple Silicon

vllm-project
โญ 2,010 Python ๐Ÿ‘ค vllm-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-12-12
47
LeapLabTHU/Absolute-Zero-Reasoner

Official Repository of Absolute Zero Reasoner

LeapLabTHU
โญ 1,893 Python ๐Ÿ‘ค LeapLabTHU User ๐Ÿ• Updated 2025-08-24 ๐Ÿ“… Created 2025-05-02
48
sybil-solutions/local-studio

Control panel for VLLM, Sglang, llama.cpp, exllamav3

sybil-solutions
โญ 1,854 TypeScript ๐Ÿ‘ค sybil-solutions Organization ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2025-12-17
49
brevdev/launchables

Collection of notebook guides created by the Brev.dev team!

brevdev
โญ 1,819 Jupyter Notebook ๐Ÿ‘ค brevdev Organization ๐Ÿ• Updated 2026-07-21 ๐Ÿ“… Created 2023-08-14
50
BytedTsinghua-SIA/DAPO

An Open-source RL System from ByteDance Seed and Tsinghua AIR

BytedTsinghua-SIA
โญ 1,814 Python ๐Ÿ‘ค BytedTsinghua-SIA Organization ๐Ÿ• Updated 2025-05-11 ๐Ÿ“… Created 2025-03-17

Frequently Asked Questions

1

What is the most popular #vllm repository on GitHub?

The top ranked open source #vllm project on GitHub is earendil-works/pi with 123,140 stars. AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI

2

Which programming languages are most used in #vllm repositories?

Among the top ranked #vllm projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Go, TypeScript.

3

How is the #vllm repository ranking calculated?

We track 133 active open source repositories tagged with #vllm (500+ stars), totaling 554,542 stars with an average of 4,169 stars per repository. Rankings update daily from the GitHub API.