#vllm Repositories
Discover 133 active open source GitHub repositories tagged with #vllm, accumulating 554,542 total stars (averaging 4,169 stars per project). Leading this topic is earendil-works/pi with 123,140 stars.
134 repositories total
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
Android in Docker solution with noVNC support, video recording, an MCP server, and an AI agent
Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research.
โ๐ป Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field: Source Code Analysis, System Design & Engineering Practice Notes
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
Learn LLM inference systems on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL
๐A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.๐
Structured data extraction, instruction calling and agentic workflows with ML, LLM and Vision LLM
Sharing AI Infra knowledge & code practice: PyTorch, vLLM/SGLang, slime/vime framework introduction โก๏ธ, performance acceleration ๐, large model basics ๐ง , AI software and hardware ๐ง, etc.
[NeurIPS'24] HippoRAG is a novel RAG framework inspired by human long-term memory that enables LLMs to continuously integrate knowledge across external documents. RAG + Knowledge Graphs + Personalized PageRank.
Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
AI Fundamentals - GPU architecture, CUDA programming, basics of large models, and knowledge related to AI Agents.
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
vLLMโs reference system for K8S-native cluster-wide deployment with community-driven performance optimization
CodeGeeX4-ALL-9B, a versatile model for all AI software development scenarios, including code completion, code interpreter, web search, function calling, repository-level Q&A and much more.
Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and full-stack tuning.
Enforce the output format (JSON Schema, Regex etc) of a language model
Frequently Asked Questions
What is the most popular #vllm repository on GitHub?
The top ranked open source #vllm project on GitHub is earendil-works/pi with 123,140 stars. AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI
Which programming languages are most used in #vllm repositories?
Among the top ranked #vllm projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Go, TypeScript.
How is the #vllm repository ranking calculated?
We track 133 active open source repositories tagged with #vllm (500+ stars), totaling 554,542 stars with an average of 4,169 stars per repository. Rankings update daily from the GitHub API.