Git Stars Git Stars

#llm-inference Repositories

202
Total Repositories
1.0M
Total Stars
5,180
Avg Stars/Repo
Programming Languages: Python C++

202 repositories total

201
Chen-zexi/vllm-cli

A command-line interface tool for serving LLM using vLLM.

Chen-zexi
⭐ 507 Python 👤 Chen-zexi User 🕐 Updated 2026-01-25 📅 Created 2025-08-14
202
vectorch-ai/ScaleLLM

A high-performance inference system for large language models, designed for production environments.

vectorch-ai
⭐ 502 C++ 👤 vectorch-ai Organization 🕐 Updated 2025-12-19 📅 Created 2023-07-24