Git Stars Git Stars

#llm-inference-serving Repositories

Discover 1 active open source GitHub repositories tagged with #llm-inference-serving, accumulating 742 total stars (averaging 742 stars per project). Leading this topic is EricLBuehler/candle-vllm with 742 stars.

1
Total Repositories
742
Total Stars
742
Avg Stars/Repo
Programming Languages: Rust

1 repositories total

1
EricLBuehler/candle-vllm

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

EricLBuehler
⭐ 742 Rust 👤 EricLBuehler User 🕐 Updated 2026-10-18 📅 Created 2023-10-29

Frequently Asked Questions

1

What is the most popular #llm-inference-serving repository on GitHub?

The top ranked open source #llm-inference-serving project on GitHub is EricLBuehler/candle-vllm with 742 stars. Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

2

Which programming languages are most used in #llm-inference-serving repositories?

Among the top ranked #llm-inference-serving projects on GitHub, the most common programming languages are Rust.

3

How is the #llm-inference-serving repository ranking calculated?

We track 1 active open source repositories tagged with #llm-inference-serving (500+ stars), totaling 742 stars with an average of 742 stars per repository. Rankings update daily from the GitHub API.