#llm-inference-serving Repositories
Discover 1 active open source GitHub repositories tagged with #llm-inference-serving, accumulating 742 total stars (averaging 742 stars per project). Leading this topic is EricLBuehler/candle-vllm with 742 stars.
1 repositories total
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
Frequently Asked Questions
What is the most popular #llm-inference-serving repository on GitHub?
The top ranked open source #llm-inference-serving project on GitHub is EricLBuehler/candle-vllm with 742 stars. Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
Which programming languages are most used in #llm-inference-serving repositories?
Among the top ranked #llm-inference-serving projects on GitHub, the most common programming languages are Rust.
How is the #llm-inference-serving repository ranking calculated?
We track 1 active open source repositories tagged with #llm-inference-serving (500+ stars), totaling 742 stars with an average of 742 stars per repository. Rankings update daily from the GitHub API.