#serving Repositories
Discover 17 active open source GitHub repositories tagged with #serving, accumulating 90,023 total stars (averaging 5,295 stars per project). Leading this topic is ray-project/ray with 44,352 stars.
17 repositories total
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Learn LLM inference systems on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
In this repository, I will share some useful notes and references about deploying deep learning-based models in production.
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
A comprehensive guide to building RAG-based LLM applications for production.
A multi-modal vector database that supports upserts and vector queries using unified SQL (MySQL-Compatible) on structured and unstructured data, while meeting the requirements of high concurrency and ultra-low latency.
The backend agents build with - Multimodal database, orchestration, and serving in one file
DELTA is a deep learning based natural language and speech processing platform. LF AI & DATA Projects: https://lfaidata.foundation/projects/delta/
A flexible, high-performance carrier for machine learning models (ใ้ฃๆกจใ Servitization Deployment Framework)
Generic and easy-to-use serving service for machine learning models
A high-performance inference system for large language models, designed for production environments.
Frequently Asked Questions
What is the most popular #serving repository on GitHub?
The top ranked open source #serving project on GitHub is ray-project/ray with 44,352 stars. Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Which programming languages are most used in #serving repositories?
Among the top ranked #serving projects on GitHub, the most common programming languages are Python, C++, Go, Jupyter Notebook.
How is the #serving repository ranking calculated?
We track 17 active open source repositories tagged with #serving (500+ stars), totaling 90,023 stars with an average of 5,295 stars per repository. Rankings update daily from the GitHub API.