Git Stars Git Stars

#ai-gateway Repositories

Discover 55 active open source GitHub repositories tagged with #ai-gateway, accumulating 539,244 total stars (averaging 9,804 stars per project). Leading this topic is cheaper-inference/OmniRoute with 89,311 stars.

55
Total Repositories
539,244
Total Stars
9,804
Avg Stars/Repo
1
cheaper-inference/OmniRoute

Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models: Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15โ€“95% of tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors

cheaper-inference
โญ 89,311 TypeScript ๐Ÿ‘ค cheaper-inference Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-13
2
BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

BerriAI
โญ 63,649 Python ๐Ÿ‘ค BerriAI Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-07-27
3
QuantumNous/new-api

Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.

QuantumNous
โญ 52,302 Go ๐Ÿ‘ค QuantumNous Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-11-10
4
Kong/kong

๐Ÿฆ The API and AI Gateway

Kong
โญ 44,403 Lua ๐Ÿ‘ค Kong Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2014-11-17
5
langfuse/langfuse

๐Ÿชข Open-source AI engineering platform: AI Gateway, agent observability, evaluations, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.

langfuse
โญ 37,696 TypeScript ๐Ÿ‘ค langfuse Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-05-18
6
decolua/9router

Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

decolua
โญ 32,693 JavaScript ๐Ÿ‘ค decolua User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-01-05
7
fosrl/pangolin

Modern networking and security platform providing secure access and connectivity to apps, infrastructure, and AI workloads. Connect and protect your users.

fosrl
โญ 23,921 TypeScript ๐Ÿ‘ค fosrl Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-09-27
8
lidge-jun/opencodex

Universal provider proxy for OpenAI Codex & Claude Code โ€” use any LLM (Claude, Gemini, Grok, DeepSeek, Ollamaโ€ฆ) with Codex CLI, App, SDK, and Claude Code

lidge-jun
โญ 18,693 TypeScript ๐Ÿ‘ค lidge-jun User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-06-18
9
apache/apisix

The Cloud-Native API Gateway and AI Gateway

apache
โญ 17,356 Lua ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2019-04-10
10
casdoor/casdoor

An open-source Agent-first Identity and Access Management (IAM) /LLM MCP & agent gateway and auth server with web UI supporting OpenClaw, MCP, OAuth, OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, TOTP, MFA, Face ID, Google Workspace, Azure AD

casdoor
โญ 14,918 Go ๐Ÿ‘ค casdoor Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-10-22
11
Portkey-AI/gateway

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Portkey-AI
โญ 13,424 TypeScript ๐Ÿ‘ค Portkey-AI Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-08-23
12
TykTechnologies/tyk

Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)

TykTechnologies
โญ 10,897 Go ๐Ÿ‘ค TykTechnologies Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2014-05-07
13
maximhq/bifrost

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200ยตs of overhead at 5k RPS.

maximhq
โญ 9,886 Go ๐Ÿ‘ค maximhq Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-03-19
14
higress-group/higress

๐Ÿค– AI Gateway | AI Native API Gateway

higress-group
โญ 9,807 Go ๐Ÿ‘ค higress-group Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2022-10-27
15
coaidev/coai

๐Ÿš€ Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.

coaidev
โญ 9,343 TypeScript ๐Ÿ‘ค coaidev Organization ๐Ÿ• Updated 2026-03-12 ๐Ÿ“… Created 2023-07-17
16
tbphp/gpt-load

Self-hosted AI gateway for multi-channel, multi-credential setups โ€” API keys and subscription accounts, scheduling, failover, request logs, and usage.

tbphp
โญ 7,241 Go ๐Ÿ‘ค tbphp User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-06-06
17
katanemo/plano

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

katanemo
โญ 7,118 Rust ๐Ÿ‘ค katanemo Organization ๐Ÿ• Updated 2026-10-24 ๐Ÿ“… Created 2024-07-09
18
vllm-project/semantic-router

An open, programmable decision layer for models and compute.

vllm-project
โญ 6,514 Go ๐Ÿ‘ค vllm-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-08-26
19
agentgateway/agentgateway

Next Generation Agentic Proxy for AI Agents and MCP servers

agentgateway
โญ 6,343 Rust ๐Ÿ‘ค agentgateway Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-03-18
20
weave-os/router

Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just an endpoint change.

weave-os
โญ 5,625 Go ๐Ÿ‘ค weave-os Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-27
21
octelium/octelium

A next-gen FOSS self-hosted unified zero trust secure access platform that can operate as a remote access VPN, a ZTNA platform, API/AI/MCP gateway, a PaaS, an ngrok-alternative and a homelab infrastructure.

octelium
โญ 4,198 Go ๐Ÿ‘ค octelium Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-05-18
22
seakee/CPA-Manager-Plus

A self-hosted CPA / CLIProxyAPI management panel and AI gateway observability dashboard for requests, usage, cost, quota, failures, and account health.

seakee
โญ 4,099 Go ๐Ÿ‘ค seakee User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-05-17
23
nextlevelbuilder/goclaw

GoClaw - GoClaw is OpenClaw rebuilt in Go โ€” with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety.

nextlevelbuilder
โญ 3,723 Go ๐Ÿ‘ค nextlevelbuilder Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-02-22
24
justlovemaki/openclaw-china-docker

OpenClaw's Docker-integrated version for Chinese IM platforms comes pre-installed and configured with plugins for mainstream Chinese IM software such as Feishu, DingTalk, QQ Bots, and Enterprise WeChat, enabling you to quickly deploy an AI bot gateway that supports multiple Chinese IM platforms.

justlovemaki
โญ 3,701 Shell ๐Ÿ‘ค justlovemaki User ๐Ÿ• Updated 2026-04-14 ๐Ÿ“… Created 2026-02-01
25
Continuum-AI-Corp/OrcaRouter-Lite

Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter

Continuum-AI-Corp
โญ 2,990 Python ๐Ÿ‘ค Continuum-AI-Corp Organization ๐Ÿ• Updated 2026-10-08 ๐Ÿ“… Created 2026-05-03
26
kaitranntt/ccs

Switch between Claude accounts, Gemini, Copilot, OpenRouter (300+ models) via CLIProxyAPI OAuth proxy. Visual dashboard, remote proxy support, WebSearch fallback. Zero-config to production-ready.

kaitranntt
โญ 2,907 TypeScript ๐Ÿ‘ค kaitranntt User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2025-11-01
27
bestruirui/octopus

One Hub All LLMs For You | The LLM API aggregation gateway for individuals

bestruirui
โญ 2,750 TypeScript ๐Ÿ‘ค bestruirui User ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2025-11-18
28
krakend/krakend-ce

KrakenD Community Edition: High-performance, stateless, declarative, API Gateway written in Go.

krakend
โญ 2,703 Go ๐Ÿ‘ค krakend Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2017-12-03
29
theagentrouter/agent-router

Manages Unified Access to Generative AI Services built on Envoy Gateway

theagentrouter
โญ 2,428 Go ๐Ÿ‘ค theagentrouter Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2024-10-21
30
future-agi/future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing ยท Evals ยท Simulations ยท Datasets ยท Gateway ยท Guardrails. Self-hostable. Apache 2.0.

future-agi
โญ 2,284 Python ๐Ÿ‘ค future-agi Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-23
31
numman-ali/cc-mirror

Create multiple isolated Claude Code variants with custom providers (Z.ai, MiniMax, OpenRouter, LiteLLM)

numman-ali
โญ 2,258 TypeScript ๐Ÿ‘ค numman-ali User ๐Ÿ• Updated 2026-05-31 ๐Ÿ“… Created 2026-01-02
32
APIParkLab/APIPark

Cloud native, ultra-high performance AI&API gateway, LLM API management, distribution system, open platform, supporting all AI APIs. Not limited to mainstream models such as OpenAI, Azure, Anthropic Claude, Google Gemini, DeepSeek, ByteDance Doubao, ChatGLM, Baidu Wenxin Yiyan, iFlytek Spark, Alibaba Tongyi Qianwen, 360 Zhinao, Tencent Hunyuan, unified API requests and responses, API application and approval, call statistics, load balancing, multi-model disaster recovery. One-click deployment, ready to use.

APIParkLab
โญ 1,825 TypeScript ๐Ÿ‘ค APIParkLab Organization ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2024-08-12
33
theopenco/llmgateway

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

theopenco
โญ 1,755 TypeScript ๐Ÿ‘ค theopenco Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-04-12
34
astaxie/TokenHub

TokenHub gives enterprises a private gateway to unify AI model access and governance, making every request controllable, traceable, and attributable.

astaxie
โญ 1,450 Go ๐Ÿ‘ค astaxie User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-06-10
35
LiteLLM-Labs/litellm-agent-control-plane

1 place to call all your agents - OpenCode, Hermes, Claude Managed Agents, Cursor Agents API, DeepAgents.

LiteLLM-Labs
โญ 1,335 Rust ๐Ÿ‘ค LiteLLM-Labs Organization ๐Ÿ• Updated 2026-10-24 ๐Ÿ“… Created 2026-05-07
36
ENTERPILOT/GoModel

AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.

ENTERPILOT
โญ 1,323 Go ๐Ÿ‘ค ENTERPILOT Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-12-05
โญ 1,222 TypeScript ๐Ÿ‘ค cloudflare Organization ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2025-03-14
38
nejib1/Free-LLM

74 free LLM API providers & 450+ free models (limits, no-card options) + Free-LLM Router: all of them behind one OpenAI/Anthropic-compatible endpoint with instant failover. Run Claude Code, Codex, Cursor, Aider on free models. Gemini, Groq, Mistral, DeepSeek, Qwen & more. Synced daily.

nejib1
โญ 1,079 JavaScript ๐Ÿ‘ค nejib1 User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-13
39
kittors/CliRelay

Self-hosted AI gateway for coding CLIs โ€” one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas.

kittors
โญ 1,063 Go ๐Ÿ‘ค kittors User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-27
40
w8123/EnterpriseAgentFramework

ReachAI Enterprise AI Agent Development Platform: Quickly and securely modernize existing business systems with AI, enabling AI to query data, fill out forms, and handle business tasks directly within OA, ERP, CRM, and other existing business applications.

w8123
โญ 1,057 Java ๐Ÿ‘ค w8123 User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-04-02
41
beizhu-1209/AIHelms

Enterprise-grade AI resource management platform, providing unified AI gateway and token scheduling capabilities, managing mainstream models such as OpenAI, Azure, Claude, and DeepSeek, and supporting centralized registration and distribution of MCP tools and Skills. It features dual-track pricing for internal and external use, cost attribution, unified identity authentication, security auditing, and efficiency reports, helping enterprises precisely control costs, quantify ROI, and efficiently govern AI assets.

beizhu-1209
โญ 1,038 Python ๐Ÿ‘ค beizhu-1209 User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-05-09
42
respanai/respan-gateway

Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini, and every other vendor. Any SDK, any model, any tool.

respanai
โญ 975 Rust ๐Ÿ‘ค respanai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-09-25
43
mozilla-ai/otari

Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

mozilla-ai
โญ 959 Python ๐Ÿ‘ค mozilla-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-02
44
ThinkWatchProject/ThinkWatch-Lite

Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.

ThinkWatchProject
โญ 946 TypeScript ๐Ÿ‘ค ThinkWatchProject Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-09-12
45
gotempsh/temps

AI-native open-source alternative to Vercel + Sentry + PostHog + Pingdom + Resend + E2B. 440+ CLI operations with drop-in skills for Claude Code, Codex & OpenCode โ€” deployments, analytics, session replay, error tracking, OpenTelemetry, email, sandboxes & AI gateway in one self-hosted Rust binary.

gotempsh
โญ 939 Rust ๐Ÿ‘ค gotempsh Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-10-21
46
AQBot-Desktop/AQBot

โ˜๏ธ Lightweight, high-performance cross-platform AI dialogue + AI Agent + AI gateway desktop client

AQBot-Desktop
โญ 927 Rust ๐Ÿ‘ค AQBot-Desktop Organization ๐Ÿ• Updated 2026-10-31 ๐Ÿ“… Created 2026-03-24
47
MaySudo/Misceo

Local Anthropic-compatible AI gateway with cheap-first routing, quality gates, safe model handoffs, and an embedded cost dashboard.

MaySudo
โญ 848 ๐Ÿ‘ค MaySudo User ๐Ÿ• Updated 2026-08-03 ๐Ÿ“… Created 2026-07-18
48
ThinkWatchProject/ThinkWatch

Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call guards, rate limits, budgets, cost accounting and audit logs.

ThinkWatchProject
โญ 817 Rust ๐Ÿ‘ค ThinkWatchProject Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-02
49
vllora/vllora

Debug your AI agents

vllora
โญ 810 Rust ๐Ÿ‘ค vllora Organization ๐Ÿ• Updated 2026-06-30 ๐Ÿ“… Created 2025-01-27
50
apache/casbin-gateway

See what every AI coding agent on your machine is doing, and whether the API behind it is the one you paid for. Claude Code, Codex, Cursor, Gemini CLI and more: one endpoint for 44 model vendors, Aโ€“F API authenticity grading, per-agent permissions, usage and prompt records.

apache
โญ 650 Go ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-10-31 ๐Ÿ“… Created 2017-05-13

Frequently Asked Questions

1

What is the most popular #ai-gateway repository on GitHub?

The top ranked open source #ai-gateway project on GitHub is cheaper-inference/OmniRoute with 89,311 stars. Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models: Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15โ€“95% of tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors

2

Which programming languages are most used in #ai-gateway repositories?

Among the top ranked #ai-gateway projects on GitHub, the most common programming languages are Go, TypeScript, Rust, Python.

3

How is the #ai-gateway repository ranking calculated?

We track 55 active open source repositories tagged with #ai-gateway (500+ stars), totaling 539,244 stars with an average of 9,804 stars per repository. Rankings update daily from the GitHub API.