Git Stars Git Stars

#llm-gateway Repositories

Discover 32 active open source GitHub repositories tagged with #llm-gateway, accumulating 404,707 total stars (averaging 12,647 stars per project). Leading this topic is cheaper-inference/OmniRoute with 89,311 stars.

32
Total Repositories
404,707
Total Stars
12,647
Avg Stars/Repo
1
cheaper-inference/OmniRoute

Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models: Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15โ€“95% of tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors

cheaper-inference
โญ 89,311 TypeScript ๐Ÿ‘ค cheaper-inference Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-13
2
BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

BerriAI
โญ 63,649 Python ๐Ÿ‘ค BerriAI Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-07-27
3
QuantumNous/new-api

Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.

QuantumNous
โญ 52,302 Go ๐Ÿ‘ค QuantumNous Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-11-10
4
Kong/kong

๐Ÿฆ The API and AI Gateway

Kong
โญ 44,403 Lua ๐Ÿ‘ค Kong Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2014-11-17
5
langfuse/langfuse

๐Ÿชข Open-source AI engineering platform: AI Gateway, agent observability, evaluations, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.

langfuse
โญ 37,696 TypeScript ๐Ÿ‘ค langfuse Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-05-18
6
decolua/9router

Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

decolua
โญ 32,693 JavaScript ๐Ÿ‘ค decolua User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-01-05
7
Portkey-AI/gateway

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Portkey-AI
โญ 13,424 TypeScript ๐Ÿ‘ค Portkey-AI Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-08-23
8
TykTechnologies/tyk

Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)

TykTechnologies
โญ 10,897 Go ๐Ÿ‘ค TykTechnologies Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2014-05-07
9
maximhq/bifrost

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200ยตs of overhead at 5k RPS.

maximhq
โญ 9,886 Go ๐Ÿ‘ค maximhq Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-03-19
10
coaidev/coai

๐Ÿš€ Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.

coaidev
โญ 9,343 TypeScript ๐Ÿ‘ค coaidev Organization ๐Ÿ• Updated 2026-03-12 ๐Ÿ“… Created 2023-07-17
11
tbphp/gpt-load

Self-hosted AI gateway for multi-channel, multi-credential setups โ€” API keys and subscription accounts, scheduling, failover, request logs, and usage.

tbphp
โญ 7,241 Go ๐Ÿ‘ค tbphp User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-06-06
12
katanemo/plano

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

katanemo
โญ 7,118 Rust ๐Ÿ‘ค katanemo Organization ๐Ÿ• Updated 2026-10-24 ๐Ÿ“… Created 2024-07-09
13
deanxv/coze-discord-proxy

Agent of Discord conversation Coze-Bot, realizing the request of the GPT4 model in API form, providing functions such as dialogue, text-to-image generation, image-to-text generation, and knowledge base retrieval.

deanxv
โญ 3,768 Go ๐Ÿ‘ค deanxv User ๐Ÿ• Updated 2026-02-22 ๐Ÿ“… Created 2024-01-26
15
bestruirui/octopus

One Hub All LLMs For You | The LLM API aggregation gateway for individuals

bestruirui
โญ 2,750 TypeScript ๐Ÿ‘ค bestruirui User ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2025-11-18
16
APIParkLab/APIPark

Cloud native, ultra-high performance AI&API gateway, LLM API management, distribution system, open platform, supporting all AI APIs. Not limited to mainstream models such as OpenAI, Azure, Anthropic Claude, Google Gemini, DeepSeek, ByteDance Doubao, ChatGLM, Baidu Wenxin Yiyan, iFlytek Spark, Alibaba Tongyi Qianwen, 360 Zhinao, Tencent Hunyuan, unified API requests and responses, API application and approval, call statistics, load balancing, multi-model disaster recovery. One-click deployment, ready to use.

APIParkLab
โญ 1,825 TypeScript ๐Ÿ‘ค APIParkLab Organization ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2024-08-12
17
theopenco/llmgateway

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

theopenco
โญ 1,755 TypeScript ๐Ÿ‘ค theopenco Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-04-12
18
Paritok-official/paritok-4b-v1

Non-destructive compression gateway for AI coding agents. Cuts token bills 25% on turn 1 to past 85% in long or saturated sessions, and fits ~3ร— more turns in the same context window. Powered by our open-source code-native 4B model. Drop-in for Claude Code, Cursor, Codex, OpenHands, and any BASE_URL agent.

Paritok-official
โญ 1,439 Python ๐Ÿ‘ค Paritok-official Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2026-07-15
19
ENTERPILOT/GoModel

AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.

ENTERPILOT
โญ 1,323 Go ๐Ÿ‘ค ENTERPILOT Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-12-05
20
HiveNexus/HiveChat

An AI chat bot for small and medium-sized teams, supporting models such as Deepseek, Open AI, Claude, and Gemini. ไธ“ไธบไธญๅฐๅ›ข้˜Ÿ่ฎพ่ฎก็š„ AI ่Šๅคฉๅบ”็”จ๏ผŒๆ”ฏๆŒ Deepseekใ€Open AIใ€Claudeใ€Gemini ็ญ‰ๆจกๅž‹ใ€‚

HiveNexus
โญ 1,186 TypeScript ๐Ÿ‘ค HiveNexus Organization ๐Ÿ• Updated 2025-09-16 ๐Ÿ“… Created 2025-02-19
21
Deep-ai-inc/ch.at

Universal Basic Chat

Deep-ai-inc
โญ 1,132 Go ๐Ÿ‘ค Deep-ai-inc Organization ๐Ÿ• Updated 2026-10-14 ๐Ÿ“… Created 2025-06-18
22
respanai/respan-gateway

Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini, and every other vendor. Any SDK, any model, any tool.

respanai
โญ 975 Rust ๐Ÿ‘ค respanai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-09-25
23
zexadev/gemini-web2api-go

Gemini web โ†’ OpenAI-compatible + native Gemini API, self-hosted, no API key. Gemini 4 Argon from a paid account cookie, strict_model (429 instead of a silent downgrade), cookie pool with auto-renewal, proxy pool, admin panel, image & video generation, single Go binary ยท Reverse-proxy the Gemini website as an OpenAI-compatible / native Gemini API; use Gemini 4 Argon directly with a cookie from a paid account.

zexadev
โญ 974 Go ๐Ÿ‘ค zexadev User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-05-29
24
mozilla-ai/otari

Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

mozilla-ai
โญ 959 Python ๐Ÿ‘ค mozilla-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-02
25
ThinkWatchProject/ThinkWatch-Lite

Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.

ThinkWatchProject
โญ 946 TypeScript ๐Ÿ‘ค ThinkWatchProject Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-09-12
26
laravel/mcp

Rapidly build MCP servers for your Laravel applications.

laravel
โญ 875 PHP ๐Ÿ‘ค laravel Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-05-15
27
ThinkWatchProject/ThinkWatch

Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call guards, rate limits, budgets, cost accounting and audit logs.

ThinkWatchProject
โญ 817 Rust ๐Ÿ‘ค ThinkWatchProject Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-02
28
vllora/vllora

Debug your AI agents

vllora
โญ 810 Rust ๐Ÿ‘ค vllora Organization ๐Ÿ• Updated 2026-06-30 ๐Ÿ“… Created 2025-01-27
29
NadirRouter/NadirClaw

Source-available LLM router and AI cost optimizer. Routes simple prompts to cheap or local models and complex ones to premium models, automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor and OpenClaw. Self-hosted, no middleman.

NadirRouter
โญ 666 Python ๐Ÿ‘ค NadirRouter Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-02-11
30
apache/casbin-gateway

See what every AI coding agent on your machine is doing, and whether the API behind it is the one you paid for. Claude Code, Codex, Cursor, Gemini CLI and more: one endpoint for 44 model vendors, Aโ€“F API authenticity grading, per-agent permissions, usage and prompt records.

apache
โญ 650 Go ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-10-31 ๐Ÿ“… Created 2017-05-13
31
Fast-Editor/Lynkr

Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.

Fast-Editor
โญ 642 JavaScript ๐Ÿ‘ค Fast-Editor Organization ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2025-12-03
32
eliasbiondo/antirion

๐Ÿ•ท๏ธ The fastest open-source AI Gateway and LLM Gateway โ€” one binary with a built-in console to route, secure, budget, and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock, and more.

eliasbiondo
โญ 539 Rust ๐Ÿ‘ค eliasbiondo User ๐Ÿ• Updated 2026-10-31 ๐Ÿ“… Created 2026-10-17

Frequently Asked Questions

1

What is the most popular #llm-gateway repository on GitHub?

The top ranked open source #llm-gateway project on GitHub is cheaper-inference/OmniRoute with 89,311 stars. Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models: Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15โ€“95% of tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors

2

Which programming languages are most used in #llm-gateway repositories?

Among the top ranked #llm-gateway projects on GitHub, the most common programming languages are Go, TypeScript, Rust, Python.

3

How is the #llm-gateway repository ranking calculated?

We track 32 active open source repositories tagged with #llm-gateway (500+ stars), totaling 404,707 stars with an average of 12,647 stars per repository. Rankings update daily from the GitHub API.