#llm-gateway Repositories
Discover 32 active open source GitHub repositories tagged with #llm-gateway, accumulating 404,707 total stars (averaging 12,647 stars per project). Leading this topic is cheaper-inference/OmniRoute with 89,311 stars.
32 repositories total
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models: Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15โ95% of tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.
๐ชข Open-source AI engineering platform: AI Gateway, agent observability, evaluations, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.
Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200ยตs of overhead at 5k RPS.
๐ Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.
Self-hosted AI gateway for multi-channel, multi-credential setups โ API keys and subscription accounts, scheduling, failover, request logs, and usage.
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
Agent of Discord conversation Coze-Bot, realizing the request of the GPT4 model in API form, providing functions such as dialogue, text-to-image generation, image-to-text generation, and knowledge base retrieval.
Cloud native, ultra-high performance AI&API gateway, LLM API management, distribution system, open platform, supporting all AI APIs. Not limited to mainstream models such as OpenAI, Azure, Anthropic Claude, Google Gemini, DeepSeek, ByteDance Doubao, ChatGLM, Baidu Wenxin Yiyan, iFlytek Spark, Alibaba Tongyi Qianwen, 360 Zhinao, Tencent Hunyuan, unified API requests and responses, API application and approval, call statistics, load balancing, multi-model disaster recovery. One-click deployment, ready to use.
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Non-destructive compression gateway for AI coding agents. Cuts token bills 25% on turn 1 to past 85% in long or saturated sessions, and fits ~3ร more turns in the same context window. Powered by our open-source code-native 4B model. Drop-in for Claude Code, Cursor, Codex, OpenHands, and any BASE_URL agent.
AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.
An AI chat bot for small and medium-sized teams, supporting models such as Deepseek, Open AI, Claude, and Gemini. ไธไธบไธญๅฐๅข้่ฎพ่ฎก็ AI ่ๅคฉๅบ็จ๏ผๆฏๆ DeepseekใOpen AIใClaudeใGemini ็ญๆจกๅใ
Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini, and every other vendor. Any SDK, any model, any tool.
Gemini web โ OpenAI-compatible + native Gemini API, self-hosted, no API key. Gemini 4 Argon from a paid account cookie, strict_model (429 instead of a silent downgrade), cookie pool with auto-renewal, proxy pool, admin panel, image & video generation, single Go binary ยท Reverse-proxy the Gemini website as an OpenAI-compatible / native Gemini API; use Gemini 4 Argon directly with a cookie from a paid account.
Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.
Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.
Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call guards, rate limits, budgets, cost accounting and audit logs.
Source-available LLM router and AI cost optimizer. Routes simple prompts to cheap or local models and complex ones to premium models, automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor and OpenClaw. Self-hosted, no middleman.
See what every AI coding agent on your machine is doing, and whether the API behind it is the one you paid for. Claude Code, Codex, Cursor, Gemini CLI and more: one endpoint for 44 model vendors, AโF API authenticity grading, per-agent permissions, usage and prompt records.
Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.
๐ท๏ธ The fastest open-source AI Gateway and LLM Gateway โ one binary with a built-in console to route, secure, budget, and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock, and more.
Frequently Asked Questions
What is the most popular #llm-gateway repository on GitHub?
The top ranked open source #llm-gateway project on GitHub is cheaper-inference/OmniRoute with 89,311 stars. Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models: Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15โ95% of tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors
Which programming languages are most used in #llm-gateway repositories?
Among the top ranked #llm-gateway projects on GitHub, the most common programming languages are Go, TypeScript, Rust, Python.
How is the #llm-gateway repository ranking calculated?
We track 32 active open source repositories tagged with #llm-gateway (500+ stars), totaling 404,707 stars with an average of 12,647 stars per repository. Rankings update daily from the GitHub API.