#ai-infrastructure Repositories
Discover 27 active open source GitHub repositories tagged with #ai-infrastructure, accumulating 87,587 total stars (averaging 3,243 stars per project). Leading this topic is semantica-agi/semantica with 14,701 stars.
27 repositories total
ใIn-Depth Understanding of AI Infrastructure: Quantitative Analysis and System Designใ (by Li Bojie), an open-source book manuscript: Starting from hardware constraints and model architectures, it quantitatively derives the design of LLM inference and training systems. Includes the full text, PDF, accompanying computational tools, and experiments.
Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
Self-hosted, open-source agent skill registry for enterprises. Publish & version skill packages, govern with RBAC and audit logs, deploy on-premise with Docker or Kubernetes.
Local persistent memory store for LLM applications including claude desktop, github copilot, codex, antigravity, etc.
HarnessRouter Community Edition: the self-hosted, Apache-2.0 edition of the unified interface for agent harnesses. Run Codex, Claude Code, Hermes, PI, DSH, and more through one API, with sessions, streaming, files, cancellation, and failure handling. Implements the Unified Harness Protocol (UHP), an open standard. Your keys, your infrastructure.
The open-source managed agent platform. A self-hostable alternative to Claude Managed Agents and OpenAI's Agents API.
14-stage Fusion Pipeline for LLM token compression โ reversible compression, AST-aware code analysis, intelligent content routing. Zero LLM inference cost. MIT licensed.
AI Infrastructure Engineer Learning Track - Production ML infrastructure curriculum (2-4 years experience)
Colivara is a suite of services that allows you to store, search, and retrieve documents based on their visual embedding. ColiVara has state of the art retrieval performance on both text and visual documents. using vision models instead of chunking and text-processing for documents. No OCR, no text extraction, no broken tables, or missing images.
Non-destructive compression gateway for AI coding agents. Cuts token bills 25% on turn 1 to past 85% in long or saturated sessions, and fits ~3ร more turns in the same context window. Powered by our open-source code-native 4B model. Drop-in for Claude Code, Cursor, Codex, OpenHands, and any BASE_URL agent.
AipexBase is an AI-native BaaS platform. You only need to develop the frontend with vibe coding tools, and leave the backend to AipexBase!
GigaModels: A Comprehensive Repository and Platform for Multi-modal, Generative, and Perceptual Models
Tensorlake is a serverless runtime for sandboxes and deploying background agentic applications
PGBoxDB โ Lightweight Postgres for AI agents. Written in Rust. Thousands of isolated databases in one runtime ๐
ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale
Local-first, self-hosted AI agent runtime and MCP bridge with sandboxed sessions, memory, credentials, audit/replay, and a local Console.
OpenAI interface aggregation management, we are committed to providing high-quality API access services, allowing you to easily integrate advanced AI models into your products and services.
OpenAIOS vGPU device plugin for Kubernetes is originated from the OpenAIOS project to virtualize GPU device memory, in order to allow applications to access larger memory space than its physical capacity. It is designed for ease of use of extended device memory for AI workloads.
Caura (formerly MemClaw) โ governed shared memory for AI agent fleets. Multi-agent, multi-tenant, MCP-native. Trust tiers, keystone policies, audit trails, knowledge graph, self-improving retrieval. Apache 2.0.
Frequently Asked Questions
What is the most popular #ai-infrastructure repository on GitHub?
The top ranked open source #ai-infrastructure project on GitHub is semantica-agi/semantica with 14,701 stars. Graph-Native Semantic Layer for Trustworthy Enterprise AI
Which programming languages are most used in #ai-infrastructure repositories?
Among the top ranked #ai-infrastructure projects on GitHub, the most common programming languages are Python, Java, TypeScript, Go.
How is the #ai-infrastructure repository ranking calculated?
We track 27 active open source repositories tagged with #ai-infrastructure (500+ stars), totaling 87,587 stars with an average of 3,243 stars per repository. Rankings update daily from the GitHub API.