Git Stars Git Stars

#ai-infrastructure Repositories

Discover 27 active open source GitHub repositories tagged with #ai-infrastructure, accumulating 87,587 total stars (averaging 3,243 stars per project). Leading this topic is semantica-agi/semantica with 14,701 stars.

27
Total Repositories
87,587
Total Stars
3,243
Avg Stars/Repo
1
semantica-agi/semantica

Graph-Native Semantic Layer for Trustworthy Enterprise AI

semantica-agi
โญ 14,701 Python ๐Ÿ‘ค semantica-agi Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-06-25
2
bojieli/ai-infra-book

ใ€ŠIn-Depth Understanding of AI Infrastructure: Quantitative Analysis and System Designใ€‹ (by Li Bojie), an open-source book manuscript: Starting from hardware constraints and model architectures, it quantitatively derives the design of LLM inference and training systems. Includes the full text, PDF, accompanying computational tools, and experiments.

bojieli
โญ 8,179 Python ๐Ÿ‘ค bojieli User ๐Ÿ• Updated 2026-10-01 ๐Ÿ“… Created 2026-08-22
3
deepseek-ai/open-infra-index

Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation

deepseek-ai
โญ 8,007 ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2025-05-15 ๐Ÿ“… Created 2025-02-21
4
airweave-ai/airweave

Open-source context retrieval layer for AI agents

airweave-ai
โญ 6,568 Python ๐Ÿ‘ค airweave-ai Organization ๐Ÿ• Updated 2026-06-05 ๐Ÿ“… Created 2024-12-24
5
agiresearch/AIOS

AIOS: AI Agent Operating System

agiresearch
โญ 6,568 Python ๐Ÿ‘ค agiresearch Organization ๐Ÿ• Updated 2026-07-20 ๐Ÿ“… Created 2024-01-15
6
sgl-project/mini-sglang

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

sgl-project
โญ 5,623 Python ๐Ÿ‘ค sgl-project Organization ๐Ÿ• Updated 2026-05-17 ๐Ÿ“… Created 2025-09-01
7
iflytek/skillhub

Self-hosted, open-source agent skill registry for enterprises. Publish & version skill packages, govern with RBAC and audit logs, deploy on-premise with Docker or Kubernetes.

iflytek
โญ 5,437 Java ๐Ÿ‘ค iflytek Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-03-11
8
CaviraOSS/LongMemory

Local persistent memory store for LLM applications including claude desktop, github copilot, codex, antigravity, etc.

CaviraOSS
โญ 4,585 TypeScript ๐Ÿ‘ค CaviraOSS Organization ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2025-10-19
9
HarnessRouter/harnessrouter

HarnessRouter Community Edition: the self-hosted, Apache-2.0 edition of the unified interface for agent harnesses. Run Codex, Claude Code, Hermes, PI, DSH, and more through one API, with sessions, streaming, files, cancellation, and failure handling. Implements the Unified Harness Protocol (UHP), an open standard. Your keys, your infrastructure.

HarnessRouter
โญ 4,395 Python ๐Ÿ‘ค HarnessRouter Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-08-09
10
omnara-ai/omnara

The open-source managed agent platform. A self-hostable alternative to Claude Managed Agents and OpenAI's Agents API.

omnara-ai
โญ 3,429 Go ๐Ÿ‘ค omnara-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-07-09
11
AmberLJC/LLMSys-PaperList

Large Language Model (LLM) Systems Paper List

AmberLJC
โญ 2,332 Python ๐Ÿ‘ค AmberLJC User ๐Ÿ• Updated 2026-10-20 ๐Ÿ“… Created 2023-06-06
12
NUS-HPC-AI-Lab/VideoSys

VideoSys: An easy and efficient system for video generation

NUS-HPC-AI-Lab
โญ 2,022 Python ๐Ÿ‘ค NUS-HPC-AI-Lab Organization ๐Ÿ• Updated 2025-08-27 ๐Ÿ“… Created 2024-02-17
13
open-compress/claw-compactor

14-stage Fusion Pipeline for LLM token compression โ€” reversible compression, AST-aware code analysis, intelligent content routing. Zero LLM inference cost. MIT licensed.

open-compress
โญ 2,005 Python ๐Ÿ‘ค open-compress Organization ๐Ÿ• Updated 2026-04-01 ๐Ÿ“… Created 2026-02-10
14
ai-infra-curriculum/ai-infra-engineer-learning

AI Infrastructure Engineer Learning Track - Production ML infrastructure curriculum (2-4 years experience)

ai-infra-curriculum
โญ 1,907 Python ๐Ÿ‘ค ai-infra-curriculum Organization ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2025-10-25
15
tjmlabs/ColiVara

Colivara is a suite of services that allows you to store, search, and retrieve documents based on their visual embedding. ColiVara has state of the art retrieval performance on both text and visual documents. using vision models instead of chunking and text-processing for documents. No OCR, no text extraction, no broken tables, or missing images.

tjmlabs
โญ 1,485 Python ๐Ÿ‘ค tjmlabs Organization ๐Ÿ• Updated 2026-07-08 ๐Ÿ“… Created 2024-09-21
16
Paritok-official/paritok-4b-v1

Non-destructive compression gateway for AI coding agents. Cuts token bills 25% on turn 1 to past 85% in long or saturated sessions, and fits ~3ร— more turns in the same context window. Powered by our open-source code-native 4B model. Drop-in for Claude Code, Cursor, Codex, OpenHands, and any BASE_URL agent.

Paritok-official
โญ 1,439 Python ๐Ÿ‘ค Paritok-official Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2026-07-15
17
kuafuai/aipexbase

AipexBase is an AI-native BaaS platform. You only need to develop the frontend with vibe coding tools, and leave the backend to AipexBase!

kuafuai
โญ 1,286 Java ๐Ÿ‘ค kuafuai Organization ๐Ÿ• Updated 2026-09-30 ๐Ÿ“… Created 2025-10-18
18
open-gigaai/giga-models

GigaModels: A Comprehensive Repository and Platform for Multi-modal, Generative, and Perceptual Models

open-gigaai
โญ 1,064 Python ๐Ÿ‘ค open-gigaai Organization ๐Ÿ• Updated 2026-08-25 ๐Ÿ“… Created 2025-09-26
19
Tencent-Hunyuan/UniRL

UniRL is a Framework for Unified Multimodal Model Reinforcement Learning

Tencent-Hunyuan
โญ 1,051 Python ๐Ÿ‘ค Tencent-Hunyuan Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-06-08
20
tensorlakeai/tensorlake

Tensorlake is a serverless runtime for sandboxes and deploying background agentic applications

tensorlakeai
โญ 1,047 Rust ๐Ÿ‘ค tensorlakeai Organization ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2024-11-15
21
pgrundev/pgboxdb

PGBoxDB โ€” Lightweight Postgres for AI agents. Written in Rust. Thousands of isolated databases in one runtime ๐Ÿ˜

pgrundev
โญ 731 Rust ๐Ÿ‘ค pgrundev Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-10-08
22
astra-sim/astra-sim

ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale

astra-sim
โญ 727 C++ ๐Ÿ‘ค astra-sim Organization ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2020-07-10
23
daytona/ai-enablement-stack

A Community-Driven Mapping of AI Development Tools

daytona
โญ 646 HTML ๐Ÿ‘ค daytona Organization ๐Ÿ• Updated 2026-07-24 ๐Ÿ“… Created 2024-12-03
24
sandbaseai/sandbase-harness

Local-first, self-hosted AI agent runtime and MCP bridge with sandboxed sessions, memory, credentials, audit/replay, and a local Console.

sandbaseai
โญ 643 TypeScript ๐Ÿ‘ค sandbaseai Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2026-07-11
25
ai365vip/chat-api

OpenAI interface aggregation management, we are committed to providing high-quality API access services, allowing you to easily integrate advanced AI models into your products and services.

ai365vip
โญ 619 JavaScript ๐Ÿ‘ค ai365vip User ๐Ÿ• Updated 2025-07-15 ๐Ÿ“… Created 2023-12-27
26
4paradigm/k8s-vgpu-scheduler

OpenAIOS vGPU device plugin for Kubernetes is originated from the OpenAIOS project to virtualize GPU device memory, in order to allow applications to access larger memory space than its physical capacity. It is designed for ease of use of extended device memory for AI workloads.

4paradigm
โญ 583 Go ๐Ÿ‘ค 4paradigm Organization ๐Ÿ• Updated 2024-05-21 ๐Ÿ“… Created 2021-03-12
27
caura-ai/caura

Caura (formerly MemClaw) โ€” governed shared memory for AI agent fleets. Multi-agent, multi-tenant, MCP-native. Trust tiers, keystone policies, audit trails, knowledge graph, self-improving retrieval. Apache 2.0.

caura-ai
โญ 574 Python ๐Ÿ‘ค caura-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-27

Frequently Asked Questions

1

What is the most popular #ai-infrastructure repository on GitHub?

The top ranked open source #ai-infrastructure project on GitHub is semantica-agi/semantica with 14,701 stars. Graph-Native Semantic Layer for Trustworthy Enterprise AI

2

Which programming languages are most used in #ai-infrastructure repositories?

Among the top ranked #ai-infrastructure projects on GitHub, the most common programming languages are Python, Java, TypeScript, Go.

3

How is the #ai-infrastructure repository ranking calculated?

We track 27 active open source repositories tagged with #ai-infrastructure (500+ stars), totaling 87,587 stars with an average of 3,243 stars per repository. Rankings update daily from the GitHub API.