Git Stars Git Stars

#ai-infra Repositories

Discover 14 active open source GitHub repositories tagged with #ai-infra, accumulating 59,426 total stars (averaging 4,244 stars per project). Leading this topic is opensandbox-group/OpenSandbox with 17,757 stars.

14
Total Repositories
59,426
Total Stars
4,244
Avg Stars/Repo
1
opensandbox-group/OpenSandbox

Secure, Fast, and Extensible Sandbox runtime for AI agents.

opensandbox-group
โญ 17,757 Go ๐Ÿ‘ค opensandbox-group Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-12-17
2
bojieli/ai-infra-book

ใ€ŠIn-Depth Understanding of AI Infrastructure: Quantitative Analysis and System Designใ€‹ (by Li Bojie), an open-source book manuscript: Starting from hardware constraints and model architectures, it quantitatively derives the design of LLM inference and training systems. Includes the full text, PDF, accompanying computational tools, and experiments.

bojieli
โญ 8,179 Python ๐Ÿ‘ค bojieli User ๐Ÿ• Updated 2026-10-01 ๐Ÿ“… Created 2026-08-22
3
Tencent/AI-Infra-Guard

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP Scan, AI Infra Scan, and LLM jailbreak evaluation.

Tencent
โญ 7,604 Python ๐Ÿ‘ค Tencent Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-12-25
4
CalvinXKY/InfraTech

Sharing AI Infra knowledge & code practice: PyTorch, vLLM/SGLang, slime/vime framework introduction โšก๏ธ, performance acceleration ๐Ÿš€, large model basics ๐Ÿง , AI software and hardware ๐Ÿ”ง, etc.

CalvinXKY
โญ 4,411 Jupyter Notebook ๐Ÿ‘ค CalvinXKY User ๐Ÿ• Updated 2026-09-20 ๐Ÿ“… Created 2025-11-14
5
SwanHubX/SwanLab

โšก๏ธSwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.

SwanHubX
โญ 4,401 Python ๐Ÿ‘ค SwanHubX Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-11-24
6
HuaizhengZhang/AI-Infra-from-Zero-to-Hero

๐Ÿš€ Awesome System for Machine Learning โšก๏ธ AI System Papers and Industry Practice. โšก๏ธ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). ๐Ÿป OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. ๐Ÿ—ƒ๏ธ Llama3, Mistral, etc. ๐Ÿง‘โ€๐Ÿ’ป Video Tutorials.

HuaizhengZhang
โญ 4,224 ๐Ÿ‘ค HuaizhengZhang User ๐Ÿ• Updated 2025-07-25 ๐Ÿ“… Created 2019-01-07
7
thu-ml/TurboDiffusion

TurboDiffusion: 100โ€“200ร— Acceleration for Video Diffusion Models

thu-ml
โญ 3,870 Python ๐Ÿ‘ค thu-ml Organization ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2025-12-06
8
ForceInjection/AI-fundamentals

AI Fundamentals - GPU architecture, CUDA programming, basics of large models, and knowledge related to AI Agents.

ForceInjection
โญ 3,515 HTML ๐Ÿ‘ค ForceInjection Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-09-23
9
thu-ml/SpargeAttn

[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.

thu-ml
โญ 1,269 Cuda ๐Ÿ‘ค thu-ml Organization ๐Ÿ• Updated 2026-02-25 ๐Ÿ“… Created 2025-02-25
10
CurvineIO/curvine

AI-native, cloud-native file system in Rust. Full POSIX on object storage with a multi-tier distributed cache, for AI training, inference, and agents. CNCF Sandbox project.

CurvineIO
โญ 1,090 Rust ๐Ÿ‘ค CurvineIO Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-05-27
11
tensorlakeai/tensorlake

Tensorlake is a serverless runtime for sandboxes and deploying background agentic applications

tensorlakeai
โญ 1,047 Rust ๐Ÿ‘ค tensorlakeai Organization ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2024-11-15
12
usemoss/moss

The retrieval layer for production AI systems. Lightning-fast (<10ms) search without vector databases. Built for browser, edge, on-device, and cloud.

usemoss
โญ 915 Python ๐Ÿ‘ค usemoss Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2025-10-04
13
jinbooooom/ai-infra-hpc

HPC tutorial, covering collective communication (MPI, NCCL), CUDA programming, vectorization SIMD, RDMA communication, etc.

jinbooooom
โญ 795 Cuda ๐Ÿ‘ค jinbooooom User ๐Ÿ• Updated 2026-04-27 ๐Ÿ“… Created 2024-07-23
14
thu-ml/SLA

SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparseโ€“Linear Attention

thu-ml
โญ 553 Python ๐Ÿ‘ค thu-ml Organization ๐Ÿ• Updated 2026-10-18 ๐Ÿ“… Created 2025-09-25

Frequently Asked Questions

1

What is the most popular #ai-infra repository on GitHub?

The top ranked open source #ai-infra project on GitHub is opensandbox-group/OpenSandbox with 17,757 stars. Secure, Fast, and Extensible Sandbox runtime for AI agents.

2

Which programming languages are most used in #ai-infra repositories?

Among the top ranked #ai-infra projects on GitHub, the most common programming languages are Python, Cuda, Rust, Go.

3

How is the #ai-infra repository ranking calculated?

We track 14 active open source repositories tagged with #ai-infra (500+ stars), totaling 59,426 stars with an average of 4,244 stars per repository. Rankings update daily from the GitHub API.