#ai-infra Repositories
Discover 14 active open source GitHub repositories tagged with #ai-infra, accumulating 59,426 total stars (averaging 4,244 stars per project). Leading this topic is opensandbox-group/OpenSandbox with 17,757 stars.
14 repositories total
ใIn-Depth Understanding of AI Infrastructure: Quantitative Analysis and System Designใ (by Li Bojie), an open-source book manuscript: Starting from hardware constraints and model architectures, it quantitatively derives the design of LLM inference and training systems. Includes the full text, PDF, accompanying computational tools, and experiments.
A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP Scan, AI Infra Scan, and LLM jailbreak evaluation.
Sharing AI Infra knowledge & code practice: PyTorch, vLLM/SGLang, slime/vime framework introduction โก๏ธ, performance acceleration ๐, large model basics ๐ง , AI software and hardware ๐ง, etc.
โก๏ธSwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.
๐ Awesome System for Machine Learning โก๏ธ AI System Papers and Industry Practice. โก๏ธ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). ๐ป OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. ๐๏ธ Llama3, Mistral, etc. ๐งโ๐ป Video Tutorials.
AI Fundamentals - GPU architecture, CUDA programming, basics of large models, and knowledge related to AI Agents.
[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
AI-native, cloud-native file system in Rust. Full POSIX on object storage with a multi-tier distributed cache, for AI training, inference, and agents. CNCF Sandbox project.
Tensorlake is a serverless runtime for sandboxes and deploying background agentic applications
The retrieval layer for production AI systems. Lightning-fast (<10ms) search without vector databases. Built for browser, edge, on-device, and cloud.
HPC tutorial, covering collective communication (MPI, NCCL), CUDA programming, vectorization SIMD, RDMA communication, etc.
SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable SparseโLinear Attention
Frequently Asked Questions
What is the most popular #ai-infra repository on GitHub?
The top ranked open source #ai-infra project on GitHub is opensandbox-group/OpenSandbox with 17,757 stars. Secure, Fast, and Extensible Sandbox runtime for AI agents.
Which programming languages are most used in #ai-infra repositories?
Among the top ranked #ai-infra projects on GitHub, the most common programming languages are Python, Cuda, Rust, Go.
How is the #ai-infra repository ranking calculated?
We track 14 active open source repositories tagged with #ai-infra (500+ stars), totaling 59,426 stars with an average of 4,244 stars per repository. Rankings update daily from the GitHub API.