#distributed-training Repositories
Discover 147 active open source GitHub repositories tagged with #distributed-training, accumulating 615,835 total stars (averaging 4,189 stars per project). Leading this topic is tensorflow/models with 77,631 stars.
147 repositories total
Learn how to develop, deploy and iterate on production-grade ML applications.
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (ใFeiJiangใcore framework, Deep Learning & Machine Learning high-performance single-node, distributed training, and cross-platform deployment)
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
Large Model Fundamentals: Understand Large Model Fundamentals in One Article
Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
Sharing AI Infra knowledge & code practice: PyTorch, vLLM/SGLang, slime/vime framework introduction โก๏ธ, performance acceleration ๐, large model basics ๐ง , AI software and hardware ๐ง, etc.
Fengshenbang-LM (ๅฐ็ฅๆฆๅคงๆจกๅ) is an open-source large model system led by the Research Center for Cognitive Computing and Natural Language Processing of the IDEA Institute, serving as the infrastructure for Chinese AIGC and cognitive intelligence.
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.
Deformable DETR: Deformable Transformers for End-to-End Object Detection.
A platform for Reasoning systems (Reinforcement Learning, Contextual Bandits, etc.)
Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
A bidirectional pipeline parallelism algorithm for computation-communication overlap in DeepSeek V3/R1 training.
Reference implementation for DPO (Direct Preference Optimization)
This repository mainly records interview questions related to Large Language Model (LLM) Algorithm Engineers.
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
Frequently Asked Questions
What is the most popular #distributed-training repository on GitHub?
The top ranked open source #distributed-training project on GitHub is tensorflow/models with 77,631 stars. Models and examples built with TensorFlow
Which programming languages are most used in #distributed-training repositories?
Among the top ranked #distributed-training projects on GitHub, the most common programming languages are Python, Jupyter Notebook, C++, HTML.
How is the #distributed-training repository ranking calculated?
We track 147 active open source repositories tagged with #distributed-training (500+ stars), totaling 615,835 stars with an average of 4,189 stars per repository. Rankings update daily from the GitHub API.