#model-parallelism Repositories
Discover 16 active open source GitHub repositories tagged with #model-parallelism, accumulating 115,629 total stars (averaging 7,226 stars per project). Leading this topic is deepspeedai/DeepSpeed with 43,348 stars.
16 repositories total
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
๐ A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.
VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo
Minimalistic 4D-parallelism distributed training framework for education purpose
Halo is an open-source framework built by White Circle for training large language and multimodal models
prime is a framework for efficient, globally distributed training of AI models over the internet.
Provides end-to-end model development pipelines for LLMs and Multimodal models that can be launched on-prem or cloud-native.
Frequently Asked Questions
What is the most popular #model-parallelism repository on GitHub?
The top ranked open source #model-parallelism project on GitHub is deepspeedai/DeepSpeed with 43,348 stars. DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Which programming languages are most used in #model-parallelism repositories?
Among the top ranked #model-parallelism projects on GitHub, the most common programming languages are Python, TypeScript, Cuda.
How is the #model-parallelism repository ranking calculated?
We track 16 active open source repositories tagged with #model-parallelism (500+ stars), totaling 115,629 stars with an average of 7,226 stars per repository. Rankings update daily from the GitHub API.