Git Stars Git Stars

#pipeline-parallelism Repositories

Discover 11 active open source GitHub repositories tagged with #pipeline-parallelism, accumulating 112,409 total stars (averaging 10,219 stars per project). Leading this topic is deepspeedai/DeepSpeed with 43,348 stars.

11
Total Repositories
112,409
Total Stars
10,219
Avg Stars/Repo
Programming Languages: Python C++ Jupyter Notebook
1
deepspeedai/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

deepspeedai
โญ 43,348 Python ๐Ÿ‘ค deepspeedai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-01-23
2
hpcaitech/ColossalAI

Making large AI models cheaper, faster and more accessible

hpcaitech
โญ 41,421 Python ๐Ÿ‘ค hpcaitech Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2021-10-28
3
bigscience-workshop/petals

Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

bigscience-workshop
โญ 9,864 Python ๐Ÿ‘ค bigscience-workshop Organization ๐Ÿ• Updated 2024-09-07 ๐Ÿ“… Created 2022-06-12
4
pytorch/torchtitan

A PyTorch native platform for training generative AI models

pytorch
โญ 5,936 Python ๐Ÿ‘ค pytorch Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-12-13
5
deepseek-ai/DualPipe

A bidirectional pipeline parallelism algorithm for computation-communication overlap in DeepSeek V3/R1 training.

deepseek-ai
โญ 3,036 Python ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2026-01-14 ๐Ÿ“… Created 2025-02-26
6
Alibaba-Quark/LiveAvatar

[ECCV 2026 Spotlight] Implementation of "Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length"

Alibaba-Quark
โญ 2,531 Python ๐Ÿ‘ค Alibaba-Quark Organization ๐Ÿ• Updated 2026-08-24 ๐Ÿ“… Created 2025-12-04
7
tdrussell/diffusion-pipe

A pipeline parallel training script for diffusion models.

tdrussell
โญ 2,037 Python ๐Ÿ‘ค tdrussell User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2024-08-03
8
bigscience-workshop/Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

bigscience-workshop
โญ 1,426 Python ๐Ÿ‘ค bigscience-workshop Organization ๐Ÿ• Updated 2024-03-20 ๐Ÿ“… Created 2021-07-02
9
Soulmate-Halo/heterogeneous-gpu-pd-lab

Accelerate sparse, large-memory hosts using dense-compute cards, including the AI Max+ 395, M3 512G, and DGX Spark.

Soulmate-Halo
โญ 1,288 C++ ๐Ÿ‘ค Soulmate-Halo User ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2026-09-01
10
kakaobrain/torchgpipe

A GPipe implementation in PyTorch

kakaobrain
โญ 861 Python ๐Ÿ‘ค kakaobrain Organization ๐Ÿ• Updated 2024-07-25 ๐Ÿ“… Created 2019-05-10
11
Coobiw/MPP-LLaVA

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.

Coobiw
โญ 678 Jupyter Notebook ๐Ÿ‘ค Coobiw User ๐Ÿ• Updated 2025-03-10 ๐Ÿ“… Created 2023-10-24

Frequently Asked Questions

1

What is the most popular #pipeline-parallelism repository on GitHub?

The top ranked open source #pipeline-parallelism project on GitHub is deepspeedai/DeepSpeed with 43,348 stars. DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

2

Which programming languages are most used in #pipeline-parallelism repositories?

Among the top ranked #pipeline-parallelism projects on GitHub, the most common programming languages are Python, C++, Jupyter Notebook.

3

How is the #pipeline-parallelism repository ranking calculated?

We track 11 active open source repositories tagged with #pipeline-parallelism (500+ stars), totaling 112,409 stars with an average of 10,219 stars per repository. Rankings update daily from the GitHub API.