Git Stars Git Stars

#data-parallelism Repositories

Discover 12 active open source GitHub repositories tagged with #data-parallelism, accumulating 130,481 total stars (averaging 10,873 stars per project). Leading this topic is deepspeedai/DeepSpeed with 43,348 stars.

12
Total Repositories
130,481
Total Stars
10,873
Avg Stars/Repo
1
deepspeedai/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

deepspeedai
โญ 43,348 Python ๐Ÿ‘ค deepspeedai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-01-23
2
hpcaitech/ColossalAI

Making large AI models cheaper, faster and more accessible

hpcaitech
โญ 41,421 Python ๐Ÿ‘ค hpcaitech Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2021-10-28
3
rasbt/deeplearning-models

A collection of various deep learning architectures, models, and tips

rasbt
โญ 17,641 Jupyter Notebook ๐Ÿ‘ค rasbt User ๐Ÿ• Updated 2026-09-26 ๐Ÿ“… Created 2019-06-05
4
rayon-rs/rayon

Rayon: A data parallelism library for Rust

rayon-rs
โญ 13,482 Rust ๐Ÿ‘ค rayon-rs Organization ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2014-10-02
5
facebookresearch/lingua

Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.

facebookresearch
โญ 4,758 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2025-07-18 ๐Ÿ“… Created 2024-10-16
6
TimelyDataflow/differential-dataflow

An implementation of differential dataflow using timely dataflow on Rust.

TimelyDataflow
โญ 3,040 Rust ๐Ÿ‘ค TimelyDataflow Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2015-05-05
7
laekov/fastmoe

A fast MoE impl for PyTorch

laekov
โญ 1,853 Python ๐Ÿ‘ค laekov User ๐Ÿ• Updated 2025-02-10 ๐Ÿ“… Created 2021-01-25
8
tczhangzhi/pytorch-distributed

A quickstart and benchmark for pytorch distributed training.

tczhangzhi
โญ 1,665 Python ๐Ÿ‘ค tczhangzhi User ๐Ÿ• Updated 2024-07-25 ๐Ÿ“… Created 2019-12-20
9
rust-lang/portable-simd

The testing ground for the future of portable SIMD in Rust

rust-lang
โญ 1,082 Rust ๐Ÿ‘ค rust-lang Organization ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2020-09-22
10
yandex/YaFSDP

YaFSDP: Yet another Fully Sharded Data Parallel

yandex
โญ 992 Python ๐Ÿ‘ค yandex Organization ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2024-05-27
11
rust-lang/packed_simd

Portable Packed SIMD Vectors for Rust standard library

rust-lang
โญ 635 Rust ๐Ÿ‘ค rust-lang Organization ๐Ÿ• Updated 2024-05-05 ๐Ÿ“… Created 2018-06-27
12
mratsim/weave

A state-of-the-art multithreading runtime: message-passing based, fast, scalable, ultra-low overhead

mratsim
โญ 569 Nim ๐Ÿ‘ค mratsim User ๐Ÿ• Updated 2024-06-29 ๐Ÿ“… Created 2019-07-20

Frequently Asked Questions

1

What is the most popular #data-parallelism repository on GitHub?

The top ranked open source #data-parallelism project on GitHub is deepspeedai/DeepSpeed with 43,348 stars. DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

2

Which programming languages are most used in #data-parallelism repositories?

Among the top ranked #data-parallelism projects on GitHub, the most common programming languages are Python, Rust, Jupyter Notebook, Nim.

3

How is the #data-parallelism repository ranking calculated?

We track 12 active open source repositories tagged with #data-parallelism (500+ stars), totaling 130,481 stars with an average of 10,873 stars per repository. Rankings update daily from the GitHub API.