Git Stars Git Stars

#fsdp Repositories

Discover 12 active open source GitHub repositories tagged with #fsdp, accumulating 18,670 total stars (averaging 1,555 stars per project). Leading this topic is facebookresearch/fairscale with 3,408 stars.

12
Total Repositories
18,670
Total Stars
1,555
Avg Stars/Repo
Programming Languages: Python Jupyter Notebook
1
facebookresearch/fairscale

PyTorch extensions for high performance and large scale training.

facebookresearch
โญ 3,408 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2025-04-26 ๐Ÿ“… Created 2020-07-07
2
radixark/miles

Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.

radixark
โญ 3,386 Python ๐Ÿ‘ค radixark Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-10-09
3
eric-mitchell/direct-preference-optimization

Reference implementation for DPO (Direct Preference Optimization)

eric-mitchell
โญ 2,826 Python ๐Ÿ‘ค eric-mitchell User ๐Ÿ• Updated 2024-08-11 ๐Ÿ“… Created 2023-06-22
4
AnswerDotAI/fsdp_qlora

Training LLMs with QLoRA + FSDP

AnswerDotAI
โญ 1,534 Jupyter Notebook ๐Ÿ‘ค AnswerDotAI Organization ๐Ÿ• Updated 2024-11-09 ๐Ÿ“… Created 2024-01-14
5
NVIDIA-NeMo/labs-molt

A scalable, agentic-first, and HuggingFace-native RL framework for research (9k lines).

NVIDIA-NeMo
โญ 1,395 Python ๐Ÿ‘ค NVIDIA-NeMo Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-06-23
โญ 1,323 Python ๐Ÿ‘ค ChenmienTan User ๐Ÿ• Updated 2026-05-20 ๐Ÿ“… Created 2025-04-04
7
sgl-project/SpecForge

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

sgl-project
โญ 1,291 Python ๐Ÿ‘ค sgl-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-06-09
8
open-gigaai/giga-train

GigaTrain: An Efficient and Scalable Training Framework for AI Models

open-gigaai
โญ 1,074 Python ๐Ÿ‘ค open-gigaai Organization ๐Ÿ• Updated 2026-08-25 ๐Ÿ“… Created 2025-09-26
9
bytedance/DreamID-V

[ECCV 2026 Oral] DreamID-V: Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer

bytedance
โญ 707 Python ๐Ÿ‘ค bytedance Organization ๐Ÿ• Updated 2026-05-22 ๐Ÿ“… Created 2025-12-17
10
LambdaLabsML/distributed-training-guide

Best practices & guides on how to write distributed pytorch training code

LambdaLabsML
โญ 633 Python ๐Ÿ‘ค LambdaLabsML Organization ๐Ÿ• Updated 2025-10-22 ๐Ÿ“… Created 2024-07-31
11
zengxiao-he/tessera

From teacher to tiles โ€” a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.

zengxiao-he
โญ 556 Python ๐Ÿ‘ค zengxiao-he User ๐Ÿ• Updated 2026-10-09 ๐Ÿ“… Created 2026-06-05
12
meta-pytorch/torchft

Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)

meta-pytorch
โญ 555 Python ๐Ÿ‘ค meta-pytorch Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-10-18

Frequently Asked Questions

1

What is the most popular #fsdp repository on GitHub?

The top ranked open source #fsdp project on GitHub is facebookresearch/fairscale with 3,408 stars. PyTorch extensions for high performance and large scale training.

2

Which programming languages are most used in #fsdp repositories?

Among the top ranked #fsdp projects on GitHub, the most common programming languages are Python, Jupyter Notebook.

3

How is the #fsdp repository ranking calculated?

We track 12 active open source repositories tagged with #fsdp (500+ stars), totaling 18,670 stars with an average of 1,555 stars per repository. Rankings update daily from the GitHub API.