Git Stars Git Stars

#distributed-training Repositories

147
Total Repositories
615,835
Total Stars
4,189
Avg Stars/Repo
101
aqlaboratory/openfold-3

A fully open source biomolecular structure prediction model based on AlphaFold3

aqlaboratory
โญ 925 Python ๐Ÿ‘ค aqlaboratory Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-10-21
102
bytedance/fedlearner

A multi-party collaborative machine learning framework

bytedance
โญ 898 Python ๐Ÿ‘ค bytedance Organization ๐Ÿ• Updated 2026-07-06 ๐Ÿ“… Created 2020-01-21
103
TRI-ML/prismatic-vlms

A flexible and efficient codebase for training visually-conditioned language models (VLMs)

TRI-ML
โญ 894 Python ๐Ÿ‘ค TRI-ML Organization ๐Ÿ• Updated 2024-07-04 ๐Ÿ“… Created 2024-02-13
104
whitecircle/halo

Halo is an open-source framework built by White Circle for training large language and multimodal models

whitecircle
โญ 868 Python ๐Ÿ‘ค whitecircle Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-08-26
105
rail-berkeley/serl

SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learning

rail-berkeley
โญ 864 Python ๐Ÿ‘ค rail-berkeley Organization ๐Ÿ• Updated 2025-10-27 ๐Ÿ“… Created 2023-12-08
106
EleutherAI/cookbook

Deep learning for dummies. All the practical details and useful utilities that go into working with real models.

EleutherAI
โญ 858 Python ๐Ÿ‘ค EleutherAI Organization ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2023-12-20
107
TideDra/lmm-r1

Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.

TideDra
โญ 843 Python ๐Ÿ‘ค TideDra User ๐Ÿ• Updated 2025-05-14 ๐Ÿ“… Created 2025-02-13
108
LambdaLabsML/examples

Deep Learning Examples

LambdaLabsML
โญ 828 Jupyter Notebook ๐Ÿ‘ค LambdaLabsML Organization ๐Ÿ• Updated 2024-10-18 ๐Ÿ“… Created 2022-07-07
109
dhcode-cpp/X-R1

minimal-cost for training 0.5B R1-Zero

dhcode-cpp
โญ 815 Python ๐Ÿ‘ค dhcode-cpp User ๐Ÿ• Updated 2025-05-14 ๐Ÿ“… Created 2025-02-11
110
GAIR-NLP/DeepResearcher

Scaling Deep Research via Reinforcement Learning in Real-world Environments.

GAIR-NLP
โญ 808 Python ๐Ÿ‘ค GAIR-NLP Organization ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2025-04-02
111
NVlabs/edm2

EDM2 and Autoguidance -- Official PyTorch implementation

NVlabs
โญ 807 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2024-12-09 ๐Ÿ“… Created 2024-03-11
112
SkafteNicki/dtu_mlops

Exercises and supplementary material for the machine learning operations course at DTU.

SkafteNicki
โญ 807 Python ๐Ÿ‘ค SkafteNicki User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2021-04-07
113
inworld-ai/tts

Inworld TTS

inworld-ai
โญ 782 Python ๐Ÿ‘ค inworld-ai Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2025-05-02
114
mlfoundations/datacomp

DataComp: In search of the next generation of multimodal datasets

mlfoundations
โญ 780 Python ๐Ÿ‘ค mlfoundations Organization ๐Ÿ• Updated 2025-04-28 ๐Ÿ“… Created 2023-04-28
115
EleutherAI/sparsify

Sparsify transformers with SAEs and transcoders

EleutherAI
โญ 744 Python ๐Ÿ‘ค EleutherAI Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2024-05-24
116
marin-community/levanter

Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax

marin-community
โญ 720 Python ๐Ÿ‘ค marin-community Organization ๐Ÿ• Updated 2026-01-26 ๐Ÿ“… Created 2022-05-24
117
meta-pytorch/torchforge

PyTorch-native post-training at scale

meta-pytorch
โญ 706 Python ๐Ÿ‘ค meta-pytorch Organization ๐Ÿ• Updated 2026-09-09 ๐Ÿ“… Created 2025-06-24
118
facebookresearch/nwm

Official code for the CVPR 2025 paper "Navigation World Models".

facebookresearch
โญ 706 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2025-11-24 ๐Ÿ“… Created 2025-03-12
119
nyu-systems/Grendel-GS

[ICLR 2025 Oral] On Scaling Up 3D Gaussian Splatting Training

nyu-systems
โญ 686 Python ๐Ÿ‘ค nyu-systems Organization ๐Ÿ• Updated 2025-09-24 ๐Ÿ“… Created 2023-12-07
120
louaaron/Score-Entropy-Discrete-Diffusion

[ICML 2024 Best Paper] Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)

louaaron
โญ 681 Python ๐Ÿ‘ค louaaron User ๐Ÿ• Updated 2024-02-29 ๐Ÿ“… Created 2024-02-21
121
redai-studio/Relax

An Asynchronous Reinforcement Learning Engine for Omni-Modal Post-Training at Scale

redai-studio
โญ 678 Python ๐Ÿ‘ค redai-studio Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-13
122
sail-sg/oat

๐ŸŒพ OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.

sail-sg
โญ 678 Python ๐Ÿ‘ค sail-sg Organization ๐Ÿ• Updated 2026-01-29 ๐Ÿ“… Created 2024-10-15
124
PaddlePaddle/Knover

Large-scale open domain KNOwledge grounded conVERsation system based on PaddlePaddle

PaddlePaddle
โญ 672 Python ๐Ÿ‘ค PaddlePaddle Organization ๐Ÿ• Updated 2024-03-06 ๐Ÿ“… Created 2020-07-03
125
csuhan/OneLLM

[CVPR 2024] OneLLM: One Framework to Align All Modalities with Language

csuhan
โญ 666 Python ๐Ÿ‘ค csuhan User ๐Ÿ• Updated 2024-10-22 ๐Ÿ“… Created 2023-11-27
126
codecaution/Awesome-Mixture-of-Experts-Papers

A curated reading list of research in Mixture-of-Experts(MoE).

codecaution
โญ 654 ๐Ÿ‘ค codecaution User ๐Ÿ• Updated 2024-10-30 ๐Ÿ“… Created 2022-02-24
127
modal-labs/llm-finetuning

Guide for fine-tuning Llama/Mistral/CodeLlama models and more

modal-labs
โญ 650 Python ๐Ÿ‘ค modal-labs Organization ๐Ÿ• Updated 2025-10-15 ๐Ÿ“… Created 2023-09-14
128
LambdaLabsML/distributed-training-guide

Best practices & guides on how to write distributed pytorch training code

LambdaLabsML
โญ 633 Python ๐Ÿ‘ค LambdaLabsML Organization ๐Ÿ• Updated 2025-10-22 ๐Ÿ“… Created 2024-07-31
129
Snowdar/asv-subtools

An Open Source Tools for Speaker Recognition

Snowdar
โญ 633 Python ๐Ÿ‘ค Snowdar User ๐Ÿ• Updated 2024-08-05 ๐Ÿ“… Created 2020-03-02
130
OpenBMB/BMTrain

Efficient Training (including pre-training and fine-tuning) for Big Models

OpenBMB
โญ 626 Python ๐Ÿ‘ค OpenBMB Organization ๐Ÿ• Updated 2026-07-07 ๐Ÿ“… Created 2021-12-01
132
inclusionAI/ASearcher

An Open-Source Large-Scale Reinforcement Learning Project for Search Agents

inclusionAI
โญ 617 Python ๐Ÿ‘ค inclusionAI Organization ๐Ÿ• Updated 2025-11-26 ๐Ÿ“… Created 2025-08-05
133
mlfoundations/evalchemy

Automatic evals for LLMs

mlfoundations
โญ 617 HTML ๐Ÿ‘ค mlfoundations Organization ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2024-11-15
134
perplexityai/pplx-kernels

Perplexity GPU Kernels

perplexityai
โญ 614 C++ ๐Ÿ‘ค perplexityai Organization ๐Ÿ• Updated 2025-11-07 ๐Ÿ“… Created 2025-03-24
135
damo-cv/RealisDance

The official implementation of RealisDance

damo-cv
โญ 611 Python ๐Ÿ‘ค damo-cv Organization ๐Ÿ• Updated 2025-06-20 ๐Ÿ“… Created 2024-09-10
136
PrimeIntellect-ai/OpenDiloco

OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training

PrimeIntellect-ai
โญ 610 Python ๐Ÿ‘ค PrimeIntellect-ai Organization ๐Ÿ• Updated 2026-07-17 ๐Ÿ“… Created 2024-07-10
137
sail-sg/MDT

Masked Diffusion Transformer is the SOTA for image synthesis. (ICCV 2023)

sail-sg
โญ 591 Python ๐Ÿ‘ค sail-sg Organization ๐Ÿ• Updated 2024-04-23 ๐Ÿ“… Created 2023-03-17
138
Shawn-IEITSystems/Yuan-1.0

Yuan 1.0 Large pretrained LM

Shawn-IEITSystems
โญ 590 Python ๐Ÿ‘ค Shawn-IEITSystems User ๐Ÿ• Updated 2024-12-03 ๐Ÿ“… Created 2021-09-27
139
epfLLM/Megatron-LLM

distributed trainer for LLMs

epfLLM
โญ 587 Python ๐Ÿ‘ค epfLLM Organization ๐Ÿ• Updated 2024-05-20 ๐Ÿ“… Created 2023-07-28
140
lumalabs/imm

Official implementation of Inductive Moment Matching

lumalabs
โญ 585 Python ๐Ÿ‘ค lumalabs Organization ๐Ÿ• Updated 2025-07-11 ๐Ÿ“… Created 2025-03-11
141
facebookresearch/optimizers

For optimization algorithm research and development.

facebookresearch
โญ 585 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2022-04-04
โญ 567 Python ๐Ÿ‘ค yuvalkirstain User ๐Ÿ• Updated 2024-12-21 ๐Ÿ“… Created 2023-04-30
143
mlfoundations/open_lm

A repository for research on medium sized language models.

mlfoundations
โญ 536 Python ๐Ÿ‘ค mlfoundations Organization ๐Ÿ• Updated 2025-06-06 ๐Ÿ“… Created 2023-08-23
144
codefuse-ai/CodeFuse-CGM

[NeurIPS 2025] A Graph-based LLM Framework for Real-world SE Tasks

codefuse-ai
โญ 534 Python ๐Ÿ‘ค codefuse-ai Organization ๐Ÿ• Updated 2025-09-19 ๐Ÿ“… Created 2024-12-23
145
DachengLi1/LongChat

Official repository for LongChat and LongEval

DachengLi1
โญ 533 Python ๐Ÿ‘ค DachengLi1 User ๐Ÿ• Updated 2024-05-24 ๐Ÿ“… Created 2023-04-21
146
XuezheMax/megalodon

Reference implementation of Megalodon 7B model

XuezheMax
โญ 525 Cuda ๐Ÿ‘ค XuezheMax User ๐Ÿ• Updated 2025-05-17 ๐Ÿ“… Created 2024-04-01