#distributed-training Repositories
147 repositories total
A fully open source biomolecular structure prediction model based on AlphaFold3
A flexible and efficient codebase for training visually-conditioned language models (VLMs)
Halo is an open-source framework built by White Circle for training large language and multimodal models
Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.
Scaling Deep Research via Reinforcement Learning in Real-world Environments.
Exercises and supplementary material for the machine learning operations course at DTU.
Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
[ICML 2024 Best Paper] Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)
An Asynchronous Reinforcement Learning Engine for Omni-Modal Post-Training at Scale
๐พ OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
Large-scale open domain KNOwledge grounded conVERsation system based on PaddlePaddle
A curated reading list of research in Mixture-of-Experts(MoE).
Best practices & guides on how to write distributed pytorch training code
An Open-Source Large-Scale Reinforcement Learning Project for Search Agents
OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training