#deepspeed Repositories
Discover 25 active open source GitHub repositories tagged with #deepspeed, accumulating 68,253 total stars (averaging 2,730 stars per project). Leading this topic is deepseek-ai/DeepSeek-Coder with 24,365 stars.
25 repositories total
FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
Ongoing research training transformer language models at scale, including: BERT & GPT-2
ChatLLaMA ๐ข Open source implementation for LLaMA-based ChatGPT runnable in a single GPU. 15x faster training process than ChatGPT
Lightweight LLM Post-training Framework, supports SFT, RLVR, On-Policy KD, Guide KD, and mixed training; implements single/multi-round Guide distillation, multi-teacher distillation, Reward mixed training, and automated data sharding๐ฉโ๐๐จโ๐
Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.
Best practices & guides on how to write distributed pytorch training code
Frequently Asked Questions
What is the most popular #deepspeed repository on GitHub?
The top ranked open source #deepspeed project on GitHub is deepseek-ai/DeepSeek-Coder with 24,365 stars. DeepSeek Coder: Let the Code Write Itself
Which programming languages are most used in #deepspeed repositories?
Among the top ranked #deepspeed projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Ruby.
How is the #deepspeed repository ranking calculated?
We track 25 active open source repositories tagged with #deepspeed (500+ stars), totaling 68,253 stars with an average of 2,730 stars per repository. Rankings update daily from the GitHub API.