Git Stars Git Stars

#deepspeed Repositories

Discover 25 active open source GitHub repositories tagged with #deepspeed, accumulating 68,253 total stars (averaging 2,730 stars per project). Leading this topic is deepseek-ai/DeepSeek-Coder with 24,365 stars.

25
Total Repositories
68,253
Total Stars
2,730
Avg Stars/Repo
1
deepseek-ai/DeepSeek-Coder

DeepSeek Coder: Let the Code Write Itself

deepseek-ai
โญ 24,365 Python ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2025-11-11 ๐Ÿ“… Created 2023-10-20
2
InternLM/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

InternLM
โญ 8,153 Python ๐Ÿ‘ค InternLM Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-06-15
3
deepspeedai/DeepSpeedExamples

Example models using DeepSpeed

deepspeedai
โญ 6,841 Python ๐Ÿ‘ค deepspeedai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2020-01-29
4
FlagAI-Open/FlagAI

FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.

FlagAI-Open
โญ 3,864 Python ๐Ÿ‘ค FlagAI-Open Organization ๐Ÿ• Updated 2026-07-13 ๐Ÿ“… Created 2022-05-16
โญ 2,230 Python ๐Ÿ‘ค XLabs-AI Organization ๐Ÿ• Updated 2024-11-08 ๐Ÿ“… Created 2024-08-05
6
tdrussell/diffusion-pipe

A pipeline parallel training script for diffusion models.

tdrussell
โญ 2,037 Python ๐Ÿ‘ค tdrussell User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2024-08-03
7
deepseek-ai/DeepSeek-MoE

DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models

deepseek-ai
โญ 1,862 Python ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2024-01-16 ๐Ÿ“… Created 2024-01-02
โญ 1,850 Python ๐Ÿ‘ค Tele-AI Organization ๐Ÿ• Updated 2026-07-09 ๐Ÿ“… Created 2024-01-07
9
lsdefine/simple_GRPO

A very simple GRPO implement for reproducing r1-like LLM thinking.

lsdefine
โญ 1,719 Python ๐Ÿ‘ค lsdefine User ๐Ÿ• Updated 2025-11-21 ๐Ÿ“… Created 2025-02-10
10
PKU-Alignment/safe-rlhf

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

PKU-Alignment
โญ 1,624 Python ๐Ÿ‘ค PKU-Alignment Organization ๐Ÿ• Updated 2025-11-24 ๐Ÿ“… Created 2023-05-15
11
bigscience-workshop/Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

bigscience-workshop
โญ 1,426 Python ๐Ÿ‘ค bigscience-workshop Organization ๐Ÿ• Updated 2024-03-20 ๐Ÿ“… Created 2021-07-02
12
zjunlp/KnowLM

An Open-sourced Knowledgable Large Language Model Framework.

zjunlp
โญ 1,387 Python ๐Ÿ‘ค zjunlp Organization ๐Ÿ• Updated 2025-01-11 ๐Ÿ“… Created 2023-04-01
14
henrywoo/chatllama

ChatLLaMA ๐Ÿ“ข Open source implementation for LLaMA-based ChatGPT runnable in a single GPU. 15x faster training process than ChatGPT

henrywoo
โญ 1,200 Python ๐Ÿ‘ค henrywoo User ๐Ÿ• Updated 2026-10-08 ๐Ÿ“… Created 2023-02-27
15
arcee-ai/DistillKit

An Open Source Toolkit For LLM Distillation

arcee-ai
โญ 1,095 Python ๐Ÿ‘ค arcee-ai Organization ๐Ÿ• Updated 2026-05-12 ๐Ÿ“… Created 2024-07-31
16
CSHaitao/LexiLaw

LexiLaw - Chinese Legal Large Language Model

CSHaitao
โญ 1,058 Python ๐Ÿ‘ค CSHaitao User ๐Ÿ• Updated 2026-03-12 ๐Ÿ“… Created 2023-05-16
17
mst272/LLM-Dojo

Lightweight LLM Post-training Framework, supports SFT, RLVR, On-Policy KD, Guide KD, and mixed training; implements single/multi-round Guide distillation, multi-teacher distillation, Reward mixed training, and automated data sharding๐Ÿ‘ฉโ€๐ŸŽ“๐Ÿ‘จโ€๐ŸŽ“

mst272
โญ 939 Python ๐Ÿ‘ค mst272 User ๐Ÿ• Updated 2026-03-08 ๐Ÿ“… Created 2024-01-23
18
wdndev/tiny-llm-zh

Implementing a small-parameter Chinese large language model from scratch.

wdndev
โญ 917 Python ๐Ÿ‘ค wdndev User ๐Ÿ• Updated 2024-08-22 ๐Ÿ“… Created 2024-03-03
19
jzhang38/EasyContext

Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.

jzhang38
โญ 751 Python ๐Ÿ‘ค jzhang38 User ๐Ÿ• Updated 2024-09-27 ๐Ÿ“… Created 2024-04-05
20
Coobiw/MPP-LLaVA

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.

Coobiw
โญ 678 Jupyter Notebook ๐Ÿ‘ค Coobiw User ๐Ÿ• Updated 2025-03-10 ๐Ÿ“… Created 2023-10-24
21
LambdaLabsML/distributed-training-guide

Best practices & guides on how to write distributed pytorch training code

LambdaLabsML
โญ 633 Python ๐Ÿ‘ค LambdaLabsML Organization ๐Ÿ• Updated 2025-10-22 ๐Ÿ“… Created 2024-07-31
22
fe1ixxu/ALMA

State-of-the-art LLM-based translation models.

fe1ixxu
โญ 585 Ruby ๐Ÿ‘ค fe1ixxu User ๐Ÿ• Updated 2025-04-09 ๐Ÿ“… Created 2023-09-13
23
AILab-CVC/SEED-X

Multimodal Models in Real World

AILab-CVC
โญ 560 Jupyter Notebook ๐Ÿ‘ค AILab-CVC Organization ๐Ÿ• Updated 2025-02-24 ๐Ÿ“… Created 2024-03-30
โญ 557 Python ๐Ÿ‘ค Snowflake-Labs Organization ๐Ÿ• Updated 2024-08-16 ๐Ÿ“… Created 2024-04-22

Frequently Asked Questions

1

What is the most popular #deepspeed repository on GitHub?

The top ranked open source #deepspeed project on GitHub is deepseek-ai/DeepSeek-Coder with 24,365 stars. DeepSeek Coder: Let the Code Write Itself

2

Which programming languages are most used in #deepspeed repositories?

Among the top ranked #deepspeed projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Ruby.

3

How is the #deepspeed repository ranking calculated?

We track 25 active open source repositories tagged with #deepspeed (500+ stars), totaling 68,253 stars with an average of 2,730 stars per repository. Rankings update daily from the GitHub API.