Git Stars Git Stars

#dpo Repositories

Discover 14 active open source GitHub repositories tagged with #dpo, accumulating 43,116 total stars (averaging 3,079 stars per project). Leading this topic is MakazhanAlpamys/Soup with 10,703 stars.

14
Total Repositories
43,116
Total Stars
3,079
Avg Stars/Repo
Programming Languages: Python Jupyter Notebook
1
MakazhanAlpamys/Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

MakazhanAlpamys
โญ 10,703 Python ๐Ÿ‘ค MakazhanAlpamys User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-20
2
oumi-ai/oumi

Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

oumi-ai
โญ 9,441 Python ๐Ÿ‘ค oumi-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-05-07
3
shibing624/MedicalGPT

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. Training a medical large model, which includes incremental pre-training (PT), supervised fine-tuning (SFT), RLHF, DPO, ORPO, GRPO.

shibing624
โญ 5,901 Python ๐Ÿ‘ค shibing624 User ๐Ÿ• Updated 2026-09-15 ๐Ÿ“… Created 2023-06-02
4
walkinglabs/hands-on-modern-rl

๐Ÿš€ An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.

walkinglabs
โญ 4,936 Jupyter Notebook ๐Ÿ‘ค walkinglabs Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2026-04-10
5
PKU-Alignment/align-anything

Align Anything: Training All-modality Model with Feedback

PKU-Alignment
โญ 4,669 Python ๐Ÿ‘ค PKU-Alignment Organization ๐Ÿ• Updated 2025-11-27 ๐Ÿ“… Created 2024-07-14
โญ 1,323 Python ๐Ÿ‘ค ChenmienTan User ๐Ÿ• Updated 2026-05-20 ๐Ÿ“… Created 2025-04-04
7
ElectricAlexis/NotaGen

NotaGen: Advancing Musicality in Symbolic Music Generation with Large Language Model Training Paradigms

ElectricAlexis
โญ 1,202 Python ๐Ÿ‘ค ElectricAlexis User ๐Ÿ• Updated 2025-04-21 ๐Ÿ“… Created 2024-06-01
8
ContextualAI/HALOs

A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).

ContextualAI
โญ 910 Python ๐Ÿ‘ค ContextualAI Organization ๐Ÿ• Updated 2025-09-30 ๐Ÿ“… Created 2023-12-03
9
ZiyuGuo99/Image-Generation-CoT

[CVPR 2025] The First Investigation of CoT Reasoning (RL, TTS, Reflection) in Image Generation

ZiyuGuo99
โญ 865 Python ๐Ÿ‘ค ZiyuGuo99 User ๐Ÿ• Updated 2026-03-19 ๐Ÿ“… Created 2025-01-23
10
zhaorw02/DeepMesh

[ICCV 2025] Official code of DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learning

zhaorw02
โญ 739 Python ๐Ÿ‘ค zhaorw02 User ๐Ÿ• Updated 2025-12-17 ๐Ÿ“… Created 2025-03-18
11
sail-sg/oat

๐ŸŒพ OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.

sail-sg
โญ 678 Python ๐Ÿ‘ค sail-sg Organization ๐Ÿ• Updated 2026-01-29 ๐Ÿ“… Created 2024-10-15
12
jianzhnie/LLamaTuner

Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM, Falcon) Efficient Quantization Training + Deployment of Large Models.

jianzhnie
โญ 620 Python ๐Ÿ‘ค jianzhnie User ๐Ÿ• Updated 2025-01-24 ๐Ÿ“… Created 2023-05-25
13
wendell0218/Awesome-RL-for-Video-Generation

A curated list of papers on reinforcement learning for video generation

wendell0218
โญ 587 ๐Ÿ‘ค wendell0218 User ๐Ÿ• Updated 2026-04-15 ๐Ÿ“… Created 2025-02-13
14
ukairia777/tensorflow-nlp-tutorial

A Deep Learning NLP repository that summarizes text preprocessing, Topic Models, and downstream tasks of state-of-the-art models such as BERT, GPT, and LLMs using TensorFlow.

ukairia777
โญ 580 Jupyter Notebook ๐Ÿ‘ค ukairia777 User ๐Ÿ• Updated 2026-06-05 ๐Ÿ“… Created 2021-12-30

Frequently Asked Questions

1

What is the most popular #dpo repository on GitHub?

The top ranked open source #dpo project on GitHub is MakazhanAlpamys/Soup with 10,703 stars. Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

2

Which programming languages are most used in #dpo repositories?

Among the top ranked #dpo projects on GitHub, the most common programming languages are Python, Jupyter Notebook.

3

How is the #dpo repository ranking calculated?

We track 14 active open source repositories tagged with #dpo (500+ stars), totaling 43,116 stars with an average of 3,079 stars per repository. Rankings update daily from the GitHub API.