Git Stars Git Stars

#direct-preference-optimization Repositories

Discover 11 active open source GitHub repositories tagged with #direct-preference-optimization, accumulating 41,696 total stars (averaging 3,790 stars per project). Leading this topic is huggingface/trl with 19,788 stars.

11
Total Repositories
41,696
Total Stars
3,790
Avg Stars/Repo
Programming Languages: Python
1
huggingface/trl

Train transformer language models with reinforcement learning.

huggingface
โญ 19,788 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-03-27
2
OpenManus/OpenManus-RL

A live stream development of RL tunning for LLM agents

OpenManus
โญ 4,178 Python ๐Ÿ‘ค OpenManus Organization ๐Ÿ• Updated 2026-05-05 ๐Ÿ“… Created 2025-03-06
3
allenai/open-instruct

AllenAI's post-training codebase

allenai
โญ 3,942 Python ๐Ÿ‘ค allenai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-06-09
โญ 3,186 Python ๐Ÿ‘ค stepfun-ai Organization ๐Ÿ• Updated 2025-03-17 ๐Ÿ“… Created 2025-02-08
5
eric-mitchell/direct-preference-optimization

Reference implementation for DPO (Direct Preference Optimization)

eric-mitchell
โญ 2,826 Python ๐Ÿ‘ค eric-mitchell User ๐Ÿ• Updated 2024-08-11 ๐Ÿ“… Created 2023-06-22
6
qibin0506/Cortex

Building Large Models from Scratch: A Complete Practice from Pretraining to RLHF

qibin0506
โญ 2,705 Python ๐Ÿ‘ค qibin0506 User ๐Ÿ• Updated 2026-08-21 ๐Ÿ“… Created 2025-06-24
8
qiufengqijun/mini_qwen

This is a project to train large language models from scratch, including pre-training, fine-tuning, and direct preference optimization, with the model having 1B parameters and supporting Chinese and English.

qiufengqijun
โญ 849 Python ๐Ÿ‘ค qiufengqijun User ๐Ÿ• Updated 2025-02-18 ๐Ÿ“… Created 2025-01-18
9
CodeGoat24/UnifiedReward

Official implementation of UnifiedReward & [NeurIPS 2025] UnifiedReward-Think & UnifiedReward-Flex

CodeGoat24
โญ 831 Python ๐Ÿ‘ค CodeGoat24 User ๐Ÿ• Updated 2026-06-18 ๐Ÿ“… Created 2025-03-04
11
SalesforceAIResearch/DiffusionDPO

Code for "Diffusion Model Alignment Using Direct Preference Optimization"

SalesforceAIResearch
โญ 717 Python ๐Ÿ‘ค SalesforceAIResearch Organization ๐Ÿ• Updated 2026-06-02 ๐Ÿ“… Created 2023-12-27

Frequently Asked Questions

1

What is the most popular #direct-preference-optimization repository on GitHub?

The top ranked open source #direct-preference-optimization project on GitHub is huggingface/trl with 19,788 stars. Train transformer language models with reinforcement learning.

2

Which programming languages are most used in #direct-preference-optimization repositories?

Among the top ranked #direct-preference-optimization projects on GitHub, the most common programming languages are Python.

3

How is the #direct-preference-optimization repository ranking calculated?

We track 11 active open source repositories tagged with #direct-preference-optimization (500+ stars), totaling 41,696 stars with an average of 3,790 stars per repository. Rankings update daily from the GitHub API.