Git Stars Git Stars

#rlhf Repositories

Discover 59 active open source GitHub repositories tagged with #rlhf, accumulating 335,276 total stars (averaging 5,682 stars per project). Leading this topic is hiyouga/LlamaFactory with 76,171 stars.

59
Total Repositories
335,276
Total Stars
5,682
Avg Stars/Repo
1
hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

hiyouga
โญ 76,171 Python ๐Ÿ‘ค hiyouga User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-05-28
2
Lordog/dive-into-llms

"Dive into LLMs: Building Large Language Models" Programming Practice Tutorial Series

Lordog
โญ 55,949 Jupyter Notebook ๐Ÿ‘ค Lordog User ๐Ÿ• Updated 2025-10-10 ๐Ÿ“… Created 2024-04-08
3
LAION-AI/Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

LAION-AI
โญ 37,485 Python ๐Ÿ‘ค LAION-AI Organization ๐Ÿ• Updated 2024-08-17 ๐Ÿ“… Created 2022-12-13
4
huggingface/open-r1

Fully open reproduction of DeepSeek-R1

huggingface
โญ 26,483 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2025-01-24
5
RUCAIBox/LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

RUCAIBox
โญ 12,165 Python ๐Ÿ‘ค RUCAIBox Organization ๐Ÿ• Updated 2025-03-11 ๐Ÿ“… Created 2023-03-14
6
InternLM/InternLM

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

InternLM
โญ 7,280 Python ๐Ÿ‘ค InternLM Organization ๐Ÿ• Updated 2025-10-30 ๐Ÿ“… Created 2023-07-06
7
ymcui/Chinese-LLaMA-Alpaca-2

Chinese LLaMA-2 & Alpaca-2 LLMs Phase II + 64K long context models (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

ymcui
โญ 7,098 Python ๐Ÿ‘ค ymcui User ๐Ÿ• Updated 2026-04-19 ๐Ÿ“… Created 2023-07-18
8
rasbt/reasoning-from-scratch

Implement a reasoning LLM in PyTorch from scratch, step by step

rasbt
โญ 5,885 Jupyter Notebook ๐Ÿ‘ค rasbt User ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2025-03-04
9
meta-pytorch/torchtune

PyTorch native post-training library

meta-pytorch
โญ 5,820 Python ๐Ÿ‘ค meta-pytorch Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2023-10-20
10
Gen-Verse/OpenClaw-RL

OpenClaw-RL: Train any agent simply by talking

Gen-Verse
โญ 5,750 Python ๐Ÿ‘ค Gen-Verse Organization ๐Ÿ• Updated 2026-05-23 ๐Ÿ“… Created 2026-02-26
11
huggingface/alignment-handbook

Robust recipes to align language models with human and AI preferences

huggingface
โญ 5,716 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-09-23 ๐Ÿ“… Created 2023-08-25
12
Kiln-AI/Kiln

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

Kiln-AI
โญ 5,286 Python ๐Ÿ‘ค Kiln-AI Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-07-23
13
argilla-io/argilla

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

argilla-io
โญ 5,208 Python ๐Ÿ‘ค argilla-io Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2021-04-28
14
transformerlab/transformerlab-app

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

transformerlab
โญ 5,200 Python ๐Ÿ‘ค transformerlab Organization ๐Ÿ• Updated 2026-11-05 ๐Ÿ“… Created 2023-12-24
15
walkinglabs/hands-on-modern-rl

๐Ÿš€ An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.

walkinglabs
โญ 4,936 Jupyter Notebook ๐Ÿ‘ค walkinglabs Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2026-04-10
16
PrimeIntellect-ai/verifiers

Our library for RL environments + evals

PrimeIntellect-ai
โญ 4,797 Python ๐Ÿ‘ค PrimeIntellect-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-01-22
17
PKU-Alignment/align-anything

Align Anything: Training All-modality Model with Feedback

PKU-Alignment
โญ 4,669 Python ๐Ÿ‘ค PKU-Alignment Organization ๐Ÿ• Updated 2025-11-27 ๐Ÿ“… Created 2024-07-14
18
opendilab/awesome-RLHF

A curated list of reinforcement learning with human feedback resources (continually updated)

opendilab
โญ 4,438 ๐Ÿ‘ค opendilab Organization ๐Ÿ• Updated 2026-05-20 ๐Ÿ“… Created 2023-02-13
19
Docta-ai/docta

A Doctor for your data

Docta-ai
โญ 3,479 Python ๐Ÿ‘ค Docta-ai Organization ๐Ÿ• Updated 2026-06-16 ๐Ÿ“… Created 2023-05-02
20
argilla-io/distilabel

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

argilla-io
โญ 3,467 Python ๐Ÿ‘ค argilla-io Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-10-16
21
alibaba/ROLL

An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models

alibaba
โญ 3,456 Python ๐Ÿ‘ค alibaba Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-05-28
22
eureka-research/Eureka

Official Repository for "Eureka: Human-Level Reward Design via Coding Large Language Models" (ICLR 2024)

eureka-research
โญ 3,098 Jupyter Notebook ๐Ÿ‘ค eureka-research Organization ๐Ÿ• Updated 2024-05-03 ๐Ÿ“… Created 2023-09-25
23
Exorust/TorchLeet

LeetCode for PyTorch โ€” 65 ML/AI interview problems from real interviews at Google, Meta, and Anthropic. Jupyter notebooks, an auto-grader, and an MCP AI tutor.

Exorust
โญ 2,644 Jupyter Notebook ๐Ÿ‘ค Exorust User ๐Ÿ• Updated 2026-11-06 ๐Ÿ“… Created 2024-12-25
24
natolambert/rlhf-book

Textbook on reinforcement learning from human feedback

natolambert
โญ 2,544 Python ๐Ÿ‘ค natolambert User ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2024-05-24
25
tatsu-lab/alpaca_eval

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

tatsu-lab
โญ 2,010 Jupyter Notebook ๐Ÿ‘ค tatsu-lab Organization ๐Ÿ• Updated 2025-08-09 ๐Ÿ“… Created 2023-05-25
26
thinkwee/AgentsMeetRL

Awesome List for Agentic RL

thinkwee
โญ 1,888 HTML ๐Ÿ‘ค thinkwee User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2025-06-09
27
zai-org/ImageReward

[NeurIPS 2023] ImageReward: Learning and Evaluating Human Preferences for Text-to-image Generation

zai-org
โญ 1,706 Python ๐Ÿ‘ค zai-org Organization ๐Ÿ• Updated 2025-10-29 ๐Ÿ“… Created 2023-04-01
28
PKU-Alignment/safe-rlhf

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

PKU-Alignment
โญ 1,624 Python ๐Ÿ‘ค PKU-Alignment Organization ๐Ÿ• Updated 2025-11-24 ๐Ÿ“… Created 2023-05-15
29
THUDM/WebGLM

WebGLM: An Efficient Web-enhanced Question Answering System (KDD 2023)

THUDM
โญ 1,605 Python ๐Ÿ‘ค THUDM Organization ๐Ÿ• Updated 2025-03-25 ๐Ÿ“… Created 2023-05-28
30
verl-project/verl-omni

Multimodal RL training framework for diffusion & omni models

verl-project
โญ 1,560 Python ๐Ÿ‘ค verl-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-21
31
RLHFlow/RLHF-Reward-Modeling

Recipes to train reward model for RLHF.

RLHFlow
โญ 1,532 Python ๐Ÿ‘ค RLHFlow Organization ๐Ÿ• Updated 2025-04-24 ๐Ÿ“… Created 2024-03-21
32
OpenLMLab/MOSS-RLHF

Secrets of RLHF in Large Language Models Part I: PPO

OpenLMLab
โญ 1,408 Python ๐Ÿ‘ค OpenLMLab Organization ๐Ÿ• Updated 2024-03-03 ๐Ÿ“… Created 2023-07-05
33
NVIDIA-NeMo/labs-molt

A scalable, agentic-first, and HuggingFace-native RL framework for research (9k lines).

NVIDIA-NeMo
โญ 1,395 Python ๐Ÿ‘ค NVIDIA-NeMo Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-06-23
34
xtreme1-io/xtreme1

Xtreme1 is an all-in-one data labeling and annotation platform for multimodal data training and supports 3D LiDAR point cloud, image, and LLM.

xtreme1-io
โญ 1,395 TypeScript ๐Ÿ‘ค xtreme1-io Organization ๐Ÿ• Updated 2026-09-29 ๐Ÿ“… Created 2022-08-08
36
NousResearch/atropos

Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse environments

NousResearch
โญ 1,324 Python ๐Ÿ‘ค NousResearch Organization ๐Ÿ• Updated 2026-06-29 ๐Ÿ“… Created 2025-04-29
37
agentscope-ai/OpenJudge

OpenJudge: A Unified Framework for Holistic Evaluation and Quality Rewards

agentscope-ai
โญ 1,121 Python ๐Ÿ‘ค agentscope-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-07-08
38
showlab/Awesome-MLLM-Hallucination

๐Ÿ“– A curated list of resources dedicated to hallucination of multimodal large language models (MLLM).

showlab
โญ 1,044 ๐Ÿ‘ค showlab Organization ๐Ÿ• Updated 2025-09-27 ๐Ÿ“… Created 2023-12-10
39
beyondguo/LLM-Tuning

Tuning LLMs with no tears๐Ÿ’ฆ; Sample Design Engineering (SDE) for more efficient downstream-tuning.

beyondguo
โญ 1,018 HTML ๐Ÿ‘ค beyondguo User ๐Ÿ• Updated 2024-04-27 ๐Ÿ“… Created 2023-06-19
40
tingaicompass/AI-Compass

"AI-Compass" will guide the community in navigating the ocean of AI technology. Whether you are a beginner or an advanced developer, you can find a path towards all major AI directions here. It aims to help developers systematically understand AIโ€™s core concepts, mainstream technologies, cuttingโ€‘edge trends, and, through practice, master the entire process from theory to implementation.

tingaicompass
โญ 1,000 Python ๐Ÿ‘ค tingaicompass User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-05-27
41
princeton-nlp/SimPO

[NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward

princeton-nlp
โญ 953 Python ๐Ÿ‘ค princeton-nlp Organization ๐Ÿ• Updated 2025-02-16 ๐Ÿ“… Created 2024-05-21
42
chrisliu298/awesome-on-policy-distillation

A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of large language models

chrisliu298
โญ 926 ๐Ÿ‘ค chrisliu298 User ๐Ÿ• Updated 2026-10-06 ๐Ÿ“… Created 2026-03-22
43
ContextualAI/HALOs

A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).

ContextualAI
โญ 910 Python ๐Ÿ‘ค ContextualAI Organization ๐Ÿ• Updated 2025-09-30 ๐Ÿ“… Created 2023-12-03
44
whitecircle/halo

Halo is an open-source framework built by White Circle for training large language and multimodal models

whitecircle
โญ 868 Python ๐Ÿ‘ค whitecircle Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-08-26
45
inworld-ai/tts

Inworld TTS

inworld-ai
โญ 782 Python ๐Ÿ‘ค inworld-ai Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2025-05-02
46
allenai/reward-bench

RewardBench: the first evaluation tool for reward models.

allenai
โญ 749 Python ๐Ÿ‘ค allenai Organization ๐Ÿ• Updated 2026-10-14 ๐Ÿ“… Created 2023-12-23
47
GaryYufei/AlignLLMHumanSurvey

Aligning Large Language Models with Human: A Survey

GaryYufei
โญ 739 ๐Ÿ‘ค GaryYufei User ๐Ÿ• Updated 2026-09-08 ๐Ÿ“… Created 2023-07-23
48
agentscope-ai/Trinity-RFT

Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (LLM).

agentscope-ai
โญ 714 Python ๐Ÿ‘ค agentscope-ai Organization ๐Ÿ• Updated 2026-10-08 ๐Ÿ“… Created 2025-04-09
49
redai-studio/Relax

An Asynchronous Reinforcement Learning Engine for Omni-Modal Post-Training at Scale

redai-studio
โญ 678 Python ๐Ÿ‘ค redai-studio Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-13
50
sail-sg/oat

๐ŸŒพ OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.

sail-sg
โญ 678 Python ๐Ÿ‘ค sail-sg Organization ๐Ÿ• Updated 2026-01-29 ๐Ÿ“… Created 2024-10-15

Frequently Asked Questions

1

What is the most popular #rlhf repository on GitHub?

The top ranked open source #rlhf project on GitHub is hiyouga/LlamaFactory with 76,171 stars. Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

2

Which programming languages are most used in #rlhf repositories?

Among the top ranked #rlhf projects on GitHub, the most common programming languages are Python, Jupyter Notebook, HTML, TypeScript.

3

How is the #rlhf repository ranking calculated?

We track 59 active open source repositories tagged with #rlhf (500+ stars), totaling 335,276 stars with an average of 5,682 stars per repository. Rankings update daily from the GitHub API.