Git Stars Git Stars

#llm-fine-tuning Repositories

Discover 60 active open source GitHub repositories tagged with #llm-fine-tuning, accumulating 139,572 total stars (averaging 2,326 stars per project). Leading this topic is Jiayi-Pan/TinyZero with 13,259 stars.

60
Total Repositories
139,572
Total Stars
2,326
Avg Stars/Repo
1
Jiayi-Pan/TinyZero

Minimal reproduction of DeepSeek R1-Zero

Jiayi-Pan
โญ 13,259 Python ๐Ÿ‘ค Jiayi-Pan User ๐Ÿ• Updated 2026-02-27 ๐Ÿ“… Created 2025-01-21
2
NVIDIA/personaplex

PersonaPlex code.

NVIDIA
โญ 12,156 Python ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-06 ๐Ÿ“… Created 2026-01-05
โญ 9,014 Python ๐Ÿ‘ค togethercomputer Organization ๐Ÿ• Updated 2024-04-09 ๐Ÿ“… Created 2023-03-03
4
bigcode-project/starcoder

Home of StarCoder: fine-tuning & inference!

bigcode-project
โญ 7,527 Python ๐Ÿ‘ค bigcode-project Organization ๐Ÿ• Updated 2024-02-27 ๐Ÿ“… Created 2023-04-24
5
henrythe9th/AI-Crash-Course

AI Crash Course to help busy builders catch up to the public frontier of AI research in 2 weeks

henrythe9th
โญ 6,274 ๐Ÿ‘ค henrythe9th User ๐Ÿ• Updated 2026-02-23 ๐Ÿ“… Created 2025-01-08
6
pengxiao-song/LaWGPT

๐ŸŽ‰ Repo for LaWGPT, Chinese-Llama tuned with Chinese Legal knowledge. Large language model based on Chinese legal knowledge.

pengxiao-song
โญ 6,022 Python ๐Ÿ‘ค pengxiao-song User ๐Ÿ• Updated 2024-06-11 ๐Ÿ“… Created 2023-04-20
8
SakuraLLM/SakuraLLM

Chinese-Japanese Translation Large Model for Light Novels/Galgames

SakuraLLM
โญ 4,858 Python ๐Ÿ‘ค SakuraLLM Organization ๐Ÿ• Updated 2026-07-23 ๐Ÿ“… Created 2023-08-23
9
Hoper-J/AI-Guide-and-Demos-zh_CN

This is a step-by-step guide to getting started with AI/LLM large models, including tutorials and demo code. It takes you from APIs to local large model deployment and fine-tuning. The code files will be provided in online versions for Kaggle or Colab, allowing you to learn even without a graphics card. The project also features a small code playground ๐ŸŽก where you can experiment with interesting AI scripts. Simultaneously, it includes a complete Chinese mirrored version of the assignments from Hung-Yi Lee's (HUNG-YI LEE) 2024 Introduction to Generative AI course.

Hoper-J
โญ 4,834 Python ๐Ÿ‘ค Hoper-J User ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2024-09-10
10
thinking-machines-lab/tinker-cookbook

Post-training with Tinker

thinking-machines-lab
โญ 4,291 Python ๐Ÿ‘ค thinking-machines-lab Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-07-14
11
OpenManus/OpenManus-RL

A live stream development of RL tunning for LLM agents

OpenManus
โญ 4,178 Python ๐Ÿ‘ค OpenManus Organization ๐Ÿ• Updated 2026-05-05 ๐Ÿ“… Created 2025-03-06
โญ 4,168 Jupyter Notebook ๐Ÿ‘ค mshumer User ๐Ÿ• Updated 2025-05-02 ๐Ÿ“… Created 2023-08-09
13
Clouditera/SecGPT

SecGPT Cybersecurity Large Language Model

Clouditera
โญ 3,070 Python ๐Ÿ‘ค Clouditera Organization ๐Ÿ• Updated 2025-06-25 ๐Ÿ“… Created 2023-11-20
14
eric-mitchell/direct-preference-optimization

Reference implementation for DPO (Direct Preference Optimization)

eric-mitchell
โญ 2,826 Python ๐Ÿ‘ค eric-mitchell User ๐Ÿ• Updated 2024-08-11 ๐Ÿ“… Created 2023-06-22
15
AkariAsai/self-rag

This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.

AkariAsai
โญ 2,282 Python ๐Ÿ‘ค AkariAsai User ๐Ÿ• Updated 2024-05-25 ๐Ÿ“… Created 2023-10-10
16
PrimeIntellect-ai/prime-rl

Agentic RL Training at Scale

PrimeIntellect-ai
โญ 2,268 Python ๐Ÿ‘ค PrimeIntellect-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-02-18
17
NVIDIA-NeMo/RL

Scalable toolkit for efficient model reinforcement

NVIDIA-NeMo
โญ 2,146 Python ๐Ÿ‘ค NVIDIA-NeMo Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-03-16
18
aceliuchanghong/FAQ_Of_LLM_Interview

Large Model Algorithm Position Interview Questions (with Answers): Common Questions and Concept Analysis "Large Model Interview Questions", "Algorithm Position Interview", "Common Interview Questions", "Large Model Algorithm Interview", "Large Model Application Fundamentals"

aceliuchanghong
โญ 2,064 Jupyter Notebook ๐Ÿ‘ค aceliuchanghong User ๐Ÿ• Updated 2026-09-17 ๐Ÿ“… Created 2024-03-13
19
fastai/lm-hackers

Hackers' Guide to Language Models

fastai
โญ 1,862 Jupyter Notebook ๐Ÿ‘ค fastai Organization ๐Ÿ• Updated 2024-12-13 ๐Ÿ“… Created 2023-09-24
20
policy-gradient/GRPO-Zero

Implementing DeepSeek R1's GRPO algorithm from scratch

policy-gradient
โญ 1,854 Python ๐Ÿ‘ค policy-gradient Organization ๐Ÿ• Updated 2025-04-18 ๐Ÿ“… Created 2025-04-08
21
openreasoner/openr

OpenR: An Open Source Framework for Advanced Reasoning with Large Language Models

openreasoner
โญ 1,846 Python ๐Ÿ‘ค openreasoner Organization ๐Ÿ• Updated 2025-01-17 ๐Ÿ“… Created 2024-10-11
22
Continual-Intelligence/SEAL

Self-Adapting Language Models

Continual-Intelligence
โญ 1,833 Python ๐Ÿ‘ค Continual-Intelligence Organization ๐Ÿ• Updated 2025-08-01 ๐Ÿ“… Created 2025-06-13
23
janhq/awesome-local-ai

An awesome repository of local AI tools

janhq
โญ 1,791 ๐Ÿ‘ค janhq Organization ๐Ÿ• Updated 2024-11-13 ๐Ÿ“… Created 2023-09-06
24
lsdefine/simple_GRPO

A very simple GRPO implement for reproducing r1-like LLM thinking.

lsdefine
โญ 1,719 Python ๐Ÿ‘ค lsdefine User ๐Ÿ• Updated 2025-11-21 ๐Ÿ“… Created 2025-02-10
25
Osilly/Vision-R1

[ICLR2026] This is the first paper to explore how to effectively use R1-like RL for MLLMs and introduce Visionโ€‘R1, a reasoning MLLM that leverages coldโ€‘start initialization and RL training to incentivize reasoning capability.

Osilly
โญ 1,558 Python ๐Ÿ‘ค Osilly User ๐Ÿ• Updated 2026-03-20 ๐Ÿ“… Created 2025-02-03
26
EvolvingLMMs-Lab/open-r1-multimodal

A fork to add multimodal model training to open-r1

EvolvingLMMs-Lab
โญ 1,556 Python ๐Ÿ‘ค EvolvingLMMs-Lab Organization ๐Ÿ• Updated 2025-02-08 ๐Ÿ“… Created 2025-01-27
โญ 1,503 Jupyter Notebook ๐Ÿ‘ค modelscope Organization ๐Ÿ• Updated 2026-04-27 ๐Ÿ“… Created 2024-03-02
28
horselock/Jailbreaks

NSFW Jailbreaks for various LLMs

horselock
โญ 1,458 Roff ๐Ÿ‘ค horselock User ๐Ÿ• Updated 2025-12-15 ๐Ÿ“… Created 2025-05-26
29
instructlab/instructlab

InstructLab Core package. Use this to chat with a model and execute the InstructLab workflow to train a model using custom taxonomy data.

instructlab
โญ 1,415 Python ๐Ÿ‘ค instructlab Organization ๐Ÿ• Updated 2026-03-30 ๐Ÿ“… Created 2024-02-21
32
0xSojalSec/LLMs-local

List of awesome platforms, tools, and resources for running LLMs locally

0xSojalSec
โญ 1,206 ๐Ÿ‘ค 0xSojalSec User ๐Ÿ• Updated 2026-06-10 ๐Ÿ“… Created 2025-12-17
33
henrywoo/chatllama

ChatLLaMA ๐Ÿ“ข Open source implementation for LLaMA-based ChatGPT runnable in a single GPU. 15x faster training process than ChatGPT

henrywoo
โญ 1,200 Python ๐Ÿ‘ค henrywoo User ๐Ÿ• Updated 2026-10-08 ๐Ÿ“… Created 2023-02-27
34
GAIR-NLP/LIMO

[COLM 2025] LIMO: Less is More for Reasoning

GAIR-NLP
โญ 1,081 Python ๐Ÿ‘ค GAIR-NLP Organization ๐Ÿ• Updated 2025-07-30 ๐Ÿ“… Created 2025-02-04
35
jondurbin/airoboros

Customizable implementation of the self-instruct paper.

jondurbin
โญ 1,050 Python ๐Ÿ‘ค jondurbin User ๐Ÿ• Updated 2024-03-07 ๐Ÿ“… Created 2023-04-29
36
DjangoPeng/LLM-quickstart

Quick Start for Large Language Models (Theoretical Learning and Practical Fine-tuning)

DjangoPeng
โญ 1,047 Jupyter Notebook ๐Ÿ‘ค DjangoPeng User ๐Ÿ• Updated 2025-06-09 ๐Ÿ“… Created 2023-12-11
37
beyondguo/LLM-Tuning

Tuning LLMs with no tears๐Ÿ’ฆ; Sample Design Engineering (SDE) for more efficient downstream-tuning.

beyondguo
โญ 1,018 HTML ๐Ÿ‘ค beyondguo User ๐Ÿ• Updated 2024-04-27 ๐Ÿ“… Created 2023-06-19
38
OpenLMLab/LOMO

LOMO: LOw-Memory Optimization

OpenLMLab
โญ 991 Python ๐Ÿ‘ค OpenLMLab Organization ๐Ÿ• Updated 2024-07-02 ๐Ÿ“… Created 2023-06-16
39
tulerfeng/Video-R1

Video-R1: Reinforcing Video Reasoning in MLLMs [๐Ÿ”ฅthe first paper to explore R1 for video]

tulerfeng
โญ 900 Python ๐Ÿ‘ค tulerfeng User ๐Ÿ• Updated 2025-12-14 ๐Ÿ“… Created 2025-02-22
40
Nebius-Academy/LLM-Engineering-Essentials

Materials for the LLM Engineering Essentials course

Nebius-Academy
โญ 844 Jupyter Notebook ๐Ÿ‘ค Nebius-Academy Organization ๐Ÿ• Updated 2026-03-30 ๐Ÿ“… Created 2025-02-17
41
databricks-academy/large-language-models

Notebooks for Large Language Models (LLMs) Specialization

databricks-academy
โญ 824 Python ๐Ÿ‘ค databricks-academy Organization ๐Ÿ• Updated 2024-05-23 ๐Ÿ“… Created 2023-06-02
42
KMnO4-zx/huanhuan-chat

Chat-Zhen Huan is a chat language model obtained by LoRA fine-tuning ChatGLM2 using all lines and sentences about Zhen Huan from the script of "The Legend of Zhen Huan" to imitate Zhen Huan's tone.

KMnO4-zx
โญ 820 Python ๐Ÿ‘ค KMnO4-zx User ๐Ÿ• Updated 2025-05-21 ๐Ÿ“… Created 2023-07-10
43
SWE-Gym/SWE-Gym

Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]

SWE-Gym
โญ 764 Jupyter Notebook ๐Ÿ‘ค SWE-Gym Organization ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2024-11-04
44
SkyworkAI/Skywork-OR1

Unleashing the Power of Reinforcement Learning for Math and Code Reasoners

SkyworkAI
โญ 744 Python ๐Ÿ‘ค SkyworkAI Organization ๐Ÿ• Updated 2025-06-06 ๐Ÿ“… Created 2025-04-11
46
stanford-futuredata/ARES

Automated Evaluation of RAG Systems

stanford-futuredata
โญ 711 Python ๐Ÿ‘ค stanford-futuredata Organization ๐Ÿ• Updated 2025-03-28 ๐Ÿ“… Created 2023-09-27
48
open-tinker/OpenTinker

OpenTinker is an RL-as-a-Service infrastructure for foundation models

open-tinker
โญ 677 Python ๐Ÿ‘ค open-tinker Organization ๐Ÿ• Updated 2026-03-21 ๐Ÿ“… Created 2025-12-20
49
modal-labs/llm-finetuning

Guide for fine-tuning Llama/Mistral/CodeLlama models and more

modal-labs
โญ 650 Python ๐Ÿ‘ค modal-labs Organization ๐Ÿ• Updated 2025-10-15 ๐Ÿ“… Created 2023-09-14
50
Zeyi-Lin/LLM-Finetune

Large language model fine-tuning, Qwen2VL, Qwen2, GLM4 instruction fine-tuning

Zeyi-Lin
โญ 644 Jupyter Notebook ๐Ÿ‘ค Zeyi-Lin User ๐Ÿ• Updated 2025-05-26 ๐Ÿ“… Created 2024-06-10

Frequently Asked Questions

1

What is the most popular #llm-fine-tuning repository on GitHub?

The top ranked open source #llm-fine-tuning project on GitHub is Jiayi-Pan/TinyZero with 13,259 stars. Minimal reproduction of DeepSeek R1-Zero

2

Which programming languages are most used in #llm-fine-tuning repositories?

Among the top ranked #llm-fine-tuning projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Roff, HTML.

3

How is the #llm-fine-tuning repository ranking calculated?

We track 60 active open source repositories tagged with #llm-fine-tuning (500+ stars), totaling 139,572 stars with an average of 2,326 stars per repository. Rankings update daily from the GitHub API.