Git Stars Git Stars

#peft Repositories

Discover 20 active open source GitHub repositories tagged with #peft, accumulating 169,767 total stars (averaging 8,488 stars per project). Leading this topic is hiyouga/LlamaFactory with 76,171 stars.

20
Total Repositories
169,767
Total Stars
8,488
Avg Stars/Repo
1
hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

hiyouga
โญ 76,171 Python ๐Ÿ‘ค hiyouga User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-05-28
2
huggingface/peft

๐Ÿค— PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

huggingface
โญ 21,910 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2022-11-25
3
modelscope/ms-swift

Use PEFT or full-parameter training for CPT/SFT/DPO/GRPO on 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, LLaVA, Phi4, ...) (AAAI 2025).

modelscope
โญ 16,138 Python ๐Ÿ‘ค modelscope Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-08-01
4
artidoro/qlora

QLoRA: Efficient Finetuning of Quantized LLMs

artidoro
โญ 10,804 Jupyter Notebook ๐Ÿ‘ค artidoro User ๐Ÿ• Updated 2024-06-10 ๐Ÿ“… Created 2023-05-11
5
MakazhanAlpamys/Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

MakazhanAlpamys
โญ 10,703 Python ๐Ÿ‘ค MakazhanAlpamys User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-20
6
bigcode-project/starcoder

Home of StarCoder: fine-tuning & inference!

bigcode-project
โญ 7,527 Python ๐Ÿ‘ค bigcode-project Organization ๐Ÿ• Updated 2024-02-27 ๐Ÿ“… Created 2023-04-24
7
yangjianxin1/Firefly

Firefly: Large model training tool, supports training large models such as Qwen2.5, Qwen2, Yi1.5, Phi-3, Llama3, Gemma, MiniCPM, Yi, Deepseek, Orion, Xverse, Mixtral-8x7B, Zephyr, Mistral, Baichuan2, Llma2, Llama, Qwen, Baichuan, ChatGLM2, InternLM, Ziya2, Vicuna, Bloom, etc.

yangjianxin1
โญ 6,625 Python ๐Ÿ‘ค yangjianxin1 User ๐Ÿ• Updated 2024-10-24 ๐Ÿ“… Created 2023-04-02
8
zyds/transformers-code

Hand-in-hand practical Huggingface Transformers course videos are updated simultaneously on Bilibili and YouTube

zyds
โญ 3,662 Jupyter Notebook ๐Ÿ‘ค zyds User ๐Ÿ• Updated 2024-07-15 ๐Ÿ“… Created 2023-05-10
9
ashishpatel26/LLM-Finetuning

LLM Finetuning with peft

ashishpatel26
โญ 2,970 Jupyter Notebook ๐Ÿ‘ค ashishpatel26 User ๐Ÿ• Updated 2025-08-01 ๐Ÿ“… Created 2023-06-08
10
stochasticai/xTuring

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

stochasticai
โญ 2,680 Python ๐Ÿ‘ค stochasticai Organization ๐Ÿ• Updated 2026-11-05 ๐Ÿ“… Created 2023-03-19
11
ARahim3/mlx-tune

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning โ€” natively on MLX. Unsloth-compatible API.

ARahim3
โญ 1,475 Python ๐Ÿ‘ค ARahim3 User ๐Ÿ• Updated 2026-06-23 ๐Ÿ“… Created 2026-01-03
12
AutoArk/TinyEngram

Research of DeepSeek Engram Architecture based on Qwen-3 and Stable Diffusion series.

AutoArk
โญ 1,343 Python ๐Ÿ‘ค AutoArk Organization ๐Ÿ• Updated 2026-05-21 ๐Ÿ“… Created 2026-01-23
13
ModelCloud/GPTQModel

LLM model quantization (compression) toolkit with hardware acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU, Tenstorrent, Huawei Ascend NPU, and Intel/AMD/Apple CPUs via HF, vLLM, and SGLang.

ModelCloud
โญ 1,294 Python ๐Ÿ‘ค ModelCloud Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-06-17
14
Bolin97/GongBU

Paper accepted by CIKM 2024. Codes of GongBU, a LLM fine-tuning platform for domain-specific adaptation.

Bolin97
โญ 1,224 Svelte ๐Ÿ‘ค Bolin97 User ๐Ÿ• Updated 2026-01-22 ๐Ÿ“… Created 2024-05-23
15
X-LANCE/SLAM-LLM

A Framework for Speech, Language, Audio, Music Processing with Large Language Model

X-LANCE
โญ 1,072 Python ๐Ÿ‘ค X-LANCE Organization ๐Ÿ• Updated 2026-01-15 ๐Ÿ“… Created 2023-10-23
16
jondurbin/airoboros

Customizable implementation of the self-instruct paper.

jondurbin
โญ 1,050 Python ๐Ÿ‘ค jondurbin User ๐Ÿ• Updated 2024-03-07 ๐Ÿ“… Created 2023-04-29
17
dvgodoy/FineTuningLLMs

Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"

dvgodoy
โญ 878 Jupyter Notebook ๐Ÿ‘ค dvgodoy User ๐Ÿ• Updated 2026-02-28 ๐Ÿ“… Created 2024-08-15
18
whitecircle/halo

Halo is an open-source framework built by White Circle for training large language and multimodal models

whitecircle
โญ 868 Python ๐Ÿ‘ค whitecircle Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-08-26
19
DaoyuanLi2816/can-i-finetune-this

Single-GPU LLM fine-tuning preflight: memory estimates, runnable LoRA/QLoRA recipes, and local measurements.

DaoyuanLi2816
โญ 796 Python ๐Ÿ‘ค DaoyuanLi2816 User ๐Ÿ• Updated 2026-10-08 ๐Ÿ“… Created 2026-05-16
20
arielnlee/Platypus

Code for fine-tuning Platypus fam LLMs using LoRA

arielnlee
โญ 631 Python ๐Ÿ‘ค arielnlee User ๐Ÿ• Updated 2024-02-04 ๐Ÿ“… Created 2023-06-26

Frequently Asked Questions

1

What is the most popular #peft repository on GitHub?

The top ranked open source #peft project on GitHub is hiyouga/LlamaFactory with 76,171 stars. Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

2

Which programming languages are most used in #peft repositories?

Among the top ranked #peft projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Svelte.

3

How is the #peft repository ranking calculated?

We track 20 active open source repositories tagged with #peft (500+ stars), totaling 169,767 stars with an average of 8,488 stars per repository. Rankings update daily from the GitHub API.