Git Stars Git Stars

#parameter-efficient-fine-tuning Repositories

Discover 22 active open source GitHub repositories tagged with #parameter-efficient-fine-tuning, accumulating 91,362 total stars (averaging 4,152 stars per project). Leading this topic is huggingface/trl with 19,788 stars.

22
Total Repositories
91,362
Total Stars
4,152
Avg Stars/Repo
Programming Languages: Python Jupyter Notebook
1
huggingface/trl

Train transformer language models with reinforcement learning.

huggingface
โญ 19,788 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-03-27
2
tloen/alpaca-lora

Instruct-tune LLaMA on consumer hardware

tloen
โญ 18,987 Jupyter Notebook ๐Ÿ‘ค tloen User ๐Ÿ• Updated 2024-07-29 ๐Ÿ“… Created 2023-03-13
3
ZJU-LLMs/Foundations-of-LLMs

A book for Learning the Foundations of LLMs

ZJU-LLMs
โญ 18,631 ๐Ÿ‘ค ZJU-LLMs User ๐Ÿ• Updated 2025-12-12 ๐Ÿ“… Created 2024-06-30
4
modelscope/facechain

FaceChain is a deep-learning toolchain for generating your Digital-Twin.

modelscope
โญ 9,496 Jupyter Notebook ๐Ÿ‘ค modelscope Organization ๐Ÿ• Updated 2025-06-06 ๐Ÿ“… Created 2023-08-10
5
OpenGVLab/LLaMA-Adapter

[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters

OpenGVLab
โญ 5,931 Python ๐Ÿ‘ค OpenGVLab Organization ๐Ÿ• Updated 2024-03-14 ๐Ÿ“… Created 2023-03-19
6
km1994/LLMs_interview_notes

This repository mainly records interview questions related to Large Language Model (LLM) Algorithm Engineers.

km1994
โญ 2,670 ๐Ÿ‘ค km1994 User ๐Ÿ• Updated 2026-10-11 ๐Ÿ“… Created 2023-09-16
7
google/tunix

A Lightweight LLM Post-Training Library

google
โญ 2,516 Python ๐Ÿ‘ค google Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-04-02
8
km1994/LLMsNineStoryDemonTower

ใ€LLMs Nine-Layered Demon Towerใ€‘Sharing LLMs practical experiences and knowledge in fields such as Natural Language Processing (ChatGLM, Chinese-LLaMA-Alpaca, Xiaoyangtuo Vicuna, LLaMA, GPT4ALL, etc.), Information Retrieval (langchain), Language Synthesis, Language Recognition, Multimodal (Stable Diffusion, MiniGPT-4, VisualGLM-6B, Ziya-Visual, etc.).

km1994
โญ 2,140 ๐Ÿ‘ค km1994 User ๐Ÿ• Updated 2024-03-30 ๐Ÿ“… Created 2023-05-01
9
liliu-avril/Awesome-Segment-Anything

This repository is for the first comprehensive survey on Meta AI's Segment Anything Model (SAM).

liliu-avril
โญ 1,227 ๐Ÿ‘ค liliu-avril User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-05-16
10
CSHaitao/LexiLaw

LexiLaw - Chinese Legal Large Language Model

CSHaitao
โญ 1,058 Python ๐Ÿ‘ค CSHaitao User ๐Ÿ• Updated 2026-03-12 ๐Ÿ“… Created 2023-05-16
11
NVlabs/DoRA

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

NVlabs
โญ 1,007 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-03-24 ๐Ÿ“… Created 2024-04-11
12
XiangLi1999/PrefixTuning

Prefix-Tuning: Optimizing Continuous Prompts for Generation

XiangLi1999
โญ 958 Python ๐Ÿ‘ค XiangLi1999 User ๐Ÿ• Updated 2024-04-26 ๐Ÿ“… Created 2021-01-21
13
mst272/LLM-Dojo

Lightweight LLM Post-training Framework, supports SFT, RLVR, On-Policy KD, Guide KD, and mixed training; implements single/multi-round Guide distillation, multi-teacher distillation, Reward mixed training, and automated data sharding๐Ÿ‘ฉโ€๐ŸŽ“๐Ÿ‘จโ€๐ŸŽ“

mst272
โญ 939 Python ๐Ÿ‘ค mst272 User ๐Ÿ• Updated 2026-03-08 ๐Ÿ“… Created 2024-01-23
14
yule-BUAA/MergeLM

Codebase for Merging Language Models (ICML 2024)

yule-BUAA
โญ 862 Python ๐Ÿ‘ค yule-BUAA User ๐Ÿ• Updated 2024-05-05 ๐Ÿ“… Created 2023-11-06
15
dhcode-cpp/X-R1

minimal-cost for training 0.5B R1-Zero

dhcode-cpp
โญ 815 Python ๐Ÿ‘ค dhcode-cpp User ๐Ÿ• Updated 2025-05-14 ๐Ÿ“… Created 2025-02-11
17
magic-research/PLLaVA

Official repository for the paper PLLaVA

magic-research
โญ 676 Python ๐Ÿ‘ค magic-research Organization ๐Ÿ• Updated 2024-07-28 ๐Ÿ“… Created 2024-04-18
18
HighCWu/ControlLoRA

ControlLoRA: A Lightweight Neural Network To Control Stable Diffusion Spatial Information

HighCWu
โญ 619 Python ๐Ÿ‘ค HighCWu User ๐Ÿ• Updated 2024-07-31 ๐Ÿ“… Created 2023-02-18
20
predibase/llm_distillation_playbook

Best practices for distilling large language models.

predibase
โญ 596 Jupyter Notebook ๐Ÿ‘ค predibase Organization ๐Ÿ• Updated 2024-02-01 ๐Ÿ“… Created 2023-12-06
21
synbol/Awesome-Parameter-Efficient-Transfer-Learning

Collection of awesome parameter-efficient fine-tuning resources.

synbol
โญ 591 ๐Ÿ‘ค synbol User ๐Ÿ• Updated 2025-12-10 ๐Ÿ“… Created 2022-11-24

Frequently Asked Questions

1

What is the most popular #parameter-efficient-fine-tuning repository on GitHub?

The top ranked open source #parameter-efficient-fine-tuning project on GitHub is huggingface/trl with 19,788 stars. Train transformer language models with reinforcement learning.

2

Which programming languages are most used in #parameter-efficient-fine-tuning repositories?

Among the top ranked #parameter-efficient-fine-tuning projects on GitHub, the most common programming languages are Python, Jupyter Notebook.

3

How is the #parameter-efficient-fine-tuning repository ranking calculated?

We track 22 active open source repositories tagged with #parameter-efficient-fine-tuning (500+ stars), totaling 91,362 stars with an average of 4,152 stars per repository. Rankings update daily from the GitHub API.