Git Stars Git Stars

#instruction-tuning Repositories

Discover 73 active open source GitHub repositories tagged with #instruction-tuning, accumulating 461,684 total stars (averaging 6,324 stars per project). Leading this topic is rasbt/LLMs-from-scratch with 108,745 stars.

73
Total Repositories
461,684
Total Stars
6,324
Avg Stars/Repo
1
rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

rasbt
โญ 108,745 Jupyter Notebook ๐Ÿ‘ค rasbt User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-07-23
2
hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

hiyouga
โญ 76,171 Python ๐Ÿ‘ค hiyouga User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-05-28
3
linexjlin/GPTs

leaked prompts of GPTs

linexjlin
โญ 31,835 ๐Ÿ‘ค linexjlin User ๐Ÿ• Updated 2024-09-27 ๐Ÿ“… Created 2023-11-11
4
deepseek-ai/DeepSeek-Coder

DeepSeek Coder: Let the Code Write Itself

deepseek-ai
โญ 24,365 Python ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2025-11-11 ๐Ÿ“… Created 2023-10-20
5
haotian-liu/LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

haotian-liu
โญ 24,232 Python ๐Ÿ‘ค haotian-liu User ๐Ÿ• Updated 2024-08-12 ๐Ÿ“… Created 2023-04-17
6
tloen/alpaca-lora

Instruct-tune LLaMA on consumer hardware

tloen
โญ 18,987 Jupyter Notebook ๐Ÿ‘ค tloen User ๐Ÿ• Updated 2024-07-29 ๐Ÿ“… Created 2023-03-13
7
BradyFU/Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

BradyFU
โญ 18,090 ๐Ÿ‘ค BradyFU User ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2023-05-19
8
RUCAIBox/LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

RUCAIBox
โญ 12,165 Python ๐Ÿ‘ค RUCAIBox Organization ๐Ÿ• Updated 2025-03-11 ๐Ÿ“… Created 2023-03-14
9
nlpxucan/WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

nlpxucan
โญ 9,483 Python ๐Ÿ‘ค nlpxucan User ๐Ÿ• Updated 2025-06-07 ๐Ÿ“… Created 2023-04-23
โญ 9,014 Python ๐Ÿ‘ค togethercomputer Organization ๐Ÿ• Updated 2024-04-09 ๐Ÿ“… Created 2023-03-03
โญ 8,646 Python ๐Ÿ‘ค apple-aiml-research Organization ๐Ÿ• Updated 2026-09-11 ๐Ÿ“… Created 2023-10-06
12
datajuicer/data-juicer

Data processing for and with foundation models! ๐ŸŽ ๐Ÿ‹ ๐ŸŒฝ โžก๏ธ โžก๏ธ๐Ÿธ ๐Ÿน ๐Ÿท

datajuicer
โญ 7,266 Python ๐Ÿ‘ค datajuicer Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-08-01
13
huggingface/smol-course

A course on aligning smol models.

huggingface
โญ 6,799 Jupyter Notebook ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2024-11-25
14
allenai/OLMo

Modeling, training, eval, and inference code for OLMo

allenai
โญ 6,739 Python ๐Ÿ‘ค allenai Organization ๐Ÿ• Updated 2025-11-24 ๐Ÿ“… Created 2023-02-20
15
pengxiao-song/LaWGPT

๐ŸŽ‰ Repo for LaWGPT, Chinese-Llama tuned with Chinese Legal knowledge. Large language model based on Chinese legal knowledge.

pengxiao-song
โญ 6,022 Python ๐Ÿ‘ค pengxiao-song User ๐Ÿ• Updated 2024-06-11 ๐Ÿ“… Created 2023-04-20
16
OpenGVLab/LLaMA-Adapter

[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters

OpenGVLab
โญ 5,931 Python ๐Ÿ‘ค OpenGVLab Organization ๐Ÿ• Updated 2024-03-14 ๐Ÿ“… Created 2023-03-19
17
OpenBMB/ToolBench

[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.

OpenBMB
โญ 5,654 Python ๐Ÿ‘ค OpenBMB Organization ๐Ÿ• Updated 2025-05-21 ๐Ÿ“… Created 2023-05-28
19
allenai/open-instruct

AllenAI's post-training codebase

allenai
โญ 3,942 Python ๐Ÿ‘ค allenai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-06-09
20
NExT-GPT/NExT-GPT

Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model

NExT-GPT
โญ 3,626 Python ๐Ÿ‘ค NExT-GPT User ๐Ÿ• Updated 2025-05-13 ๐Ÿ“… Created 2023-08-30
21
DSXiangLi/DecryptPrompt

Summary of Prompt & LLM papers, open source data & models, AIGC applications

DSXiangLi
โญ 3,453 ๐Ÿ‘ค DSXiangLi User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-02-10
22
PKU-YuanGroup/Video-LLaVA

ใ€EMNLP 2024๐Ÿ”ฅใ€‘Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

PKU-YuanGroup
โญ 3,425 Python ๐Ÿ‘ค PKU-YuanGroup Organization ๐Ÿ• Updated 2024-12-03 ๐Ÿ“… Created 2023-10-23
23
yoloytang/Awesome-LLMs-for-Video-Understanding

๐Ÿ”ฅ๐Ÿ”ฅ๐Ÿ”ฅ [IEEE TCSVT] Latest Papers, Codes and Datasets on Vid-LLMs.

yoloytang
โญ 3,310 ๐Ÿ‘ค yoloytang User ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2023-07-16
24
EvolvingLMMs-Lab/Otter

Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

EvolvingLMMs-Lab
โญ 3,283 Python ๐Ÿ‘ค EvolvingLMMs-Lab Organization ๐Ÿ• Updated 2024-03-05 ๐Ÿ“… Created 2023-04-01
25
tekaratzas/RustGPT

An transformer based LLM. Written completely in Rust

tekaratzas
โญ 3,187 Rust ๐Ÿ‘ค tekaratzas User ๐Ÿ• Updated 2025-10-10 ๐Ÿ“… Created 2025-09-13
โญ 3,090 Python ๐Ÿ‘ค mistralai Organization ๐Ÿ• Updated 2026-06-12 ๐Ÿ“… Created 2024-05-24
27
InternLM/InternLM-XComposer

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

InternLM
โญ 2,925 Python ๐Ÿ‘ค InternLM Organization ๐Ÿ• Updated 2025-05-26 ๐Ÿ“… Created 2023-09-26
28
X-PLUG/mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

X-PLUG
โญ 2,541 Python ๐Ÿ‘ค X-PLUG Organization ๐Ÿ• Updated 2025-04-02 ๐Ÿ“… Created 2023-04-25
29
OpenGVLab/InternVideo

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

OpenGVLab
โญ 2,421 Python ๐Ÿ‘ค OpenGVLab Organization ๐Ÿ• Updated 2026-07-02 ๐Ÿ“… Created 2022-11-23
31
cambrian-mllm/cambrian

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

cambrian-mllm
โญ 2,013 Python ๐Ÿ‘ค cambrian-mllm Organization ๐Ÿ• Updated 2025-11-07 ๐Ÿ“… Created 2024-06-17
32
bespokelabsai/curator

Synthetic data curation for post-training and structured data extraction

bespokelabsai
โญ 1,766 Python ๐Ÿ‘ค bespokelabsai Organization ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2024-10-28
33
OpenCodeInterpreter/OpenCodeInterpreter

OpenCodeInterpreter is a suite of open-source code generation systems aimed at bridging the gap between large language models and sophisticated proprietary systems like the GPT-4 Code Interpreter. It significantly enhances code generation capabilities by integrating execution and iterative refinement functionalities.

OpenCodeInterpreter
โญ 1,694 Python ๐Ÿ‘ค OpenCodeInterpreter User ๐Ÿ• Updated 2024-05-07 ๐Ÿ“… Created 2024-02-19
โญ 1,576 Python ๐Ÿ‘ค google-research Organization ๐Ÿ• Updated 2026-07-02 ๐Ÿ“… Created 2021-08-21
35
wasiahmad/Awesome-LLM-Synthetic-Data

A reading list on LLM based Synthetic Data Generation ๐Ÿ”ฅ

wasiahmad
โญ 1,538 ๐Ÿ‘ค wasiahmad User ๐Ÿ• Updated 2025-06-05 ๐Ÿ“… Created 2024-08-08
36
lmmlzn/Awesome-LLMs-Datasets

Summarize existing representative LLMs text datasets.

lmmlzn
โญ 1,484 ๐Ÿ‘ค lmmlzn User ๐Ÿ• Updated 2026-03-11 ๐Ÿ“… Created 2024-01-17
37
zjunlp/KnowLM

An Open-sourced Knowledgable Large Language Model Framework.

zjunlp
โญ 1,387 Python ๐Ÿ‘ค zjunlp Organization ๐Ÿ• Updated 2025-01-11 ๐Ÿ“… Created 2023-04-01
38
FreedomIntelligence/HuatuoGPT

HuatuoGPT, Towards Taming Language Models To Be a Doctor. (An Open Medical GPT)

FreedomIntelligence
โญ 1,283 Python ๐Ÿ‘ค FreedomIntelligence Organization ๐Ÿ• Updated 2024-12-16 ๐Ÿ“… Created 2023-04-13
39
ibm-granite/granite-code-models

Granite Code Models: A Family of Open Foundation Models for Code Intelligence

ibm-granite
โญ 1,250 ๐Ÿ‘ค ibm-granite Organization ๐Ÿ• Updated 2025-06-25 ๐Ÿ“… Created 2024-04-23
41
IBM/Dromedary

Dromedary: towards helpful, ethical and reliable LLMs.

IBM
โญ 1,136 Python ๐Ÿ‘ค IBM Organization ๐Ÿ• Updated 2025-09-18 ๐Ÿ“… Created 2023-05-03
42
yaodongC/awesome-instruction-dataset

A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)

yaodongC
โญ 1,136 ๐Ÿ‘ค yaodongC User ๐Ÿ• Updated 2024-01-04 ๐Ÿ“… Created 2023-03-29
43
datadreamer-dev/DataDreamer

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. โ€‚ ๐Ÿค–๐Ÿ’ค

datadreamer-dev
โญ 1,112 Python ๐Ÿ‘ค datadreamer-dev Organization ๐Ÿ• Updated 2025-02-02 ๐Ÿ“… Created 2023-06-02
44
Arena-OSS/arena-hard-auto

Arena-Hard-Auto: An automatic LLM benchmark.

Arena-OSS
โญ 1,087 Python ๐Ÿ‘ค Arena-OSS Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-11-04
45
CSHaitao/LexiLaw

LexiLaw - Chinese Legal Large Language Model

CSHaitao
โญ 1,058 Python ๐Ÿ‘ค CSHaitao User ๐Ÿ• Updated 2026-03-12 ๐Ÿ“… Created 2023-05-16
46
Xwin-LM/Xwin-LM

Xwin-LM: Powerful, Stable, and Reproducible LLM Alignment

Xwin-LM
โญ 1,041 Python ๐Ÿ‘ค Xwin-LM Organization ๐Ÿ• Updated 2024-05-31 ๐Ÿ“… Created 2023-09-11
47
yaotingwangofficial/Awesome-MCoT

Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey

yaotingwangofficial
โญ 1,030 TeX ๐Ÿ‘ค yaotingwangofficial User ๐Ÿ• Updated 2026-10-03 ๐Ÿ“… Created 2025-02-15
48
beyondguo/LLM-Tuning

Tuning LLMs with no tears๐Ÿ’ฆ; Sample Design Engineering (SDE) for more efficient downstream-tuning.

beyondguo
โญ 1,018 HTML ๐Ÿ‘ค beyondguo User ๐Ÿ• Updated 2024-04-27 ๐Ÿ“… Created 2023-06-19
49
NVlabs/DoRA

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

NVlabs
โญ 1,007 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-03-24 ๐Ÿ“… Created 2024-04-11
โญ 922 Python ๐Ÿ‘ค WeOpenML Organization ๐Ÿ• Updated 2024-05-22 ๐Ÿ“… Created 2023-04-30

Frequently Asked Questions

1

What is the most popular #instruction-tuning repository on GitHub?

The top ranked open source #instruction-tuning project on GitHub is rasbt/LLMs-from-scratch with 108,745 stars. Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

2

Which programming languages are most used in #instruction-tuning repositories?

Among the top ranked #instruction-tuning projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Rust, TeX.

3

How is the #instruction-tuning repository ranking calculated?

We track 73 active open source repositories tagged with #instruction-tuning (500+ stars), totaling 461,684 stars with an average of 6,324 stars per repository. Rankings update daily from the GitHub API.