Git Stars Git Stars

#distillation Repositories

Discover 24 active open source GitHub repositories tagged with #distillation, accumulating 42,743 total stars (averaging 1,780 stars per project). Leading this topic is rasbt/reasoning-from-scratch with 5,885 stars.

24
Total Repositories
42,743
Total Stars
1,780
Avg Stars/Repo
Programming Languages: Python Jupyter Notebook
1
rasbt/reasoning-from-scratch

Implement a reasoning LLM in PyTorch from scratch, step by step

rasbt
โญ 5,885 Jupyter Notebook ๐Ÿ‘ค rasbt User ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2025-03-04
2
hao-ai-lab/FastVideo

A unified inference and post-training framework for accelerated video generation.

hao-ai-lab
โญ 4,833 Python ๐Ÿ‘ค hao-ai-lab Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-10-24
3
dkozlov/awesome-knowledge-distillation

Awesome Knowledge Distillation

dkozlov
โญ 3,920 ๐Ÿ‘ค dkozlov User ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2017-02-28
4
thu-ml/TurboDiffusion

TurboDiffusion: 100โ€“200ร— Acceleration for Video Diffusion Models

thu-ml
โญ 3,870 Python ๐Ÿ‘ค thu-ml Organization ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2025-12-06
5
ViTAE-Transformer/ViTPose

The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"

ViTAE-Transformer
โญ 2,222 Python ๐Ÿ‘ค ViTAE-Transformer Organization ๐Ÿ• Updated 2025-12-25 ๐Ÿ“… Created 2022-04-27
6
tangxyw/RecSysPapers

A collection of industry classics and cutting-edge papers in the field of recommendation/advertising/search. A collection of industry classics and cutting-edge papers in the field of recommendation/advertising/search.

tangxyw
โญ 2,216 Python ๐Ÿ‘ค tangxyw User ๐Ÿ• Updated 2026-06-11 ๐Ÿ“… Created 2022-08-16
7
NVlabs/RADIO

Official repository for "AM-RADIO: Reduce All Domains Into One"

NVlabs
โญ 2,008 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-10-06 ๐Ÿ“… Created 2023-12-08
8
GMvandeVen/continual-learning

PyTorch implementation of various methods for continual learning (XdG, EWC, SI, LwF, FROMP, DGR, BI-R, ER, A-GEM, iCaRL, Generative Classifier) in three different scenarios.

GMvandeVen
โญ 1,891 Jupyter Notebook ๐Ÿ‘ค GMvandeVen User ๐Ÿ• Updated 2025-11-05 ๐Ÿ“… Created 2018-09-26
9
lightly-ai/lightly-train

All-in-one training for vision models (YOLO, ViTs, RT-DETR, DINOv3): pretraining, fine-tuning, distillation.

lightly-ai
โญ 1,743 Python ๐Ÿ‘ค lightly-ai Organization ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2025-04-10
10
PaddlePaddle/PaddleSlim

PaddleSlim is an open-source library for deep model compression and architecture search.

PaddlePaddle
โญ 1,613 Python ๐Ÿ‘ค PaddlePaddle Organization ๐Ÿ• Updated 2026-01-04 ๐Ÿ“… Created 2019-12-16
11
agenmod/immortal-skill

โ™พ๏ธ Open-Source Digital Immortality Framework โ€” Distills anyone's 7D digital avatar from chat logs. Supports 12+ platforms like WeChat/Feishu/iMessage/Telegram, 7 role templates, aligned with OpenClaw Soul Spec standard. One command line lets your AI learn distillation.

agenmod
โญ 1,154 Python ๐Ÿ‘ค agenmod User ๐Ÿ• Updated 2026-04-15 ๐Ÿ“… Created 2026-04-01
12
lasgroup/SDPO

Reinforcement Learning via Self-Distillation (SDPO)

lasgroup
โญ 1,152 Python ๐Ÿ‘ค lasgroup Organization ๐Ÿ• Updated 2026-07-01 ๐Ÿ“… Created 2026-01-24
13
NVlabs/FastGen

NVIDIA FastGen: Fast Generation from Diffusion Models

NVlabs
โญ 1,124 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-01-15
14
titanwings/ex-skill

To that unforgettable TA of yours, all large models are coding saints. It's giving rebirth era. Welcome to Digital Life 1.0. ๐Ÿซถ

titanwings
โญ 1,100 Python ๐Ÿ‘ค titanwings User ๐Ÿ• Updated 2026-08-13 ๐Ÿ“… Created 2026-03-31
15
thu-ml/Causal-Forcing

[ICML 2026] Official codebase for "Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation" & Causal Forcing++

thu-ml
โญ 1,029 Python ๐Ÿ‘ค thu-ml Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-02-01
16
chrisliu298/awesome-on-policy-distillation

A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of large language models

chrisliu298
โญ 926 ๐Ÿ‘ค chrisliu298 User ๐Ÿ• Updated 2026-10-06 ๐Ÿ“… Created 2026-03-22
17
nolabs-ai/deepfabric

Generate High-Quality Synthetics, Train, Measure, and Evaluate in a Single Pipeline

nolabs-ai
โญ 896 Python ๐Ÿ‘ค nolabs-ai Organization ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2024-10-25
18
thinkwee/AwesomeOPD

Awesome List for On-Policy Distillation

thinkwee
โญ 883 ๐Ÿ‘ค thinkwee User ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2026-04-27
19
kandinskylab/kandinsky-5

Kandinsky 5.0: A family of diffusion models for Video & Image generation

kandinskylab
โญ 846 Python ๐Ÿ‘ค kandinskylab Organization ๐Ÿ• Updated 2026-08-07 ๐Ÿ“… Created 2025-08-11
20
NVlabs/rcm

rCM & Causal-rCM: Leading and Unified Algorithms/Infrastructures for Bidirectional/Autoregressive Video Diffusion Distillation at Scale

NVlabs
โญ 832 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-06-25 ๐Ÿ“… Created 2025-10-09
21
AlibabaResearch/SparkDiffusion

SparkDiffusion: Accelerating DiT video generation by 265ร— via joint sparsity, distillation, quantization, etc.

AlibabaResearch
โญ 750 Python ๐Ÿ‘ค AlibabaResearch Organization ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2026-09-18
22
Tanuki/tanuki.py

Prompt engineering for developers

Tanuki
โญ 695 Python ๐Ÿ‘ค Tanuki Organization ๐Ÿ• Updated 2024-02-13 ๐Ÿ“… Created 2023-10-16
23
gojasper/flash-diffusion

Flash Diffusion โ€” accelerating conditional diffusion models (AAAI 2025 Oral)

gojasper
โญ 663 Python ๐Ÿ‘ค gojasper Organization ๐Ÿ• Updated 2025-03-11 ๐Ÿ“… Created 2024-06-04
24
Lakonik/LakonLab

Official implementation of pi-H3, AsymFlow, pi-Flow, GMFlow

Lakonik
โญ 516 Python ๐Ÿ‘ค Lakonik User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-10-16

Frequently Asked Questions

1

What is the most popular #distillation repository on GitHub?

The top ranked open source #distillation project on GitHub is rasbt/reasoning-from-scratch with 5,885 stars. Implement a reasoning LLM in PyTorch from scratch, step by step

2

Which programming languages are most used in #distillation repositories?

Among the top ranked #distillation projects on GitHub, the most common programming languages are Python, Jupyter Notebook.

3

How is the #distillation repository ranking calculated?

We track 24 active open source repositories tagged with #distillation (500+ stars), totaling 42,743 stars with an average of 1,780 stars per repository. Rankings update daily from the GitHub API.