Git Stars Git Stars

#knowledge-distillation Repositories

Discover 35 active open source GitHub repositories tagged with #knowledge-distillation, accumulating 102,336 total stars (averaging 2,923 stars per project). Leading this topic is titanwings/distilly with 26,745 stars.

35
Total Repositories
102,336
Total Stars
2,923
Avg Stars/Repo
Programming Languages: Python Jupyter Notebook C
1
titanwings/distilly

Distilly โ€” Distill how they think into reusable Skills for any Agent or Bot. Formerly Colleague Skill (originally โ€œColleague Skillโ€).

titanwings
โญ 26,745 Python ๐Ÿ‘ค titanwings User ๐Ÿ• Updated 2026-10-13 ๐Ÿ“… Created 2026-03-30
2
kangarooking/cangjie-skill

Distill high-value content from books, long-form videos, podcasts, and more into executable Agent Skills

kangarooking
โญ 13,161 Python ๐Ÿ‘ค kangarooking User ๐Ÿ• Updated 2026-10-02 ๐Ÿ“… Created 2026-04-16
3
z1069614715/objectdetection_script

Some scripts for object detection and code with improvement ideas; please see readme.md for details.

z1069614715
โญ 7,353 Python ๐Ÿ‘ค z1069614715 User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-01-05
4
PaddlePaddle/PaddleClas

A treasure chest for visual classification and recognition powered by PaddlePaddle

PaddlePaddle
โญ 5,861 Python ๐Ÿ‘ค PaddlePaddle Organization ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2020-03-30
5
dkozlov/awesome-knowledge-distillation

Awesome Knowledge Distillation

dkozlov
โญ 3,920 ๐Ÿ‘ค dkozlov User ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2017-02-28
6
huawei-noah/Pretrained-Language-Model

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

huawei-noah
โญ 3,152 Python ๐Ÿ‘ค huawei-noah Organization ๐Ÿ• Updated 2024-01-22 ๐Ÿ“… Created 2019-12-02
7
robert-mcdermott/ai-knowledge-graph

AI Powered Knowledge Graph Generator

robert-mcdermott
โญ 3,143 Python ๐Ÿ‘ค robert-mcdermott User ๐Ÿ• Updated 2026-09-13 ๐Ÿ“… Created 2025-03-23
8
jingyi0000/VLM_survey

Collection of AWESOME vision-language models for vision tasks

jingyi0000
โญ 3,132 ๐Ÿ‘ค jingyi0000 User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-03-30
9
divamgupta/image-segmentation-keras

Implementation of Segnet, FCN, UNet, PSPNet and other models in Keras.

divamgupta
โญ 3,010 Python ๐Ÿ‘ค divamgupta User ๐Ÿ• Updated 2024-05-12 ๐Ÿ“… Created 2017-03-20
10
intel/neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

intel
โญ 2,733 Python ๐Ÿ‘ค intel Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2020-07-21
11
google/tunix

A Lightweight LLM Post-Training Library

google
โญ 2,516 Python ๐Ÿ‘ค google Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-04-02
12
alibaba/EasyNLP

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

alibaba
โญ 2,180 Python ๐Ÿ‘ค alibaba Organization ๐Ÿ• Updated 2024-11-27 ๐Ÿ“… Created 2022-04-06
13
horseee/Awesome-Efficient-LLM

A curated list for Efficient Large Language Models

horseee
โญ 2,019 Python ๐Ÿ‘ค horseee User ๐Ÿ• Updated 2025-06-17 ๐Ÿ“… Created 2023-05-22
14
GAIR-NLP/O1-Journey

O1 Replication Journey

GAIR-NLP
โญ 2,000 ๐Ÿ‘ค GAIR-NLP Organization ๐Ÿ• Updated 2025-01-14 ๐Ÿ“… Created 2024-10-07
15
HuangOwen/Awesome-LLM-Compression

Awesome LLM compression research papers and tools.

HuangOwen
โญ 1,899 ๐Ÿ‘ค HuangOwen User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-05-30
16
microsoft/Cream

This is a collection of our NAS and Vision Transformer work.

microsoft
โญ 1,818 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2024-07-25 ๐Ÿ“… Created 2020-10-12
17
open-mmlab/mmrazor

OpenMMLab Model Compression Toolbox and Benchmark.

open-mmlab
โญ 1,653 Python ๐Ÿ‘ค open-mmlab Organization ๐Ÿ• Updated 2024-06-11 ๐Ÿ“… Created 2021-12-22
18
yoshitomo-matsubara/torchdistill

A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. ๐Ÿ† 28 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc. have been implemented so far. ๐ŸŽ Trained models, training logs, and configurations are available to ensure reproducibility and benchmarking.

yoshitomo-matsubara
โญ 1,636 Python ๐Ÿ‘ค yoshitomo-matsubara User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2019-12-18
19
wasiahmad/Awesome-LLM-Synthetic-Data

A reading list on LLM based Synthetic Data Generation ๐Ÿ”ฅ

wasiahmad
โญ 1,538 ๐Ÿ‘ค wasiahmad User ๐Ÿ• Updated 2025-06-05 ๐Ÿ“… Created 2024-08-08
20
huawei-noah/Efficient-Computing

Efficient computing methods developed by Huawei Noah's Ark Lab

huawei-noah
โญ 1,306 Jupyter Notebook ๐Ÿ‘ค huawei-noah Organization ๐Ÿ• Updated 2024-11-05 ๐Ÿ“… Created 2019-09-04
21
Tebmer/Awesome-Knowledge-Distillation-of-LLMs

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

Tebmer
โญ 1,282 ๐Ÿ‘ค Tebmer User ๐Ÿ• Updated 2025-03-09 ๐Ÿ“… Created 2024-02-08
22
HarborYuan/ovsam

[ECCV 2024] The official code of paper "Open-Vocabulary SAM".

HarborYuan
โญ 1,034 Python ๐Ÿ‘ค HarborYuan User ๐Ÿ• Updated 2026-09-08 ๐Ÿ“… Created 2024-01-05
23
MingSun-Tse/Efficient-Deep-Learning

Collection of recent methods on (deep) neural network compression and acceleration.

MingSun-Tse
โญ 954 ๐Ÿ‘ค MingSun-Tse User ๐Ÿ• Updated 2025-04-04 ๐Ÿ“… Created 2018-09-16
24
chrisliu298/awesome-on-policy-distillation

A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of large language models

chrisliu298
โญ 926 ๐Ÿ‘ค chrisliu298 User ๐Ÿ• Updated 2026-10-06 ๐Ÿ“… Created 2026-03-22
25
aimagelab/mammoth

An Extendible (General) Continual Learning Framework based on Pytorch - official codebase of Dark Experience for General Continual Learning

aimagelab
โญ 852 Python ๐Ÿ‘ค aimagelab Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2020-10-05
26
Ampixa/sanoTTS

sanoTTS (เคธเคพเคจเฅ‹ = โ€œsmallโ€ in Nepali): a 294kโ€“2.27M-parameter neural TTS system that runs on a $3 chip, in the browser, or in Python, with low-latency streaming.

Ampixa
โญ 851 C ๐Ÿ‘ค Ampixa Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-07-11
27
RUCAIBox/Slow_Thinking_with_LLMs

A series of technical report on Slow Thinking with LLM

RUCAIBox
โญ 768 Python ๐Ÿ‘ค RUCAIBox Organization ๐Ÿ• Updated 2025-08-13 ๐Ÿ“… Created 2024-12-12
28
Picsart-AI-Research/MI-GAN

[ICCV 2023] MI-GAN: A Simple Baseline for Image Inpainting on Mobile Devices

Picsart-AI-Research
โญ 714 Python ๐Ÿ‘ค Picsart-AI-Research Organization ๐Ÿ• Updated 2026-09-14 ๐Ÿ“… Created 2023-08-16
29
Westlake-AGI-Lab/Distill-Any-Depth

The repo for "Distill Any Depth: Distillation Creates a Stronger Monocular Depth Estimator"

Westlake-AGI-Lab
โญ 692 Python ๐Ÿ‘ค Westlake-AGI-Lab Organization ๐Ÿ• Updated 2025-04-21 ๐Ÿ“… Created 2025-02-20
31
google-deepmind/searchless_chess

Grandmaster-Level Chess Without Search

google-deepmind
โญ 634 Python ๐Ÿ‘ค google-deepmind Organization ๐Ÿ• Updated 2025-01-10 ๐Ÿ“… Created 2024-04-09
32
nick7nlp/Awesome-LLM-On-Policy-Distillation

A curated collection of papers and resources on On-Policy Distillation for Large Language Models.

nick7nlp
โญ 598 Python ๐Ÿ‘ค nick7nlp User ๐Ÿ• Updated 2026-10-13 ๐Ÿ“… Created 2026-04-05
33
predibase/llm_distillation_playbook

Best practices for distilling large language models.

predibase
โญ 596 Jupyter Notebook ๐Ÿ‘ค predibase Organization ๐Ÿ• Updated 2024-02-01 ๐Ÿ“… Created 2023-12-06
34
csyhhu/Awesome-Deep-Neural-Network-Compression

Summary, Code for Deep Neural Network Quantization

csyhhu
โญ 562 Python ๐Ÿ‘ค csyhhu User ๐Ÿ• Updated 2026-09-01 ๐Ÿ“… Created 2019-02-28
35
zengxiao-he/tessera

From teacher to tiles โ€” a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.

zengxiao-he
โญ 556 Python ๐Ÿ‘ค zengxiao-he User ๐Ÿ• Updated 2026-10-09 ๐Ÿ“… Created 2026-06-05

Frequently Asked Questions

1

What is the most popular #knowledge-distillation repository on GitHub?

The top ranked open source #knowledge-distillation project on GitHub is titanwings/distilly with 26,745 stars. Distilly โ€” Distill how they think into reusable Skills for any Agent or Bot. Formerly Colleague Skill (originally โ€œColleague Skillโ€).

2

Which programming languages are most used in #knowledge-distillation repositories?

Among the top ranked #knowledge-distillation projects on GitHub, the most common programming languages are Python, Jupyter Notebook, C.

3

How is the #knowledge-distillation repository ranking calculated?

We track 35 active open source repositories tagged with #knowledge-distillation (500+ stars), totaling 102,336 stars with an average of 2,923 stars per repository. Rankings update daily from the GitHub API.