Git Stars Git Stars

#model-quantization Repositories

Discover 59 active open source GitHub repositories tagged with #model-quantization, accumulating 217,873 total stars (averaging 3,692 stars per project). Leading this topic is zai-org/ChatGLM-6B with 41,224 stars.

59
Total Repositories
217,873
Total Stars
3,692
Avg Stars/Repo
1
zai-org/ChatGLM-6B

ChatGLM-6B: An Open Bilingual Dialogue Language Model | Open Source Bilingual Dialogue Language Model

zai-org
โญ 41,224 Python ๐Ÿ‘ค zai-org Organization ๐Ÿ• Updated 2024-06-27 ๐Ÿ“… Created 2023-03-13
2
karpathy/llama2.c

Inference Llama 2 in one file of pure C

karpathy
โญ 19,062 C ๐Ÿ‘ค karpathy User ๐Ÿ• Updated 2024-08-06 ๐Ÿ“… Created 2023-07-23
3
apple-aiml-research/ml-stable-diffusion

Stable Diffusion with Core ML on Apple Silicon

apple-aiml-research
โญ 17,962 Python ๐Ÿ‘ค apple-aiml-research Organization ๐Ÿ• Updated 2026-09-11 ๐Ÿ“… Created 2022-11-16
4
zai-org/ChatGLM3

ChatGLM3 series: Open Bilingual Chat LLMs | Open Bilingual Chat LLMs

zai-org
โญ 13,680 Python ๐Ÿ‘ค zai-org Organization ๐Ÿ• Updated 2025-01-13 ๐Ÿ“… Created 2023-10-26
6
OpenBMB/MiniCPM

MiniCPM5: SOTA on-device LLMs, small yet powerful.

OpenBMB
โญ 11,898 Jupyter Notebook ๐Ÿ‘ค OpenBMB Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2024-01-29
7
meta-llama/llama-models

Utilities intended for use with Llama models.

meta-llama
โญ 7,727 Python ๐Ÿ‘ค meta-llama Organization ๐Ÿ• Updated 2026-02-11 ๐Ÿ“… Created 2024-06-27
8
bigcode-project/starcoder

Home of StarCoder: fine-tuning & inference!

bigcode-project
โญ 7,527 Python ๐Ÿ‘ค bigcode-project Organization ๐Ÿ• Updated 2024-02-27 ๐Ÿ“… Created 2023-04-24
9
deepseek-ai/DeepSeek-LLM

DeepSeek LLM: Let there be answers

deepseek-ai
โญ 6,688 Makefile ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2024-02-04 ๐Ÿ“… Created 2023-11-29
10
OpenGVLab/LLaMA-Adapter

[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters

OpenGVLab
โญ 5,931 Python ๐Ÿ‘ค OpenGVLab Organization ๐Ÿ• Updated 2024-03-14 ๐Ÿ“… Created 2023-03-19
11
NVIDIA/Model-Optimizer

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

NVIDIA
โญ 5,646 Python ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-04-23
12
Hoper-J/AI-Guide-and-Demos-zh_CN

This is a step-by-step guide to getting started with AI/LLM large models, including tutorials and demo code. It takes you from APIs to local large model deployment and fine-tuning. The code files will be provided in online versions for Kaggle or Colab, allowing you to learn even without a graphics card. The project also features a small code playground ๐ŸŽก where you can experiment with interesting AI scripts. Simultaneously, it includes a complete Chinese mirrored version of the assignments from Hung-Yi Lee's (HUNG-YI LEE) 2024 Introduction to Generative AI course.

Hoper-J
โญ 4,834 Python ๐Ÿ‘ค Hoper-J User ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2024-09-10
13
city96/ComfyUI-GGUF

GGUF Quantization support for native ComfyUI models

city96
โญ 4,284 Python ๐Ÿ‘ค city96 User ๐Ÿ• Updated 2026-01-12 ๐Ÿ“… Created 2024-08-15
14
qwopqwop200/GPTQ-for-LLaMa

4 bits quantization of LLaMA using GPTQ

qwopqwop200
โญ 3,077 Python ๐Ÿ‘ค qwopqwop200 User ๐Ÿ• Updated 2024-07-13 ๐Ÿ“… Created 2023-03-06
15
echonoshy/cgft-llm

Practice to LLM.

echonoshy
โญ 2,718 Jupyter Notebook ๐Ÿ‘ค echonoshy User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2024-05-22
16
km1994/LLMs_interview_notes

This repository mainly records interview questions related to Large Language Model (LLM) Algorithm Engineers.

km1994
โญ 2,670 ๐Ÿ‘ค km1994 User ๐Ÿ• Updated 2026-10-11 ๐Ÿ“… Created 2023-09-16
18
AI-Efficiency/Awesome-Model-Quantization

A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.

AI-Efficiency
โญ 2,471 ๐Ÿ‘ค AI-Efficiency Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2018-10-18
19
horseee/Awesome-Efficient-LLM

A curated list for Efficient Large Language Models

horseee
โญ 2,019 Python ๐Ÿ‘ค horseee User ๐Ÿ• Updated 2025-06-17 ๐Ÿ“… Created 2023-05-22
20
merveenoyan/smol-vision

Recipes for shrinking, optimizing, customizing cutting edge vision models. ๐Ÿ’œ

merveenoyan
โญ 2,004 Jupyter Notebook ๐Ÿ‘ค merveenoyan User ๐Ÿ• Updated 2026-08-12 ๐Ÿ“… Created 2024-03-13
21
HuangOwen/Awesome-LLM-Compression

Awesome LLM compression research papers and tools.

HuangOwen
โญ 1,899 ๐Ÿ‘ค HuangOwen User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-05-30
22
XiongjieDai/GPU-Benchmarks-on-LLM-Inference

Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?

XiongjieDai
โญ 1,862 Jupyter Notebook ๐Ÿ‘ค XiongjieDai User ๐Ÿ• Updated 2024-05-13 ๐Ÿ“… Created 2023-07-19
โญ 1,850 Python ๐Ÿ‘ค Tele-AI Organization ๐Ÿ• Updated 2026-07-09 ๐Ÿ“… Created 2024-01-07
24
Xilinx/Vitis-AI

Vitis AI is Xilinxโ€™s development stack for AI inference on Xilinx hardware platforms, including both edge devices and Alveo cards.

Xilinx
โญ 1,814 Python ๐Ÿ‘ค Xilinx Organization ๐Ÿ• Updated 2026-02-24 ๐Ÿ“… Created 2019-10-16
โญ 1,776 Python ๐Ÿ‘ค airockchip User ๐Ÿ• Updated 2026-09-29 ๐Ÿ“… Created 2024-03-14
26
bytedance/DreamO

[SIGGRAPH Asia 2025] DreamO: A Unified Framework for Image Customization

bytedance
โญ 1,651 Python ๐Ÿ‘ค bytedance Organization ๐Ÿ• Updated 2025-08-14 ๐Ÿ“… Created 2025-04-21
27
WisdomShell/codeshell

A series of code large language models developed by PKU-KCL

WisdomShell
โญ 1,635 Python ๐Ÿ‘ค WisdomShell Organization ๐Ÿ• Updated 2024-07-18 ๐Ÿ“… Created 2023-09-22
28
mit-han-lab/smoothquant

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

mit-han-lab
โญ 1,576 Python ๐Ÿ‘ค mit-han-lab Organization ๐Ÿ• Updated 2024-07-12 ๐Ÿ“… Created 2022-11-17
29
BICLab/SpikingBrain-7B

Spiking Brain-inspired Large Models, integrating hybrid efficient attention, MoE modules and spike encoding into its architecture

BICLab
โญ 1,432 Python ๐Ÿ‘ค BICLab User ๐Ÿ• Updated 2026-05-14 ๐Ÿ“… Created 2025-09-03
30
Vahe1994/AQLM

Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf and PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression https://arxiv.org/abs/2405.14852

Vahe1994
โญ 1,330 Python ๐Ÿ‘ค Vahe1994 User ๐Ÿ• Updated 2026-02-26 ๐Ÿ“… Created 2024-01-12
31
Duxiaoman-DI/XuanYuan

Xuanyuan: Duxiaoman Chinese Financial Dialogue Large Model

Duxiaoman-DI
โญ 1,323 Python ๐Ÿ‘ค Duxiaoman-DI Organization ๐Ÿ• Updated 2025-01-07 ๐Ÿ“… Created 2023-05-21
32
OpenBuddy/OpenBuddy

Open Multilingual Chatbot for Everyone

OpenBuddy
โญ 1,274 ๐Ÿ‘ค OpenBuddy Organization ๐Ÿ• Updated 2025-06-08 ๐Ÿ“… Created 2023-04-26
33
espressif/esp-dl

Espressif deep-learning library for AIoT applications

espressif
โญ 1,232 Assembly ๐Ÿ‘ค espressif Organization ๐Ÿ• Updated 2026-11-06 ๐Ÿ“… Created 2018-11-16
34
Alpha-VLLM/Lumina-mGPT-2.0

Lumina-mGPT 2.0: Stand-Alone AutoRegressive Image Modeling

Alpha-VLLM
โญ 1,081 Python ๐Ÿ‘ค Alpha-VLLM Organization ๐Ÿ• Updated 2025-11-03 ๐Ÿ“… Created 2025-04-03
35
sipeed/TinyMaix

TinyMaix is a tiny inference library for microcontrollers (TinyML).

sipeed
โญ 1,056 C ๐Ÿ‘ค sipeed Organization ๐Ÿ• Updated 2025-02-05 ๐Ÿ“… Created 2022-08-08
โญ 1,027 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2024-01-04 ๐Ÿ“… Created 2023-07-17
38
nvidia-cosmos/cosmos-reason1

Cosmos-Reason1 models understand the physical common sense and generate appropriate embodied decisions in natural language through long chain-of-thought reasoning processes.

nvidia-cosmos
โญ 965 Python ๐Ÿ‘ค nvidia-cosmos Organization ๐Ÿ• Updated 2026-06-07 ๐Ÿ“… Created 2025-03-02
39
vivo-ai-lab/BlueLM

BlueLM(Blue Heart Large Language Model): Open large language models developed by vivo AI Lab

vivo-ai-lab
โญ 930 Python ๐Ÿ‘ค vivo-ai-lab Organization ๐Ÿ• Updated 2024-12-30 ๐Ÿ“… Created 2023-10-16
40
wdndev/tiny-llm-zh

Implementing a small-parameter Chinese large language model from scratch.

wdndev
โญ 917 Python ๐Ÿ‘ค wdndev User ๐Ÿ• Updated 2024-08-22 ๐Ÿ“… Created 2024-03-03
41
ModelTC/MQBench

Model Quantization Benchmark

ModelTC
โญ 869 Python ๐Ÿ‘ค ModelTC Organization ๐Ÿ• Updated 2025-04-20 ๐Ÿ“… Created 2021-08-19
42
deepseek-ai/awesome-deepseek-coder

A curated list of open-source projects related to DeepSeek Coder

deepseek-ai
โญ 842 ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2025-11-11 ๐Ÿ“… Created 2023-11-06
43
mustafaaljadery/lightning-whisper-mlx

An extremely fast implementation of whisper optimized for Apple Silicon using MLX.

mustafaaljadery
โญ 835 Python ๐Ÿ‘ค mustafaaljadery User ๐Ÿ• Updated 2024-05-08 ๐Ÿ“… Created 2024-03-23
44
Tencent-Hunyuan/Hunyuan-A13B

Tencent Hunyuan A13B (short as Hunyuan-A13B), an innovative and open-source LLM built on a fine-grained MoE architecture.

Tencent-Hunyuan
โญ 815 Python ๐Ÿ‘ค Tencent-Hunyuan Organization ๐Ÿ• Updated 2025-07-08 ๐Ÿ“… Created 2025-06-27
45
nunchaku-ai/deepcompressor

Model Compression Toolbox for Large Language Models and Diffusion Models

nunchux-ai
โญ 799 Python ๐Ÿ‘ค nunchux-ai Organization ๐Ÿ• Updated 2025-08-14 ๐Ÿ“… Created 2024-05-06
46
PaddlePaddle/Paddle-Lite-Demo

lib, demo, model, data

PaddlePaddle
โญ 799 C++ ๐Ÿ‘ค PaddlePaddle Organization ๐Ÿ• Updated 2025-09-17 ๐Ÿ“… Created 2019-08-21
โญ 752 Python ๐Ÿ‘ค Open-Magic-Video Organization ๐Ÿ• Updated 2025-02-18 ๐Ÿ“… Created 2025-02-10
48
EricLBuehler/candle-vllm

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

EricLBuehler
โญ 742 Rust ๐Ÿ‘ค EricLBuehler User ๐Ÿ• Updated 2026-10-18 ๐Ÿ“… Created 2023-10-29
โญ 715 Python ๐Ÿ‘ค SkunkworksAI Organization ๐Ÿ• Updated 2024-03-06 ๐Ÿ“… Created 2023-10-10

Frequently Asked Questions

1

What is the most popular #model-quantization repository on GitHub?

The top ranked open source #model-quantization project on GitHub is zai-org/ChatGLM-6B with 41,224 stars. ChatGLM-6B: An Open Bilingual Dialogue Language Model | Open Source Bilingual Dialogue Language Model

2

Which programming languages are most used in #model-quantization repositories?

Among the top ranked #model-quantization projects on GitHub, the most common programming languages are Python, Jupyter Notebook, C, Makefile.

3

How is the #model-quantization repository ranking calculated?

We track 59 active open source repositories tagged with #model-quantization (500+ stars), totaling 217,873 stars with an average of 3,692 stars per repository. Rankings update daily from the GitHub API.