Git Stars Git Stars

#efficient-inference Repositories

Discover 18 active open source GitHub repositories tagged with #efficient-inference, accumulating 46,090 total stars (averaging 2,560 stars per project). Leading this topic is OpenBMB/MiniCPM with 11,898 stars.

18
Total Repositories
46,090
Total Stars
2,560
Avg Stars/Repo
Programming Languages: Python Jupyter Notebook
1
OpenBMB/MiniCPM

MiniCPM5: SOTA on-device LLMs, small yet powerful.

OpenBMB
โญ 11,898 Jupyter Notebook ๐Ÿ‘ค OpenBMB Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2024-01-29
โญ 9,620 Python ๐Ÿ‘ค meituan-longcat Organization ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2025-10-25
3
huawei-noah/Efficient-AI-Backbones

Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.

huawei-noah
โญ 4,417 Python ๐Ÿ‘ค huawei-noah Organization ๐Ÿ• Updated 2025-03-15 ๐Ÿ“… Created 2019-11-16
4
BlinkDL/AI-Writer

AI writes novels, generating fantasy and romance webnovels, etc. Chinese pre-trained generative model. Using my RWKV model, similar to GPT-2. AI writing. RWKV for Chinese novel generation.

BlinkDL
โญ 3,729 Python ๐Ÿ‘ค BlinkDL User ๐Ÿ• Updated 2025-05-15 ๐Ÿ“… Created 2021-07-26
5
AI-Efficiency/Awesome-Model-Quantization

A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.

AI-Efficiency
โญ 2,471 ๐Ÿ‘ค AI-Efficiency Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2018-10-18
6
HuangOwen/Awesome-LLM-Compression

Awesome LLM compression research papers and tools.

HuangOwen
โญ 1,899 ๐Ÿ‘ค HuangOwen User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-05-30
7
SqueezeAILab/LLMCompiler

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

SqueezeAILab
โญ 1,808 Python ๐Ÿ‘ค SqueezeAILab Organization ๐Ÿ• Updated 2024-07-10 ๐Ÿ“… Created 2023-12-06
8
ermongroup/ddim

Denoising Diffusion Implicit Models

ermongroup
โญ 1,763 Python ๐Ÿ‘ค ermongroup Organization ๐Ÿ• Updated 2024-07-26 ๐Ÿ“… Created 2020-10-05
9
BICLab/SpikingBrain-7B

Spiking Brain-inspired Large Models, integrating hybrid efficient attention, MoE modules and spike encoding into its architecture

BICLab
โญ 1,432 Python ๐Ÿ‘ค BICLab User ๐Ÿ• Updated 2026-05-14 ๐Ÿ“… Created 2025-09-03
10
myshell-ai/JetMoE

Reaching LLaMA2 Performance with 0.1M Dollars

myshell-ai
โญ 988 Python ๐Ÿ‘ค myshell-ai Organization ๐Ÿ• Updated 2024-07-23 ๐Ÿ“… Created 2024-04-02
11
horseee/DeepCache

[CVPR 2024] DeepCache: Accelerating Diffusion Models for Free

horseee
โญ 950 Python ๐Ÿ‘ค horseee User ๐Ÿ• Updated 2024-06-27 ๐Ÿ“… Created 2023-12-01
12
Zhen-Dong/Awesome-Quantization-Papers

List of papers related to neural network quantization in recent AI conferences and journals.

Zhen-Dong
โญ 825 ๐Ÿ‘ค Zhen-Dong User ๐Ÿ• Updated 2025-03-27 ๐Ÿ“… Created 2022-01-01
13
VITA-Group/LightGaussian

[NeurIPS 2024 Spotlight]"LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS", Zhiwen Fan, Kevin Wang, Kairun Wen, Zehao Zhu, Dejia Xu, Zhangyang Wang

VITA-Group
โญ 759 Python ๐Ÿ‘ค VITA-Group Organization ๐Ÿ• Updated 2024-12-30 ๐Ÿ“… Created 2023-11-26
14
exiawsh/StreamPETR

[ICCV 2023] StreamPETR: Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detection

exiawsh
โญ 754 Python ๐Ÿ‘ค exiawsh User ๐Ÿ• Updated 2024-06-26 ๐Ÿ“… Created 2023-03-21
16
SqueezeAILab/SqueezeLLM

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

SqueezeAILab
โญ 710 Python ๐Ÿ‘ค SqueezeAILab Organization ๐Ÿ• Updated 2024-08-13 ๐Ÿ“… Created 2023-06-12
17
google-deepmind/recurrentgemma

Open weights language model from Google DeepMind, based on Griffin.

google-deepmind
โญ 686 Python ๐Ÿ‘ค google-deepmind Organization ๐Ÿ• Updated 2026-02-06 ๐Ÿ“… Created 2024-03-25
18
sail-sg/lorahub

[COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition

sail-sg
โญ 665 Python ๐Ÿ‘ค sail-sg Organization ๐Ÿ• Updated 2024-07-22 ๐Ÿ“… Created 2023-07-20

Frequently Asked Questions

1

What is the most popular #efficient-inference repository on GitHub?

The top ranked open source #efficient-inference project on GitHub is OpenBMB/MiniCPM with 11,898 stars. MiniCPM5: SOTA on-device LLMs, small yet powerful.

2

Which programming languages are most used in #efficient-inference repositories?

Among the top ranked #efficient-inference projects on GitHub, the most common programming languages are Python, Jupyter Notebook.

3

How is the #efficient-inference repository ranking calculated?

We track 18 active open source repositories tagged with #efficient-inference (500+ stars), totaling 46,090 stars with an average of 2,560 stars per repository. Rankings update daily from the GitHub API.