Git Stars Git Stars

#llm-inference-acceleration Repositories

Discover 6 active open source GitHub repositories tagged with #llm-inference-acceleration, accumulating 6,745 total stars (averaging 1,124 stars per project). Leading this topic is ByteDance-Seed/Triton-distributed with 1,587 stars.

6
Total Repositories
6,745
Total Stars
1,124
Avg Stars/Repo
Programming Languages: Python Jupyter Notebook
1
ByteDance-Seed/Triton-distributed

Distributed Compiler and Optimized Parallel Kernels

ByteDance-Seed
โญ 1,587 Python ๐Ÿ‘ค ByteDance-Seed Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-04-02
2
hao-ai-lab/LookaheadDecoding

[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

hao-ai-lab
โญ 1,337 Python ๐Ÿ‘ค hao-ai-lab Organization ๐Ÿ• Updated 2025-03-06 ๐Ÿ“… Created 2023-11-21
3
Vahe1994/AQLM

Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf and PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression https://arxiv.org/abs/2405.14852

Vahe1994
โญ 1,330 Python ๐Ÿ‘ค Vahe1994 User ๐Ÿ• Updated 2026-02-26 ๐Ÿ“… Created 2024-01-12
โญ 970 Python ๐Ÿ‘ค zhentingqi User ๐Ÿ• Updated 2025-01-23 ๐Ÿ“… Created 2024-08-07
5
skapadia3214/groq-moa

Mixture of Agents using Groq

skapadia3214
โญ 940 Python ๐Ÿ‘ค skapadia3214 User ๐Ÿ• Updated 2024-08-09 ๐Ÿ“… Created 2024-06-17

Frequently Asked Questions

1

What is the most popular #llm-inference-acceleration repository on GitHub?

The top ranked open source #llm-inference-acceleration project on GitHub is ByteDance-Seed/Triton-distributed with 1,587 stars. Distributed Compiler and Optimized Parallel Kernels

2

Which programming languages are most used in #llm-inference-acceleration repositories?

Among the top ranked #llm-inference-acceleration projects on GitHub, the most common programming languages are Python, Jupyter Notebook.

3

How is the #llm-inference-acceleration repository ranking calculated?

We track 6 active open source repositories tagged with #llm-inference-acceleration (500+ stars), totaling 6,745 stars with an average of 1,124 stars per repository. Rankings update daily from the GitHub API.