#llm-inference-acceleration Repositories
Discover 6 active open source GitHub repositories tagged with #llm-inference-acceleration, accumulating 6,745 total stars (averaging 1,124 stars per project). Leading this topic is ByteDance-Seed/Triton-distributed with 1,587 stars.
6 repositories total
[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf and PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression https://arxiv.org/abs/2405.14852
Frequently Asked Questions
What is the most popular #llm-inference-acceleration repository on GitHub?
The top ranked open source #llm-inference-acceleration project on GitHub is ByteDance-Seed/Triton-distributed with 1,587 stars. Distributed Compiler and Optimized Parallel Kernels
Which programming languages are most used in #llm-inference-acceleration repositories?
Among the top ranked #llm-inference-acceleration projects on GitHub, the most common programming languages are Python, Jupyter Notebook.
How is the #llm-inference-acceleration repository ranking calculated?
We track 6 active open source repositories tagged with #llm-inference-acceleration (500+ stars), totaling 6,745 stars with an average of 1,124 stars per repository. Rankings update daily from the GitHub API.