#ai-inference-acceleration Repositories
Discover 3 active open source GitHub repositories tagged with #ai-inference-acceleration, accumulating 8,097 total stars (averaging 2,699 stars per project). Leading this topic is NVIDIA/Model-Optimizer with 5,646 stars.
3 repositories total
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
Frequently Asked Questions
What is the most popular #ai-inference-acceleration repository on GitHub?
The top ranked open source #ai-inference-acceleration project on GitHub is NVIDIA/Model-Optimizer with 5,646 stars. A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
Which programming languages are most used in #ai-inference-acceleration repositories?
Among the top ranked #ai-inference-acceleration projects on GitHub, the most common programming languages are Python, C++.
How is the #ai-inference-acceleration repository ranking calculated?
We track 3 active open source repositories tagged with #ai-inference-acceleration (500+ stars), totaling 8,097 stars with an average of 2,699 stars per repository. Rankings update daily from the GitHub API.