Git Stars Git Stars

#ai-inference-acceleration Repositories

Discover 3 active open source GitHub repositories tagged with #ai-inference-acceleration, accumulating 8,097 total stars (averaging 2,699 stars per project). Leading this topic is NVIDIA/Model-Optimizer with 5,646 stars.

3
Total Repositories
8,097
Total Stars
2,699
Avg Stars/Repo
Programming Languages: Python C++

3 repositories total

1
NVIDIA/Model-Optimizer

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

NVIDIA
⭐ 5,646 Python 👤 NVIDIA Organization 🕐 Updated 2026-11-21 📅 Created 2024-04-23
2
ai-dynamo/nixl

NVIDIA Inference Xfer Library (NIXL)

ai-dynamo
⭐ 1,373 C++ 👤 ai-dynamo Organization 🕐 Updated 2026-11-21 📅 Created 2025-03-05

Frequently Asked Questions

1

What is the most popular #ai-inference-acceleration repository on GitHub?

The top ranked open source #ai-inference-acceleration project on GitHub is NVIDIA/Model-Optimizer with 5,646 stars. A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

2

Which programming languages are most used in #ai-inference-acceleration repositories?

Among the top ranked #ai-inference-acceleration projects on GitHub, the most common programming languages are Python, C++.

3

How is the #ai-inference-acceleration repository ranking calculated?

We track 3 active open source repositories tagged with #ai-inference-acceleration (500+ stars), totaling 8,097 stars with an average of 2,699 stars per repository. Rankings update daily from the GitHub API.