Git Stars Git Stars

#tensorrt-llm Repositories

Discover 24 active open source GitHub repositories tagged with #tensorrt-llm, accumulating 65,708 total stars (averaging 2,737 stars per project). Leading this topic is SWivid/F5-TTS with 15,634 stars.

24
Total Repositories
65,708
Total Stars
2,737
Avg Stars/Repo
1
SWivid/F5-TTS

Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"

SWivid
โญ 15,634 Python ๐Ÿ‘ค SWivid User ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2024-10-08
2
ai-dynamo/dynamo

A Datacenter Scale Distributed Inference Serving Framework

ai-dynamo
โญ 8,542 Rust ๐Ÿ‘ค ai-dynamo Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-03-03
3
NVIDIA/Model-Optimizer

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

NVIDIA
โญ 5,646 Python ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-04-23
4
xlite-dev/Awesome-LLM-Inference

๐Ÿ“šA curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.๐ŸŽ‰

xlite-dev
โญ 5,565 Python ๐Ÿ‘ค xlite-dev Organization ๐Ÿ• Updated 2026-10-20 ๐Ÿ“… Created 2023-08-27
5
collabora/WhisperLive

A nearly-live implementation of OpenAI's Whisper.

collabora
โญ 4,363 Python ๐Ÿ‘ค collabora Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-05-04
6
mit-han-lab/llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

mit-han-lab
โญ 3,590 Python ๐Ÿ‘ค mit-han-lab Organization ๐Ÿ• Updated 2025-07-17 ๐Ÿ“… Created 2023-06-01
7
NVIDIA/ChatRTX

A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM

NVIDIA
โญ 3,101 Python ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-01-21 ๐Ÿ“… Created 2023-10-18
8
cfregly/ai-performance-engineering

Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and full-stack tuning.

cfregly
โญ 2,233 Python ๐Ÿ‘ค cfregly User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2025-04-21
9
SemiAnalysisAI/InferenceX

Open-Source Inference Research Platform

SemiAnalysisAI
โญ 2,074 Python ๐Ÿ‘ค SemiAnalysisAI Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-07-12
10
brevdev/launchables

Collection of notebook guides created by the Brev.dev team!

brevdev
โญ 1,819 Jupyter Notebook ๐Ÿ‘ค brevdev Organization ๐Ÿ• Updated 2026-07-21 ๐Ÿ“… Created 2023-08-14
11
NVIDIA/RULER

This repo contains the source code for RULER: Whatโ€™s the Real Context Size of Your Long-Context Language Models?

NVIDIA
โญ 1,641 Python ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2024-04-09
โญ 1,588 Python ๐Ÿ‘ค Tencent-Hunyuan Organization ๐Ÿ• Updated 2024-12-06 ๐Ÿ“… Created 2024-10-23
13
mit-han-lab/smoothquant

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

mit-han-lab
โญ 1,576 Python ๐Ÿ‘ค mit-han-lab Organization ๐Ÿ• Updated 2024-07-12 ๐Ÿ“… Created 2022-11-17
14
NVIDIA-NeMo/Skills

A project to improve skills of large language models

NVIDIA-NeMo
โญ 1,065 Python ๐Ÿ‘ค NVIDIA-NeMo Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2024-02-11
โญ 1,041 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-09-24 ๐Ÿ“… Created 2023-10-06
16
triton-inference-server/tensorrtllm_backend

The Triton TensorRT-LLM Backend

triton-inference-server
โญ 944 ๐Ÿ‘ค triton-inference-server Organization ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2023-09-12
17
triton-inference-server/tutorials

This repository contains tutorials and examples for Triton Inference Server

triton-inference-server
โญ 869 Python ๐Ÿ‘ค triton-inference-server Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2022-12-16
18
Tencent-Hunyuan/Hunyuan-A13B

Tencent Hunyuan A13B (short as Hunyuan-A13B), an innovative and open-source LLM built on a fine-grained MoE architecture.

Tencent-Hunyuan
โญ 815 Python ๐Ÿ‘ค Tencent-Hunyuan Organization ๐Ÿ• Updated 2025-07-08 ๐Ÿ“… Created 2025-06-27
โญ 727 Python ๐Ÿ‘ค Tencent-Hunyuan Organization ๐Ÿ• Updated 2025-12-30 ๐Ÿ“… Created 2025-08-28
20
IEIT-Yuan/Yuan-2.0

Yuan 2.0 Large Language Model

IEIT-Yuan
โญ 689 Python ๐Ÿ‘ค IEIT-Yuan Organization ๐Ÿ• Updated 2024-07-11 ๐Ÿ“… Created 2023-11-26
โญ 553 C++ ๐Ÿ‘ค Tencent Organization ๐Ÿ• Updated 2026-08-27 ๐Ÿ“… Created 2024-05-22
23
shashikg/WhisperS2T

An Optimized Speech-to-Text Pipeline for the Whisper Model Supporting Multiple Inference Engine

shashikg
โญ 534 Jupyter Notebook ๐Ÿ‘ค shashikg User ๐Ÿ• Updated 2024-08-27 ๐Ÿ“… Created 2023-12-16
24
coderonion/awesome-cuda-and-hpc

๐Ÿš€๐Ÿš€๐Ÿš€ This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.

coderonion
โญ 502 ๐Ÿ‘ค coderonion User ๐Ÿ• Updated 2025-08-02 ๐Ÿ“… Created 2023-02-23

Frequently Asked Questions

1

What is the most popular #tensorrt-llm repository on GitHub?

The top ranked open source #tensorrt-llm project on GitHub is SWivid/F5-TTS with 15,634 stars. Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"

2

Which programming languages are most used in #tensorrt-llm repositories?

Among the top ranked #tensorrt-llm projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Rust, C++.

3

How is the #tensorrt-llm repository ranking calculated?

We track 24 active open source repositories tagged with #tensorrt-llm (500+ stars), totaling 65,708 stars with an average of 2,737 stars per repository. Rankings update daily from the GitHub API.