#tensorrt-llm Repositories
Discover 24 active open source GitHub repositories tagged with #tensorrt-llm, accumulating 65,708 total stars (averaging 2,737 stars per project). Leading this topic is SWivid/F5-TTS with 15,634 stars.
24 repositories total
Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
๐A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.๐
[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM
Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and full-stack tuning.
This repo contains the source code for RULER: Whatโs the Real Context Size of Your Long-Context Language Models?
[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
This repository contains tutorials and examples for Triton Inference Server
Tencent Hunyuan A13B (short as Hunyuan-A13B), an innovative and open-source LLM built on a fine-grained MoE architecture.
An Optimized Speech-to-Text Pipeline for the Whisper Model Supporting Multiple Inference Engine
๐๐๐ This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.
Frequently Asked Questions
What is the most popular #tensorrt-llm repository on GitHub?
The top ranked open source #tensorrt-llm project on GitHub is SWivid/F5-TTS with 15,634 stars. Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"
Which programming languages are most used in #tensorrt-llm repositories?
Among the top ranked #tensorrt-llm projects on GitHub, the most common programming languages are Python, Jupyter Notebook, Rust, C++.
How is the #tensorrt-llm repository ranking calculated?
We track 24 active open source repositories tagged with #tensorrt-llm (500+ stars), totaling 65,708 stars with an average of 2,737 stars per repository. Rankings update daily from the GitHub API.