Git Stars Git Stars

#cuda Repositories

325
Total Repositories
1.2M
Total Stars
3,634
Avg Stars/Repo
151
chengzeyi/stable-fast

https://wavespeed.ai/ Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.

chengzeyi
โญ 1,303 Python ๐Ÿ‘ค chengzeyi User ๐Ÿ• Updated 2025-03-27 ๐Ÿ“… Created 2023-10-17
152
siboehm/SGEMM_CUDA

Fast CUDA matrix multiplication from scratch

siboehm
โญ 1,297 Cuda ๐Ÿ‘ค siboehm User ๐Ÿ• Updated 2025-09-02 ๐Ÿ“… Created 2022-11-13
153
ModelCloud/GPTQModel

LLM model quantization (compression) toolkit with hardware acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU, Tenstorrent, Huawei Ascend NPU, and Intel/AMD/Apple CPUs via HF, vLLM, and SGLang.

ModelCloud
โญ 1,294 Python ๐Ÿ‘ค ModelCloud Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-06-17
154
wici-ai/inferssd

Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

wici-ai
โญ 1,277 C++ ๐Ÿ‘ค wici-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-10-22
155
stotko/stdgpu

stdgpu: Efficient STL-like Data Structures on the GPU

stotko
โญ 1,275 C++ ๐Ÿ‘ค stotko User ๐Ÿ• Updated 2026-09-12 ๐Ÿ“… Created 2019-08-16
156
DeepGraphLearning/graphvite

GraphVite: A General and High-performance Graph Embedding System

DeepGraphLearning
โญ 1,268 C++ ๐Ÿ‘ค DeepGraphLearning Organization ๐Ÿ• Updated 2024-06-14 ๐Ÿ“… Created 2019-07-16
157
AlphaGPU
โญ 1,251 Python ๐Ÿ‘ค AlphaGPU Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-07-20
158
chelsea0x3b/cudarc

Safe rust wrapper around CUDA toolkit

chelsea0x3b
โญ 1,248 Rust ๐Ÿ‘ค chelsea0x3b User ๐Ÿ• Updated 2026-09-24 ๐Ÿ“… Created 2022-09-16
159
markus-perl/ffmpeg-build-script

The FFmpeg build script provides an easy way to build a static FFmpeg on OSX and Linux with non-free codecs included.

markus-perl
โญ 1,227 Shell ๐Ÿ‘ค markus-perl User ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2014-10-21
โญ 1,223 Python ๐Ÿ‘ค trianglesplatting Organization ๐Ÿ• Updated 2025-11-24 ๐Ÿ“… Created 2025-05-25
161
hasktorch/hasktorch

Tensors and neural networks in Haskell

hasktorch
โญ 1,215 Haskell ๐Ÿ‘ค hasktorch Organization ๐Ÿ• Updated 2026-10-20 ๐Ÿ“… Created 2017-09-09
162
jmaczan/tiny-vllm

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

jmaczan
โญ 1,207 C++ ๐Ÿ‘ค jmaczan User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-02-09
163
oneapi-src/oneAPI-samples

Samples for Intelยฎ oneAPI Toolkits

oneapi-src
โญ 1,170 C++ ๐Ÿ‘ค oneapi-src Organization ๐Ÿ• Updated 2026-07-28 ๐Ÿ“… Created 2020-05-27
164
inducer/pyopencl

OpenCL integration for Python, plus shiny features

inducer
โญ 1,158 Python ๐Ÿ‘ค inducer User ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2011-04-06
165
NVIDIA/libnvidia-container

NVIDIA container runtime library

NVIDIA
โญ 1,139 C ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2017-04-14
166
uncomplicate/neanderthal

Fast Clojure Matrix Library

uncomplicate
โญ 1,130 Clojure ๐Ÿ‘ค uncomplicate Organization ๐Ÿ• Updated 2026-08-19 ๐Ÿ“… Created 2014-08-14
167
fff-rs/juice

The Hacker's Machine Learning Engine

fff-rs
โญ 1,126 Rust ๐Ÿ‘ค fff-rs Organization ๐Ÿ• Updated 2024-07-22 ๐Ÿ“… Created 2017-01-14
168
NVIDIA/cuopt

GPU accelerated decision optimization

NVIDIA
โญ 1,123 Cuda ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-04-08
169
gunrock/gunrock

Programmable CUDA/C++ GPU Graph Analytics

gunrock
โญ 1,108 C++ ๐Ÿ‘ค gunrock Organization ๐Ÿ• Updated 2026-10-31 ๐Ÿ“… Created 2013-11-03
170
neka-nat/cupoch

Robotics with GPU computing

neka-nat
โญ 1,065 C++ ๐Ÿ‘ค neka-nat User ๐Ÿ• Updated 2026-06-25 ๐Ÿ“… Created 2019-10-22
171
LuisaGroup/LuisaCompute

High-Performance Rendering Framework on Stream Architectures

LuisaGroup
โญ 1,062 C++ ๐Ÿ‘ค LuisaGroup Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-11-20
172
NVIDIA/cuda-tile

CUDA Tile IR is an MLIR-based intermediate representation and compiler infrastructure for CUDA kernel optimization, focusing on tile-based computation patterns and optimizations targeting NVIDIA tensor core units.

NVIDIA
โญ 1,061 MLIR ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-07 ๐Ÿ“… Created 2025-11-05
173
NVlabs/cutile-rs

cuTile Rust provides a safe, tile-based kernel programming DSL for the Rust programming language. It features a safe host-side API for passing tensors to asynchronously executed kernel functions.

NVlabs
โญ 1,060 Rust ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-10-01 ๐Ÿ“… Created 2026-03-12
174
NVIDIA/raft

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

NVIDIA
โญ 1,055 Cuda ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2019-06-13
175
mryab/efficient-dl-systems

Efficient Deep Learning Systems course materials

mryab
โญ 1,052 Jupyter Notebook ๐Ÿ‘ค mryab User ๐Ÿ• Updated 2026-05-28 ๐Ÿ“… Created 2021-12-06
โญ 1,044 C++ ๐Ÿ‘ค LitLeo User ๐Ÿ• Updated 2024-03-13 ๐Ÿ“… Created 2017-04-26
โญ 1,041 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-09-24 ๐Ÿ“… Created 2023-10-06
178
BabitMF/bmf

Cross-platform, customizable multimedia/video processing framework. With strong GPU acceleration, heterogeneous design, multi-language support, easy to use, multi-framework compatible and high performance, the framework is ideal for transcoding, AI inference, algorithm integration, live video streaming, and more.

BabitMF
โญ 1,038 C++ ๐Ÿ‘ค BabitMF Organization ๐Ÿ• Updated 2026-08-26 ๐Ÿ“… Created 2023-07-15
179
mni-ml/framework

A machine learning library with a TypeScript API and Rust backend. CUDA and WebGPU compatibility. Built to understand how ML frameworks and models work internally.

mni-ml
โญ 1,023 Rust ๐Ÿ‘ค mni-ml Organization ๐Ÿ• Updated 2026-04-20 ๐Ÿ“… Created 2026-01-08
180
AccelerateHS/accelerate

Embedded language for high-performance array computations

AccelerateHS
โญ 1,021 Haskell ๐Ÿ‘ค AccelerateHS Organization ๐Ÿ• Updated 2026-06-20 ๐Ÿ“… Created 2011-04-08
181
sniklaus/sepconv-slomo

an implementation of Video Frame Interpolation via Adaptive Separable Convolution using PyTorch

sniklaus
โญ 1,020 Python ๐Ÿ‘ค sniklaus User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2017-09-10
182
Motphys/UniLab

UniLab: Contract-Driven Infrastructure for Robot Learning Across Physics Backends and Hardware

Motphys
โญ 1,011 Python ๐Ÿ‘ค Motphys Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-04
183
NVIDIA/cudnn-frontend

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

NVIDIA
โญ 1,008 Cuda ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2021-01-22
184
alternbits/awesome-cuda-books

A curated list of best CUDA programming books

alternbits
โญ 1,005 ๐Ÿ‘ค alternbits Organization ๐Ÿ• Updated 2026-05-19 ๐Ÿ“… Created 2026-01-31
185
pytorch/helion

A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.

pytorch
โญ 994 Python ๐Ÿ‘ค pytorch Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-04-22
186
Qengineering/Jetson-Nano-Ubuntu-20-image

Jetson Nano with Ubuntu 20.04 image

Qengineering
โญ 989 ๐Ÿ‘ค Qengineering User ๐Ÿ• Updated 2026-07-25 ๐Ÿ“… Created 2021-09-22
187
brichard19/BitCrack

A tool for cracking Bitcoin private keys

brichard19
โญ 988 C++ ๐Ÿ‘ค brichard19 User ๐Ÿ• Updated 2024-03-17 ๐Ÿ“… Created 2018-02-08
188
efeslab/Nanoflow

A throughput-oriented high-performance serving framework for LLMs

efeslab
โญ 978 Jupyter Notebook ๐Ÿ‘ค efeslab Organization ๐Ÿ• Updated 2026-03-29 ๐Ÿ“… Created 2024-08-19
189
Dao-AILab/causal-conv1d

Causal depthwise conv1d in CUDA, with a PyTorch interface

Dao-AILab
โญ 978 Python ๐Ÿ‘ค Dao-AILab Organization ๐Ÿ• Updated 2026-08-20 ๐Ÿ“… Created 2023-12-03
190
Celebrandil/CudaSift

A CUDA implementation of SIFT for NVidia GPUs (1.2 ms on a GTX 1060)

Celebrandil
โญ 962 Cuda ๐Ÿ‘ค Celebrandil User ๐Ÿ• Updated 2026-03-17 ๐Ÿ“… Created 2013-06-20
191
dusty-nv/ros_deep_learning

Deep learning inference nodes for ROS / ROS2 with support for NVIDIA Jetson and TensorRT

dusty-nv
โญ 959 C++ ๐Ÿ‘ค dusty-nv User ๐Ÿ• Updated 2024-07-13 ๐Ÿ“… Created 2016-10-04
192
NVIDIA/nvbench

CUDA Kernel Benchmarking Library

NVIDIA
โญ 952 Cuda ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2021-03-03
193
Totoro97/f2-nerf

Fast neural radiance field training with free camera trajectories

Totoro97
โญ 942 C ๐Ÿ‘ค Totoro97 User ๐Ÿ• Updated 2024-02-28 ๐Ÿ“… Created 2023-04-19
194
olcf/cuda-training-series

Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)

olcf
โญ 927 Cuda ๐Ÿ‘ค olcf Organization ๐Ÿ• Updated 2024-08-19 ๐Ÿ“… Created 2020-01-06
195
e-ago/bitcracker

BitCracker is the first open source password cracking tool for memory units encrypted with BitLocker

e-ago
โญ 925 C ๐Ÿ‘ค e-ago User ๐Ÿ• Updated 2024-05-31 ๐Ÿ“… Created 2017-08-03
196
NVIDIA/multi-gpu-programming-models

Examples demonstrating available options to program multiple GPUs in a single node or a cluster

NVIDIA
โญ 919 Cuda ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-06 ๐Ÿ“… Created 2018-05-11
197
tugot17/pmpp

Complete solutions to the Programming Massively Parallel Processors Edition 4

tugot17
โญ 916 Jupyter Notebook ๐Ÿ‘ค tugot17 User ๐Ÿ• Updated 2026-09-07 ๐Ÿ“… Created 2024-03-04
198
mli/transformers-benchmarks

real Transformer TeraFLOPS on various GPUs

mli
โญ 916 Jupyter Notebook ๐Ÿ‘ค mli User ๐Ÿ• Updated 2024-01-09 ๐Ÿ“… Created 2022-08-15
199
hedronvision/bazel-compile-commands-extractor

Goal: Enable awesome tooling for Bazel users of the C language family.

hedronvision
โญ 913 Python ๐Ÿ‘ค hedronvision Organization ๐Ÿ• Updated 2025-08-11 ๐Ÿ“… Created 2021-10-23
200
zhihu/ZhiLight

A highly optimized LLM inference acceleration engine for Llama and its variants.

zhihu
โญ 906 C++ ๐Ÿ‘ค zhihu Organization ๐Ÿ• Updated 2026-03-18 ๐Ÿ“… Created 2024-12-06