#cuda Repositories
325 repositories total
https://wavespeed.ai/ Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.
LLM model quantization (compression) toolkit with hardware acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU, Tenstorrent, Huawei Ascend NPU, and Intel/AMD/Apple CPUs via HF, vLLM, and SGLang.
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
The FFmpeg build script provides an easy way to build a static FFmpeg on OSX and Linux with non-free codecs included.
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
CUDA Tile IR is an MLIR-based intermediate representation and compiler infrastructure for CUDA kernel optimization, focusing on tile-based computation patterns and optimizations targeting NVIDIA tensor core units.
cuTile Rust provides a safe, tile-based kernel programming DSL for the Rust programming language. It features a safe host-side API for passing tensors to asynchronously executed kernel functions.
RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.
Cross-platform, customizable multimedia/video processing framework. With strong GPU acceleration, heterogeneous design, multi-language support, easy to use, multi-framework compatible and high performance, the framework is ideal for transcoding, AI inference, algorithm integration, live video streaming, and more.
A machine learning library with a TypeScript API and Rust backend. CUDA and WebGPU compatibility. Built to understand how ML frameworks and models work internally.
an implementation of Video Frame Interpolation via Adaptive Separable Convolution using PyTorch
UniLab: Contract-Driven Infrastructure for Robot Learning Across Physics Backends and Hardware
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.
Deep learning inference nodes for ROS / ROS2 with support for NVIDIA Jetson and TensorRT
Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)
BitCracker is the first open source password cracking tool for memory units encrypted with BitLocker
Examples demonstrating available options to program multiple GPUs in a single node or a cluster
Goal: Enable awesome tooling for Bazel users of the C language family.