#cuda Repositories
325 repositories total
Xolotl: run DeepSeek-V4.1-Flash, all 552B parameters, as a local coding agent on one gaming PC (RTX 4090 + 110 GB RAM): ~33 tok/s agent, ~41 fast, 512K context. Plus Inkling-2-Mini (Thinking Machines, own engine + MTP drafter), GLM-5.3-Flash, Qwen3.8, LFM3-Omni. MoE experts tiered across VRAM, RAM, and NVMe (Xolotl Direct). OpenAI + Anthropic API.
An open collection of methodologies to help with successful training of large language models.
Peak compute, memory bandwidth and latency of CPUs, GPUs and NPUs: the same tests through every API that reaches a device. Command line and app for Windows, macOS, Linux and Android
A local multimodal AI desktop companion for Windows, with screen and audio perception.
Data visualisation and ray tracing in Python based on OptiX 9.1 framework.
Docker Image for Ubuntu Desktop which support HW GPU accelerated GUI apps. you can access the Container with ssh or remote desktop, just like Cloud VM.
ppl.cv is a high-performance image processing library of openPPL supporting various platforms.
an implementation of softmax splatting for differentiable forward warping using PyTorch
Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.
Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS
ManagedCUDA aims an easy integration of NVidia's CUDA in .net applications written in C#, Visual Basic or any other .net language.
Demo project showing a single Rust codebase running on CPUs and directly on GPUs
A hardware acceleration library for compute intensive cryptography :ice_cube:
A high-performance inference system for large language models, designed for production environments.
๐๐๐ This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.
Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.