#gpu-optimization Repositories
Discover 55 active open source GitHub repositories tagged with #gpu-optimization, accumulating 216,210 total stars (averaging 3,931 stars per project). Leading this topic is Dao-AILab/flash-attention with 25,330 stars.
55 repositories total
A PyTorch Extension: Tools for easy mixed precision and distributed training in PyTorch
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
A bidirectional pipeline parallelism algorithm for computation-communication overlap in DeepSeek V3/R1 training.
๐น A more flexible framework that can generate videos at any resolution and creates videos from images.
Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".
Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and full-stack tuning.
A project demonstrating Lidar related AI solutions, including three GPU accelerated Lidar/camera DL networks (PointPillars, CenterPoint, BEVFusion) and the related libs (cuPCL, 3D SparseConvolution, YUV2RGB, cuOSD).
NVIDIA DLSS is a new and improved deep learning neural network that boosts frame rates and generates beautiful, sharp images for your games
FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/
Official implementation of the SIGGRAPH 2024 paper "A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasets"
CUDA Tile IR is an MLIR-based intermediate representation and compiler infrastructure for CUDA kernel optimization, focusing on tile-based computation patterns and optimizations targeting NVIDIA tensor core units.
Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training
Examples demonstrating available options to program multiple GPUs in a single node or a cluster
Notebooks for Large Language Models (LLMs) Specialization
Real-Time Diffusion-Based Streaming Video Super-Resolution / Real-Time Video Streaming Super-Resolution Model Based on Diffusion Architecture
C++ cross-platform 3D graphics SDK. Includes demos & helper code (resource loading etc.) to speed up development of Vulkan, OpenGL ES 2.0 & 3.x applications
JNeRF is a NeRF benchmark based on Jittor. JNeRF re-implemented instant-ngp and achieved same performance with original paper.
Frequently Asked Questions
What is the most popular #gpu-optimization repository on GitHub?
The top ranked open source #gpu-optimization project on GitHub is Dao-AILab/flash-attention with 25,330 stars. Fast and memory-efficient exact attention
Which programming languages are most used in #gpu-optimization repositories?
Among the top ranked #gpu-optimization projects on GitHub, the most common programming languages are Python, C++, Cuda, HTML.
How is the #gpu-optimization repository ranking calculated?
We track 55 active open source repositories tagged with #gpu-optimization (500+ stars), totaling 216,210 stars with an average of 3,931 stars per repository. Rankings update daily from the GitHub API.