#sparse-attention Repositories
Discover 18 active open source GitHub repositories tagged with #sparse-attention, accumulating 62,491 total stars (averaging 3,471 stars per project). Leading this topic is deepseek-ai/FlashMLA with 13,275 stars.
18 repositories total
This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.
We propose Prism, a dynamic sparse attention framework for natively training joint video-audio generation models at 2K.
[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.
๐ณ Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"
[MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention
Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper
[ICML2025, NeurIPS2025 Spotlight] Sparse VideoGen 1 & 2: Accelerating Video Diffusion Transformers with Sparse Attention
[NeurIPS 2025] Radial Attention: O(nlogn) Sparse Attention with Energy Decay for Long Video Generation
SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable SparseโLinear Attention
Frequently Asked Questions
What is the most popular #sparse-attention repository on GitHub?
The top ranked open source #sparse-attention project on GitHub is deepseek-ai/FlashMLA with 13,275 stars. FlashMLA: Efficient Multi-head Latent Attention Kernels
Which programming languages are most used in #sparse-attention repositories?
Among the top ranked #sparse-attention projects on GitHub, the most common programming languages are Python, C++, Jupyter Notebook, Cuda.
How is the #sparse-attention repository ranking calculated?
We track 18 active open source repositories tagged with #sparse-attention (500+ stars), totaling 62,491 stars with an average of 3,471 stars per repository. Rankings update daily from the GitHub API.