Git Stars Git Stars

#efficient-attention Repositories

Discover 3 active open source GitHub repositories tagged with #efficient-attention, accumulating 5,099 total stars (averaging 1,699 stars per project). Leading this topic is thu-ml/SageAttention with 4,017 stars.

3
Total Repositories
5,099
Total Stars
1,699
Avg Stars/Repo
Programming Languages: Python Cuda

3 repositories total

1
thu-ml/SageAttention

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

thu-ml
⭐ 4,017 Cuda 👤 thu-ml Organization 🕐 Updated 2026-01-17 📅 Created 2024-10-03
2
lucidrains/ring-attention-pytorch

Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch

lucidrains
⭐ 547 Python 👤 lucidrains User 🕐 Updated 2025-05-16 📅 Created 2024-02-14
3
Amshaker/unetr_plus_plus

[IEEE TMI-2024] UNETR++: Delving into Efficient and Accurate 3D Medical Image Segmentation

Amshaker
⭐ 538 Python 👤 Amshaker User 🕐 Updated 2025-12-14 📅 Created 2022-12-09

Frequently Asked Questions

1

What is the most popular #efficient-attention repository on GitHub?

The top ranked open source #efficient-attention project on GitHub is thu-ml/SageAttention with 4,017 stars. [ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

2

Which programming languages are most used in #efficient-attention repositories?

Among the top ranked #efficient-attention projects on GitHub, the most common programming languages are Python, Cuda.

3

How is the #efficient-attention repository ranking calculated?

We track 3 active open source repositories tagged with #efficient-attention (500+ stars), totaling 5,099 stars with an average of 1,699 stars per repository. Rankings update daily from the GitHub API.