#ring-attention Repositories
Discover 3 active open source GitHub repositories tagged with #ring-attention, accumulating 2,502 total stars (averaging 834 stars per project). Leading this topic is zhuzilin/ring-flash-attention with 1,054 stars.
3 repositories total
Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
Frequently Asked Questions
What is the most popular #ring-attention repository on GitHub?
The top ranked open source #ring-attention project on GitHub is zhuzilin/ring-flash-attention with 1,054 stars. Ring attention implementation with flash attention
Which programming languages are most used in #ring-attention repositories?
Among the top ranked #ring-attention projects on GitHub, the most common programming languages are Python.
How is the #ring-attention repository ranking calculated?
We track 3 active open source repositories tagged with #ring-attention (500+ stars), totaling 2,502 stars with an average of 834 stars per repository. Rankings update daily from the GitHub API.