#transformer-optimization Repositories
Discover 7 active open source GitHub repositories tagged with #transformer-optimization, accumulating 28,537 total stars (averaging 4,076 stars per project). Leading this topic is deepseek-ai/FlashMLA with 13,275 stars.
7 repositories total
A PyTorch Extension: Tools for easy mixed precision and distributed training in PyTorch
[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.
Frequently Asked Questions
What is the most popular #transformer-optimization repository on GitHub?
The top ranked open source #transformer-optimization project on GitHub is deepseek-ai/FlashMLA with 13,275 stars. FlashMLA: Efficient Multi-head Latent Attention Kernels
Which programming languages are most used in #transformer-optimization repositories?
Among the top ranked #transformer-optimization projects on GitHub, the most common programming languages are Python, C++.
How is the #transformer-optimization repository ranking calculated?
We track 7 active open source repositories tagged with #transformer-optimization (500+ stars), totaling 28,537 stars with an average of 4,076 stars per repository. Rankings update daily from the GitHub API.