Git Stars Git Stars

#transformer-optimization Repositories

Discover 7 active open source GitHub repositories tagged with #transformer-optimization, accumulating 28,537 total stars (averaging 4,076 stars per project). Leading this topic is deepseek-ai/FlashMLA with 13,275 stars.

7
Total Repositories
28,537
Total Stars
4,076
Avg Stars/Repo
Programming Languages: Python C++
1
deepseek-ai/FlashMLA

FlashMLA: Efficient Multi-head Latent Attention Kernels

deepseek-ai
โญ 13,275 C++ ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2025-02-21
2
NVIDIA/apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in PyTorch

NVIDIA
โญ 9,010 Python ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2018-04-23
3
HuangOwen/Awesome-LLM-Compression

Awesome LLM compression research papers and tools.

HuangOwen
โญ 1,899 ๐Ÿ‘ค HuangOwen User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-05-30
4
hao-ai-lab/LookaheadDecoding

[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

hao-ai-lab
โญ 1,337 Python ๐Ÿ‘ค hao-ai-lab Organization ๐Ÿ• Updated 2025-03-06 ๐Ÿ“… Created 2023-11-21
5
meta-pytorch/attention-gym

Helpful tools and examples for working with flex-attention

meta-pytorch
โญ 1,274 Python ๐Ÿ‘ค meta-pytorch Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-07-31
6
microsoft/MInference

[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.

microsoft
โญ 1,230 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2024-05-22
7
pbelcak/UltraFastBERT

The repository for the code of the UltraFastBERT paper

pbelcak
โญ 519 Python ๐Ÿ‘ค pbelcak User ๐Ÿ• Updated 2024-03-24 ๐Ÿ“… Created 2023-11-12

Frequently Asked Questions

1

What is the most popular #transformer-optimization repository on GitHub?

The top ranked open source #transformer-optimization project on GitHub is deepseek-ai/FlashMLA with 13,275 stars. FlashMLA: Efficient Multi-head Latent Attention Kernels

2

Which programming languages are most used in #transformer-optimization repositories?

Among the top ranked #transformer-optimization projects on GitHub, the most common programming languages are Python, C++.

3

How is the #transformer-optimization repository ranking calculated?

We track 7 active open source repositories tagged with #transformer-optimization (500+ stars), totaling 28,537 stars with an average of 4,076 stars per repository. Rankings update daily from the GitHub API.