Git Stars Git Stars

#linear-attention Repositories

Discover 7 active open source GitHub repositories tagged with #linear-attention, accumulating 31,942 total stars (averaging 4,563 stars per project). Leading this topic is BlinkDL/RWKV-LM with 14,786 stars.

7
Total Repositories
31,942
Total Stars
4,563
Avg Stars/Repo
Programming Languages: Python C
1
BlinkDL/RWKV-LM

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

BlinkDL
โญ 14,786 Python ๐Ÿ‘ค BlinkDL User ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2021-08-08
2
FareedKhan-dev/kimi-k3-in-c

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

FareedKhan-dev
โญ 12,523 C ๐Ÿ‘ค FareedKhan-dev User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-08-01
4
GAIR-NLP/ASI-Arch

AlphaGo Moment for Model Architecture Discovery.

GAIR-NLP
โญ 1,196 Python ๐Ÿ‘ค GAIR-NLP Organization ๐Ÿ• Updated 2025-12-03 ๐Ÿ“… Created 2025-07-18
6
thu-ml/SLA

SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparseโ€“Linear Attention

thu-ml
โญ 553 Python ๐Ÿ‘ค thu-ml Organization ๐Ÿ• Updated 2026-10-18 ๐Ÿ“… Created 2025-09-25
7
OmniJev/Flide

๐Ÿ”ฅ๐Ÿ”ฅ The extremely fast inference engine for decision models

OmniJev
โญ 550 Python ๐Ÿ‘ค OmniJev Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-10-24

Frequently Asked Questions

1

What is the most popular #linear-attention repository on GitHub?

The top ranked open source #linear-attention project on GitHub is BlinkDL/RWKV-LM with 14,786 stars. RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

2

Which programming languages are most used in #linear-attention repositories?

Among the top ranked #linear-attention projects on GitHub, the most common programming languages are Python, C.

3

How is the #linear-attention repository ranking calculated?

We track 7 active open source repositories tagged with #linear-attention (500+ stars), totaling 31,942 stars with an average of 4,563 stars per repository. Rankings update daily from the GitHub API.