Git Stars Git Stars

#kv-cache-optimization Repositories

Discover 9 active open source GitHub repositories tagged with #kv-cache-optimization, accumulating 13,361 total stars (averaging 1,484 stars per project). Leading this topic is deepseek-ai/DeepSeek-V2 with 4,988 stars.

9
Total Repositories
13,361
Total Stars
1,484
Avg Stars/Repo
Programming Languages: Python Jupyter Notebook
1
deepseek-ai/DeepSeek-V2

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

deepseek-ai
โญ 4,988 ๐Ÿ‘ค deepseek-ai Organization ๐Ÿ• Updated 2024-09-25 ๐Ÿ“… Created 2024-04-22
2
HuangOwen/Awesome-LLM-Compression

Awesome LLM compression research papers and tools.

HuangOwen
โญ 1,899 ๐Ÿ‘ค HuangOwen User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-05-30
3
microsoft/MInference

[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.

microsoft
โญ 1,230 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2024-05-22
4
mit-han-lab/streaming-vlm

StreamingVLM: Real-Time Understanding for Infinite Video Streams

mit-han-lab
โญ 1,095 Python ๐Ÿ‘ค mit-han-lab Organization ๐Ÿ• Updated 2025-10-15 ๐Ÿ“… Created 2025-10-11
5
mustafaaljadery/gemma-2B-10M

Gemma 2B with 10M context length using Infini-attention.

mustafaaljadery
โญ 939 Python ๐Ÿ‘ค mustafaaljadery User ๐Ÿ• Updated 2024-05-12 ๐Ÿ“… Created 2024-05-07
โญ 927 Python ๐Ÿ‘ค Lux-Luna Organization ๐Ÿ• Updated 2026-04-17 ๐Ÿ“… Created 2025-09-25
7
sgl-project/sgl-learning-materials

Materials for learning SGLang

sgl-project
โญ 906 ๐Ÿ‘ค sgl-project Organization ๐Ÿ• Updated 2026-01-05 ๐Ÿ“… Created 2024-09-10
8
LLMServe/DistServe

Disaggregated serving system for Large Language Models (LLMs).

LLMServe
โญ 817 Jupyter Notebook ๐Ÿ‘ค LLMServe Organization ๐Ÿ• Updated 2025-04-06 ๐Ÿ“… Created 2024-01-16
9
llumnix-project/llumnix-ray

Efficient and easy multi-instance LLM serving

llumnix-project
โญ 561 Python ๐Ÿ‘ค llumnix-project Organization ๐Ÿ• Updated 2026-03-12 ๐Ÿ“… Created 2024-05-20

Frequently Asked Questions

1

What is the most popular #kv-cache-optimization repository on GitHub?

The top ranked open source #kv-cache-optimization project on GitHub is deepseek-ai/DeepSeek-V2 with 4,988 stars. DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

2

Which programming languages are most used in #kv-cache-optimization repositories?

Among the top ranked #kv-cache-optimization projects on GitHub, the most common programming languages are Python, Jupyter Notebook.

3

How is the #kv-cache-optimization repository ranking calculated?

We track 9 active open source repositories tagged with #kv-cache-optimization (500+ stars), totaling 13,361 stars with an average of 1,484 stars per repository. Rankings update daily from the GitHub API.