Git Stars Git Stars

#long-context-llm Repositories

Discover 19 active open source GitHub repositories tagged with #long-context-llm, accumulating 56,271 total stars (averaging 2,961 stars per project). Leading this topic is QwenLM/Qwen3 with 27,753 stars.

19
Total Repositories
56,271
Total Stars
2,961
Avg Stars/Repo
Programming Languages: Python Jupyter Notebook
1
QwenLM/Qwen3

Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud.

QwenLM
โญ 27,753 Python ๐Ÿ‘ค QwenLM Organization ๐Ÿ• Updated 2026-01-09 ๐Ÿ“… Created 2024-02-05
2
meta-llama/llama-models

Utilities intended for use with Llama models.

meta-llama
โญ 7,727 Python ๐Ÿ‘ค meta-llama Organization ๐Ÿ• Updated 2026-02-11 ๐Ÿ“… Created 2024-06-27
โญ 3,473 ๐Ÿ‘ค MoonshotAI Organization ๐Ÿ• Updated 2025-03-07 ๐Ÿ“… Created 2025-01-19
4
zai-org/CodeGeeX4

CodeGeeX4-ALL-9B, a versatile model for all AI software development scenarios, including code completion, code interpreter, web search, function calling, repository-level Q&A and much more.

zai-org
โญ 2,347 Python ๐Ÿ‘ค zai-org Organization ๐Ÿ• Updated 2024-08-25 ๐Ÿ“… Created 2024-07-03
โญ 1,588 Python ๐Ÿ‘ค Tencent-Hunyuan Organization ๐Ÿ• Updated 2024-12-06 ๐Ÿ“… Created 2024-10-23
7
test-time-training/ttt-lm-pytorch

Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States

test-time-training
โญ 1,300 Python ๐Ÿ‘ค test-time-training User ๐Ÿ• Updated 2024-07-14 ๐Ÿ“… Created 2024-06-28
8
microsoft/MInference

[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.

microsoft
โญ 1,230 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2024-05-22
9
BytedTsinghua-SIA/MemAgent

A MemAgent framework that can be extrapolated to 3.5M, along with a training framework for RL training of any agent workflow.

BytedTsinghua-SIA
โญ 1,118 Python ๐Ÿ‘ค BytedTsinghua-SIA Organization ๐Ÿ• Updated 2026-05-12 ๐Ÿ“… Created 2025-06-24
10
abertsch72/unlimiformer

Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"

abertsch72
โญ 1,063 Python ๐Ÿ‘ค abertsch72 User ๐Ÿ• Updated 2024-03-07 ๐Ÿ“… Created 2023-05-03
11
qiuzh20/gated_attention

The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free

qiuzh20
โญ 994 Jupyter Notebook ๐Ÿ‘ค qiuzh20 User ๐Ÿ• Updated 2025-12-20 ๐Ÿ“… Created 2025-05-09
12
SandAI-org/MagiAttention

A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training

SandAI-org
โญ 975 Python ๐Ÿ‘ค SandAI-org Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-04-20
13
mustafaaljadery/gemma-2B-10M

Gemma 2B with 10M context length using Infini-attention.

mustafaaljadery
โญ 939 Python ๐Ÿ‘ค mustafaaljadery User ๐Ÿ• Updated 2024-05-12 ๐Ÿ“… Created 2024-05-07
โญ 891 Python ๐Ÿ‘ค ByteDance-Seed Organization ๐Ÿ• Updated 2025-09-15 ๐Ÿ“… Created 2025-08-08
15
dvlab-research/LLaMA-VID

LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)

JIA-Lab-research
โญ 854 Python ๐Ÿ‘ค JIA-Lab-research Organization ๐Ÿ• Updated 2024-07-29 ๐Ÿ“… Created 2023-11-28
16
OrionStarAI/Orion

Orion-14B is a family of models includes a 14B foundation LLM, and a series of models: a chat model, a long context model, a quantized model, a RAG fine-tuned model, and an Agent fine-tuned model. The Orion-14B model series includes a 14 billion parameter multilingual foundation LLM and a series of related derivative models, including a chat model, a long context model, a quantized model, a RAG fine-tuned model, and an Agent fine-tuned model, etc.

OrionStarAI
โญ 801 Python ๐Ÿ‘ค OrionStarAI Organization ๐Ÿ• Updated 2024-06-03 ๐Ÿ“… Created 2024-01-17
17
mit-han-lab/duo-attention

[ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads

mit-han-lab
โญ 541 Python ๐Ÿ‘ค mit-han-lab Organization ๐Ÿ• Updated 2025-02-10 ๐Ÿ“… Created 2024-10-15
18
DachengLi1/LongChat

Official repository for LongChat and LongEval

DachengLi1
โญ 533 Python ๐Ÿ‘ค DachengLi1 User ๐Ÿ• Updated 2024-05-24 ๐Ÿ“… Created 2023-04-21
19
QwenLM/QwQ

QwQ is the reasoning model series developed by Qwen team, Alibaba Cloud.

QwenLM
โญ 516 Python ๐Ÿ‘ค QwenLM Organization ๐Ÿ• Updated 2025-03-27 ๐Ÿ“… Created 2025-03-11

Frequently Asked Questions

1

What is the most popular #long-context-llm repository on GitHub?

The top ranked open source #long-context-llm project on GitHub is QwenLM/Qwen3 with 27,753 stars. Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud.

2

Which programming languages are most used in #long-context-llm repositories?

Among the top ranked #long-context-llm projects on GitHub, the most common programming languages are Python, Jupyter Notebook.

3

How is the #long-context-llm repository ranking calculated?

We track 19 active open source repositories tagged with #long-context-llm (500+ stars), totaling 56,271 stars with an average of 2,961 stars per repository. Rankings update daily from the GitHub API.