#long-context-llm Repositories
Discover 19 active open source GitHub repositories tagged with #long-context-llm, accumulating 56,271 total stars (averaging 2,961 stars per project). Leading this topic is QwenLM/Qwen3 with 27,753 stars.
19 repositories total
CodeGeeX4-ALL-9B, a versatile model for all AI software development scenarios, including code completion, code interpreter, web search, function calling, repository-level Q&A and much more.
Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States
[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.
A MemAgent framework that can be extrapolated to 3.5M, along with a training framework for RL training of any agent workflow.
Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"
The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training
LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)
Orion-14B is a family of models includes a 14B foundation LLM, and a series of models: a chat model, a long context model, a quantized model, a RAG fine-tuned model, and an Agent fine-tuned model. The Orion-14B model series includes a 14 billion parameter multilingual foundation LLM and a series of related derivative models, including a chat model, a long context model, a quantized model, a RAG fine-tuned model, and an Agent fine-tuned model, etc.
[ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
Frequently Asked Questions
What is the most popular #long-context-llm repository on GitHub?
The top ranked open source #long-context-llm project on GitHub is QwenLM/Qwen3 with 27,753 stars. Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud.
Which programming languages are most used in #long-context-llm repositories?
Among the top ranked #long-context-llm projects on GitHub, the most common programming languages are Python, Jupyter Notebook.
How is the #long-context-llm repository ranking calculated?
We track 19 active open source repositories tagged with #long-context-llm (500+ stars), totaling 56,271 stars with an average of 2,961 stars per repository. Rankings update daily from the GitHub API.