Git Stars Git Stars

#llm-optimization Repositories

Discover 18 active open source GitHub repositories tagged with #llm-optimization, accumulating 56,346 total stars (averaging 3,130 stars per project). Leading this topic is OpenBMB/MiniCPM with 11,898 stars.

18
Total Repositories
56,346
Total Stars
3,130
Avg Stars/Repo
1
OpenBMB/MiniCPM

MiniCPM5: SOTA on-device LLMs, small yet powerful.

OpenBMB
โญ 11,898 Jupyter Notebook ๐Ÿ‘ค OpenBMB Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2024-01-29
โญ 9,689 Jupyter Notebook ๐Ÿ‘ค mshumer User ๐Ÿ• Updated 2025-10-16 ๐Ÿ“… Created 2023-07-04
3
NVIDIA/Model-Optimizer

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

NVIDIA
โญ 5,646 Python ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-04-23
4
afshinea/stanford-cme-295-transformers-large-language-models

VIP cheatsheet for Stanford's CME 295 Transformers and Large Language Models

afshinea
โญ 5,110 ๐Ÿ‘ค afshinea User ๐Ÿ• Updated 2026-09-13 ๐Ÿ“… Created 2025-03-23
5
makenotion/notion-mcp-server

Official Notion MCP Server.

makenotion
โญ 4,720 TypeScript ๐Ÿ‘ค makenotion Organization ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2025-03-10
6
microsoft/PromptWizard

Task-Aware Agent-driven Prompt Optimization Framework

microsoft
โญ 4,016 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2025-10-13 ๐Ÿ“… Created 2024-05-30
7
Acmesec/PromptJailbreakManual

Prompt Jailbreak Manual

Acmesec
โญ 3,049 ๐Ÿ‘ค Acmesec Organization ๐Ÿ• Updated 2024-12-17 ๐Ÿ“… Created 2024-11-25
8
gpu-mode/resource-stream

GPU programming related news and material links

gpu-mode
โญ 2,415 ๐Ÿ‘ค gpu-mode Organization ๐Ÿ• Updated 2026-06-15 ๐Ÿ“… Created 2023-12-27
9
mainframecomputer/fullmoon-ios

chat with private and local large language models

mainframecomputer
โญ 2,255 Swift ๐Ÿ‘ค mainframecomputer Organization ๐Ÿ• Updated 2025-05-05 ๐Ÿ“… Created 2024-10-09
10
themanojdesai/genai-llm-ml-case-studies

A collection of 500+ real-world ML & LLM system design case studies from 100+ companies. Learn how top tech firms implement GenAI in production.

themanojdesai
โญ 1,607 ๐Ÿ‘ค themanojdesai User ๐Ÿ• Updated 2025-06-21 ๐Ÿ“… Created 2025-03-08
11
fla-org/native-sparse-attention

๐Ÿณ Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"

fla-org
โญ 1,030 Python ๐Ÿ‘ค fla-org Organization ๐Ÿ• Updated 2026-02-05 ๐Ÿ“… Created 2025-02-21
12
hinthornw/promptimizer

Prompt optimization scratch

hinthornw
โญ 899 Python ๐Ÿ‘ค hinthornw User ๐Ÿ• Updated 2025-04-17 ๐Ÿ“… Created 2024-10-30
13
IST-DASLab/sparsegpt

Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".

IST-DASLab
โญ 859 Python ๐Ÿ‘ค IST-DASLab Organization ๐Ÿ• Updated 2024-08-20 ๐Ÿ“… Created 2023-03-20
14
pig-dot-dev/muscle-mem

A cache for AI agents to learn and replay complex behaviors.

pig-dot-dev
โญ 762 Python ๐Ÿ‘ค pig-dot-dev Organization ๐Ÿ• Updated 2025-06-15 ๐Ÿ“… Created 2025-05-08
โญ 663 Python ๐Ÿ‘ค nyunAI Organization ๐Ÿ• Updated 2025-01-22 ๐Ÿ“… Created 2024-07-08
17
ganarajpr/awesome-dspy

An Awesome list of curated DSPy resources.

ganarajpr
โญ 592 ๐Ÿ‘ค ganarajpr User ๐Ÿ• Updated 2026-10-28 ๐Ÿ“… Created 2024-02-22

Frequently Asked Questions

1

What is the most popular #llm-optimization repository on GitHub?

The top ranked open source #llm-optimization project on GitHub is OpenBMB/MiniCPM with 11,898 stars. MiniCPM5: SOTA on-device LLMs, small yet powerful.

2

Which programming languages are most used in #llm-optimization repositories?

Among the top ranked #llm-optimization projects on GitHub, the most common programming languages are Python, Jupyter Notebook, TypeScript, Swift.

3

How is the #llm-optimization repository ranking calculated?

We track 18 active open source repositories tagged with #llm-optimization (500+ stars), totaling 56,346 stars with an average of 3,130 stars per repository. Rankings update daily from the GitHub API.