#llm-optimization Repositories
Discover 18 active open source GitHub repositories tagged with #llm-optimization, accumulating 56,346 total stars (averaging 3,130 stars per project). Leading this topic is OpenBMB/MiniCPM with 11,898 stars.
18 repositories total
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
VIP cheatsheet for Stanford's CME 295 Transformers and Large Language Models
A collection of 500+ real-world ML & LLM system design case studies from 100+ companies. Learn how top tech firms implement GenAI in production.
๐ณ Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"
Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".
Frequently Asked Questions
What is the most popular #llm-optimization repository on GitHub?
The top ranked open source #llm-optimization project on GitHub is OpenBMB/MiniCPM with 11,898 stars. MiniCPM5: SOTA on-device LLMs, small yet powerful.
Which programming languages are most used in #llm-optimization repositories?
Among the top ranked #llm-optimization projects on GitHub, the most common programming languages are Python, Jupyter Notebook, TypeScript, Swift.
How is the #llm-optimization repository ranking calculated?
We track 18 active open source repositories tagged with #llm-optimization (500+ stars), totaling 56,346 stars with an average of 3,130 stars per repository. Rankings update daily from the GitHub API.