#model-quantization Repositories
Discover 59 active open source GitHub repositories tagged with #model-quantization, accumulating 217,873 total stars (averaging 3,692 stars per project). Leading this topic is zai-org/ChatGLM-6B with 41,224 stars.
59 repositories total
ChatGLM-6B: An Open Bilingual Dialogue Language Model | Open Source Bilingual Dialogue Language Model
[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
This is a step-by-step guide to getting started with AI/LLM large models, including tutorials and demo code. It takes you from APIs to local large model deployment and fine-tuning. The code files will be provided in online versions for Kaggle or Colab, allowing you to learn even without a graphics card. The project also features a small code playground ๐ก where you can experiment with interesting AI scripts. Simultaneously, it includes a complete Chinese mirrored version of the assignments from Hung-Yi Lee's (HUNG-YI LEE) 2024 Introduction to Generative AI course.
This repository mainly records interview questions related to Large Language Model (LLM) Algorithm Engineers.
A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.
Recipes for shrinking, optimizing, customizing cutting edge vision models. ๐
Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?
Vitis AI is Xilinxโs development stack for AI inference on Xilinx hardware platforms, including both edge devices and Alveo cards.
[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
Spiking Brain-inspired Large Models, integrating hybrid efficient attention, MoE modules and spike encoding into its architecture
Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf and PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression https://arxiv.org/abs/2405.14852
Cosmos-Reason1 models understand the physical common sense and generate appropriate embodied decisions in natural language through long chain-of-thought reasoning processes.
BlueLM(Blue Heart Large Language Model): Open large language models developed by vivo AI Lab
A curated list of open-source projects related to DeepSeek Coder
An extremely fast implementation of whisper optimized for Apple Silicon using MLX.
Tencent Hunyuan A13B (short as Hunyuan-A13B), an innovative and open-source LLM built on a fine-grained MoE architecture.
Model Compression Toolbox for Large Language Models and Diffusion Models
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
Frequently Asked Questions
What is the most popular #model-quantization repository on GitHub?
The top ranked open source #model-quantization project on GitHub is zai-org/ChatGLM-6B with 41,224 stars. ChatGLM-6B: An Open Bilingual Dialogue Language Model | Open Source Bilingual Dialogue Language Model
Which programming languages are most used in #model-quantization repositories?
Among the top ranked #model-quantization projects on GitHub, the most common programming languages are Python, Jupyter Notebook, C, Makefile.
How is the #model-quantization repository ranking calculated?
We track 59 active open source repositories tagged with #model-quantization (500+ stars), totaling 217,873 stars with an average of 3,692 stars per repository. Rankings update daily from the GitHub API.