#npu Repositories
Discover 12 active open source GitHub repositories tagged with #npu, accumulating 23,063 total stars (averaging 1,921 stars per project). Leading this topic is lemonade-sdk/lemonade with 6,262 stars.
12 repositories total
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
CubeStudio is an open-source cloud-native one-stop machine learning/deep learning/large model AI platform/MaaS/MLOps/artificial intelligence platform/training and inference platform, covering the full algorithm pipeline, multi-tenancy, computing power leasing platform, token relay, drag-and-drop task flow pipeline orchestration, multi-machine multi-card distributed training, hyperparameter search, inference services, VGPU virtualization, cloud-edge-device collaboration, edge computing, automated annotation platform, SFT fine-tuning/reward model/reinforcement learning training for large models like DeepSeek, multi-machine inference for large models with vLLM/Ollama/MindIE, private knowledge base LLMOps intelligent agents, AI model marketplace, support for domestic heterogeneous computing power scheduling (Ascend, Cambricon, Hygon, Moore Threads, Muxi, etc.), support for IB/RoCE/RDMA, and Xinchuang support.
Run LLMs on AMD Ryzenโข AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.
An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.
LLM model quantization (compression) toolkit with hardware acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU, Tenstorrent, Huawei Ascend NPU, and Intel/AMD/Apple CPUs via HF, vLLM, and SGLang.
A Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend.
Build AI agents that run 100% on-device. Sub-100ms latency on Qualcomm NPU. Zero cloud dependency.
A close-to-metal Python API for programming AMD Ryzenโข AI NPUs (AI Engines), built on an open-source MLIR-based compiler toolchain.
Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support (rkllm)
Peak compute, memory bandwidth and latency of CPUs, GPUs and NPUs: the same tests through every API that reaches a device. Command line and app for Windows, macOS, Linux and Android
Frequently Asked Questions
What is the most popular #npu repository on GitHub?
The top ranked open source #npu project on GitHub is lemonade-sdk/lemonade with 6,262 stars. Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
Which programming languages are most used in #npu repositories?
Among the top ranked #npu projects on GitHub, the most common programming languages are C++, Python, C#, Jupyter Notebook.
How is the #npu repository ranking calculated?
We track 12 active open source repositories tagged with #npu (500+ stars), totaling 23,063 stars with an average of 1,921 stars per repository. Rankings update daily from the GitHub API.