Git Stars Git Stars

#edge-ai Repositories

Discover 84 active open source GitHub repositories tagged with #edge-ai, accumulating 340,999 total stars (averaging 4,059 stars per project). Leading this topic is exo-explore/exo with 48,516 stars.

84
Total Repositories
340,999
Total Stars
4,059
Avg Stars/Repo
1
exo-explore/exo

Run frontier AI locally.

exo-explore
โญ 48,516 Python ๐Ÿ‘ค exo-explore Organization ๐Ÿ• Updated 2026-11-06 ๐Ÿ“… Created 2024-06-24
2
microsoft/BitNet

Official inference framework for 1-bit LLMs

microsoft
โญ 42,358 C++ ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-07-27 ๐Ÿ“… Created 2024-08-05
3
nats-io/nats-server

High-Performance server for NATS.io, the cloud and edge native messaging system.

nats-io
โญ 21,092 Go ๐Ÿ‘ค nats-io Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2012-10-29
4
karpathy/llama2.c

Inference Llama 2 in one file of pure C

karpathy
โญ 19,062 C ๐Ÿ‘ค karpathy User ๐Ÿ• Updated 2024-08-06 ๐Ÿ“… Created 2023-07-23
5
KittenML/KittenTTS

Open-source state-of-the-art TTS model that runs on a CPU ๐Ÿ˜ป

KittenML
โญ 17,026 Python ๐Ÿ‘ค KittenML Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2025-08-05
6
cactus-compute/cactus

Under-50 MB agentic, voice, and vision intelligence for consumer devices.

cactus-compute
โญ 14,864 Python ๐Ÿ‘ค cactus-compute Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2026-02-24
7
Edge0-AI/Edge0

Device-native foundation models: 145B on a laptop, 35B on a phone. Latent MoE, SSD-streamed weights, a router that predicts loads one step ahead. Mac, iPhone, Android, Windows.

Edge0-AI
โญ 12,176 C++ ๐Ÿ‘ค Edge0-AI Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-09-08
8
ultralytics/yolov3

PyTorch implementation of YOLOv3, YOLOv3-SPP, and YOLOv3-tiny for real-time object detection with training, validation, inference, and multi-format export.

ultralytics
โญ 10,647 Python ๐Ÿ‘ค ultralytics Organization ๐Ÿ• Updated 2026-11-07 ๐Ÿ“… Created 2018-08-26
9
m87-labs/moondream

tiny vision language model

m87-labs
โญ 10,167 Python ๐Ÿ‘ค m87-labs Organization ๐Ÿ• Updated 2026-04-20 ๐Ÿ“… Created 2023-12-29
10
jomjol/AI-on-the-edge-device

Easy to use device for connecting "old" measuring units (water, power, gas, ...) to the digital world

jomjol
โญ 9,000 C++ ๐Ÿ‘ค jomjol User ๐Ÿ• Updated 2026-11-07 ๐Ÿ“… Created 2020-07-28
11
google-ai-edge/LiteRT-LM

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

google-ai-edge
โญ 6,913 C++ ๐Ÿ‘ค google-ai-edge Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-04-14
12
OHF-Voice/piper1-gpl

Fast and local neural text-to-speech engine

OHF-Voice
โญ 6,342 C++ ๐Ÿ‘ค OHF-Voice Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-03-28
13
cactus-compute/engine

2-bit quantization, kernels, and runtime for consumer devices.

cactus-compute
โญ 6,200 C++ ๐Ÿ‘ค cactus-compute Organization ๐Ÿ• Updated 2026-11-05 ๐Ÿ“… Created 2025-04-23
14
beclab/Olares

Open-Source Personal Cloud OS for Always-On Agents

beclab
โญ 5,373 Go ๐Ÿ‘ค beclab Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-04-29
15
Fractal-Compute-Orchestrations/FractalAndroid

A human-centric, resource-aware Android node for edge computing and federated learning. Orchestrates distributed intelligence with privacy-first localization and empathetic hardware management.

Fractal-Compute-Orchestrations
โญ 4,851 Kotlin ๐Ÿ‘ค Fractal-Compute-Orchestrations Organization ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2025-11-21
16
0xShug0/audio.cpp

An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.

0xShug0
โญ 4,385 C++ ๐Ÿ‘ค 0xShug0 User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-06-23
17
FedML-AI/FedML

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

FedML-AI
โญ 4,068 Python ๐Ÿ‘ค FedML-AI Organization ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2020-07-21
18
NVlabs/VILA

VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and cloud.

NVlabs
โญ 3,873 Python ๐Ÿ‘ค NVlabs Organization ๐Ÿ• Updated 2026-03-12 ๐Ÿ“… Created 2024-02-23
19
mit-han-lab/llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

mit-han-lab
โญ 3,590 Python ๐Ÿ‘ค mit-han-lab Organization ๐Ÿ• Updated 2025-07-17 ๐Ÿ“… Created 2023-06-01
20
facebookresearch/pytorchvideo

A deep learning library for video understanding research.

facebookresearch
โญ 3,568 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2026-10-16 ๐Ÿ“… Created 2021-03-09
โญ 3,563 C ๐Ÿ‘ค airockchip User ๐Ÿ• Updated 2026-10-20 ๐Ÿ“… Created 2023-09-25
22
off-grid-ai/OGAM

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac โ€” GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.

off-grid-ai
โญ 3,406 TypeScript ๐Ÿ‘ค off-grid-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-01-29
23
NVIDIA-AI-IOT/jetbot

An educational AI robot based on NVIDIA Jetson Nano.

NVIDIA-AI-IOT
โญ 3,351 Jupyter Notebook ๐Ÿ‘ค NVIDIA-AI-IOT Organization ๐Ÿ• Updated 2026-06-30 ๐Ÿ“… Created 2019-03-09
24
evilsocket/cake

Distributed inference for mobile, desktop and server.

evilsocket
โญ 3,141 Rust ๐Ÿ‘ค evilsocket User ๐Ÿ• Updated 2026-04-24 ๐Ÿ“… Created 2024-07-07
โญ 2,917 C ๐Ÿ‘ค airockchip User ๐Ÿ• Updated 2026-10-20 ๐Ÿ“… Created 2022-02-15
โญ 2,894 Jupyter Notebook ๐Ÿ‘ค google-ai-edge Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-10-21
27
BBuf/tvm_mlir_learn

Compiler learning resources collect.

BBuf
โญ 2,791 Python ๐Ÿ‘ค BBuf User ๐Ÿ• Updated 2026-05-20 ๐Ÿ“… Created 2021-03-16
28
google-coral/coralnpu

A machine learning accelerator core designed for energy-efficient AI at the edge.

google-coral
โญ 2,715 Emacs Lisp ๐Ÿ‘ค google-coral Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-10-02
29
Intent-Lab/VisionClaw

Real-time AI assistant for Meta Rayโ€‘Ban smart glasses -- voice + vision + agentic actions via Gemini Live and OpenClaw

Intent-Lab
โญ 2,634 TypeScript ๐Ÿ‘ค Intent-Lab Organization ๐Ÿ• Updated 2026-10-21 ๐Ÿ“… Created 2026-02-06
30
kleinlee/DH_live

A digital human for everyone

kleinlee
โญ 2,237 Python ๐Ÿ‘ค kleinlee User ๐Ÿ• Updated 2026-08-16 ๐Ÿ“… Created 2024-07-30
31
espressif/esp-who

Face detection and recognition framework

espressif
โญ 2,183 C++ ๐Ÿ‘ค espressif Organization ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2018-10-26
32
cosmo-wander-ai/cosmo-edge

Production-grade C++ edge AI engine for video analytics and on-device VLM across Sophon, Rockchip RKNN, and x86, with visual orchestration, real-time OSD, events, and reproducible benchmarks.

cosmo-wander-ai
โญ 2,106 C ๐Ÿ‘ค cosmo-wander-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-06-09
33
NVIDIA-AI-IOT/deepstream_python_apps

DeepStream SDK Python bindings and sample applications

NVIDIA-AI-IOT
โญ 1,901 Jupyter Notebook ๐Ÿ‘ค NVIDIA-AI-IOT Organization ๐Ÿ• Updated 2026-04-01 ๐Ÿ“… Created 2019-10-29
34
Xilinx/Vitis-AI

Vitis AI is Xilinxโ€™s development stack for AI inference on Xilinx hardware platforms, including both edge devices and Alveo cards.

Xilinx
โญ 1,814 Python ๐Ÿ‘ค Xilinx Organization ๐Ÿ• Updated 2026-02-24 ๐Ÿ“… Created 2019-10-16
35
microsoft/edgeai-for-beginners

This course is designed to guide beginners through the exciting world of Edge AI, covering fundamental concepts, popular models, inference techniques, device-specific applications, model optimization, and the development of intelligent Edge AI agents.

microsoft
โญ 1,784 Jupyter Notebook ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2025-06-27
36
sipeed/MaixPy-v1

MicroPython for K210 RISC-V, let's play with edge AI easier

sipeed
โญ 1,712 Python ๐Ÿ‘ค sipeed Organization ๐Ÿ• Updated 2024-06-17 ๐Ÿ“… Created 2018-10-26
37
Anemll/Anemll

Artificial Neural Engine Machine Learning Library

Anemll
โญ 1,710 Python ๐Ÿ‘ค Anemll User ๐Ÿ• Updated 2026-10-31 ๐Ÿ“… Created 2025-01-06
38
apple-aiml-research/ml-mobileclip

This repository contains the official implementation of the research papers, "MobileCLIP" CVPR 2024 and "MobileCLIP2" TMLR August 2025

apple-aiml-research
โญ 1,687 Python ๐Ÿ‘ค apple-aiml-research Organization ๐Ÿ• Updated 2026-09-11 ๐Ÿ“… Created 2024-03-01
39
LlamaEdge/LlamaEdge

The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

LlamaEdge
โญ 1,665 Rust ๐Ÿ‘ค LlamaEdge Organization ๐Ÿ• Updated 2026-02-08 ๐Ÿ“… Created 2023-10-09
40
DT42/BerryNet

Deep learning gateway on Raspberry Pi and other edge devices

DT42
โญ 1,614 Python ๐Ÿ‘ค DT42 Organization ๐Ÿ• Updated 2026-10-31 ๐Ÿ“… Created 2017-04-27
41
EdjeElectronics/TensorFlow-Lite-Object-Detection-on-Android-and-Raspberry-Pi

A tutorial showing how to train, convert, and run TensorFlow Lite object detection models on Android devices, the Raspberry Pi, and more!

EdjeElectronics
โญ 1,592 Jupyter Notebook ๐Ÿ‘ค EdjeElectronics User ๐Ÿ• Updated 2025-02-13 ๐Ÿ“… Created 2019-09-21
42
openai/openai-realtime-embedded

Instructions on how to use the Realtime API on Microcontrollers and Embedded Platforms

openai
โญ 1,582 ๐Ÿ‘ค openai Organization ๐Ÿ• Updated 2025-03-25 ๐Ÿ“… Created 2024-11-14
43
NVIDIA-AI-IOT/deepstream_reference_apps

Samples for TensorRT/Deepstream for Tesla & Jetson

NVIDIA-AI-IOT
โญ 1,367 C++ ๐Ÿ‘ค NVIDIA-AI-IOT Organization ๐Ÿ• Updated 2026-07-15 ๐Ÿ“… Created 2018-07-16
44
espressif/esp-box

The ESP-BOX is a new generation AIoT development platform released by Espressif Systems.

espressif
โญ 1,352 HTML ๐Ÿ‘ค espressif Organization ๐Ÿ• Updated 2026-06-01 ๐Ÿ“… Created 2021-10-20
45
sqliteai/sqlite-vector

SQLite-Vector is a cross-platform, ultra-efficient SQLite extension that brings vector search capabilities to your embedded database.

sqliteai
โญ 1,221 C ๐Ÿ‘ค sqliteai Organization ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2025-04-07
46
usamahz/cpu-performance-engineering

A reading path for CPU performance engineering, from one instruction to production inference. Primary sources only, with a runnable benchmark for every section.

usamahz
โญ 1,160 Python ๐Ÿ‘ค usamahz User ๐Ÿ• Updated 2026-10-08 ๐Ÿ“… Created 2026-09-17
47
Geekgineer/YOLOs-CPP

Cross-Platform Production-ready C++ inference engine for YOLO models (v5-v12, YOLO26). Unified API for detection, segmentation, pose estimation, OBB, and classification. Built on ONNX Runtime and OpenCV. Optimized for CPU/GPU with quantization support.

Geekgineer
โญ 1,102 C++ ๐Ÿ‘ค Geekgineer User ๐Ÿ• Updated 2026-08-23 ๐Ÿ“… Created 2024-10-09
48
microsoft/Biodiversity

Microsoft AI for Good Lab biodiversity hub: project catalogue, documentation, and navigation for conservation AI, SPARROW, and MegaDetector.

microsoft
โญ 1,091 HTML ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2018-10-11
โญ 1,084 C ๐Ÿ‘ค rockchip-linux Organization ๐Ÿ• Updated 2024-03-25 ๐Ÿ“… Created 2021-06-02
50
hyperionaidev/smolmaxxing

Maximizing the ability to run different LLMs on the smallest devices possible

hyperionaidev
โญ 1,079 C ๐Ÿ‘ค hyperionaidev Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-11-04

Frequently Asked Questions

1

What is the most popular #edge-ai repository on GitHub?

The top ranked open source #edge-ai project on GitHub is exo-explore/exo with 48,516 stars. Run frontier AI locally.

2

Which programming languages are most used in #edge-ai repositories?

Among the top ranked #edge-ai projects on GitHub, the most common programming languages are Python, C++, C, Jupyter Notebook.

3

How is the #edge-ai repository ranking calculated?

We track 84 active open source repositories tagged with #edge-ai (500+ stars), totaling 340,999 stars with an average of 4,059 stars per repository. Rankings update daily from the GitHub API.