#edge-ai Repositories
Discover 84 active open source GitHub repositories tagged with #edge-ai, accumulating 340,999 total stars (averaging 4,059 stars per project). Leading this topic is exo-explore/exo with 48,516 stars.
84 repositories total
High-Performance server for NATS.io, the cloud and edge native messaging system.
Device-native foundation models: 145B on a laptop, 35B on a phone. Latent MoE, SSD-streamed weights, a router that predicts loads one step ahead. Mac, iPhone, Android, Windows.
PyTorch implementation of YOLOv3, YOLOv3-SPP, and YOLOv3-tiny for real-time object detection with training, validation, inference, and multi-format export.
Easy to use device for connecting "old" measuring units (water, power, gas, ...) to the digital world
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
A human-centric, resource-aware Android node for edge computing and federated learning. Orchestrates distributed intelligence with privacy-first localization and empathetic hardware management.
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and cloud.
[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac โ GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
A machine learning accelerator core designed for energy-efficient AI at the edge.
Real-time AI assistant for Meta RayโBan smart glasses -- voice + vision + agentic actions via Gemini Live and OpenClaw
Production-grade C++ edge AI engine for video analytics and on-device VLM across Sophon, Rockchip RKNN, and x86, with visual orchestration, real-time OSD, events, and reproducible benchmarks.
Vitis AI is Xilinxโs development stack for AI inference on Xilinx hardware platforms, including both edge devices and Alveo cards.
This course is designed to guide beginners through the exciting world of Edge AI, covering fundamental concepts, popular models, inference techniques, device-specific applications, model optimization, and the development of intelligent Edge AI agents.
This repository contains the official implementation of the research papers, "MobileCLIP" CVPR 2024 and "MobileCLIP2" TMLR August 2025
The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
A tutorial showing how to train, convert, and run TensorFlow Lite object detection models on Android devices, the Raspberry Pi, and more!
Instructions on how to use the Realtime API on Microcontrollers and Embedded Platforms
The ESP-BOX is a new generation AIoT development platform released by Espressif Systems.
SQLite-Vector is a cross-platform, ultra-efficient SQLite extension that brings vector search capabilities to your embedded database.
A reading path for CPU performance engineering, from one instruction to production inference. Primary sources only, with a runnable benchmark for every section.
Cross-Platform Production-ready C++ inference engine for YOLO models (v5-v12, YOLO26). Unified API for detection, segmentation, pose estimation, OBB, and classification. Built on ONNX Runtime and OpenCV. Optimized for CPU/GPU with quantization support.
Microsoft AI for Good Lab biodiversity hub: project catalogue, documentation, and navigation for conservation AI, SPARROW, and MegaDetector.
Maximizing the ability to run different LLMs on the smallest devices possible
Frequently Asked Questions
What is the most popular #edge-ai repository on GitHub?
The top ranked open source #edge-ai project on GitHub is exo-explore/exo with 48,516 stars. Run frontier AI locally.
Which programming languages are most used in #edge-ai repositories?
Among the top ranked #edge-ai projects on GitHub, the most common programming languages are Python, C++, C, Jupyter Notebook.
How is the #edge-ai repository ranking calculated?
We track 84 active open source repositories tagged with #edge-ai (500+ stars), totaling 340,999 stars with an average of 4,059 stars per repository. Rankings update daily from the GitHub API.