Git Stars Git Stars

#on-device-ai Repositories

68
Total Repositories
183,992
Total Stars
2,705
Avg Stars/Repo
51
SharpAI/SwiftLM

โšก Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

SharpAI
โญ 802 Swift ๐Ÿ‘ค SharpAI Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-03-21
52
webmachinelearning/prompt-api

๐Ÿ’ฌ A proposal for a web API for prompting browser-provided language models

webmachinelearning
โญ 797 Bikeshed ๐Ÿ‘ค webmachinelearning Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2024-07-01
53
Sentient-OS-Labs/sentient-os

An on-device LLM understands your entire life, then proactively offers to get your work done through computer use.

Sentient-OS-Labs
โญ 774 Swift ๐Ÿ‘ค Sentient-OS-Labs Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-06-10
54
carloslfu/slotstream

Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16โ€“64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

carloslfu
โญ 674 Swift ๐Ÿ‘ค carloslfu User ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2026-08-28
55
DenisovAV/flutter_edge_ai

On-device AI for Flutter โ€” Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.

DenisovAV
โญ 669 Dart ๐Ÿ‘ค DenisovAV User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-04-02
56
leonickson1/Swiftlet

Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.

leonickson1
โญ 667 Swift ๐Ÿ‘ค leonickson1 User ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2026-08-03
57
woheller69/whisperIME

Android Input Method Editor (IME) based on Whisper

woheller69
โญ 661 Java ๐Ÿ‘ค woheller69 User ๐Ÿ• Updated 2026-10-28 ๐Ÿ“… Created 2024-12-30
59
NightMean/OlliteRT

Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source

NightMean
โญ 645 Kotlin ๐Ÿ‘ค NightMean User ๐Ÿ• Updated 2026-11-07 ๐Ÿ“… Created 2026-04-06
60
sarim2000/pennywiseai-tracker

PennyWise automatically reads transaction SMS messages and transforms them into organized financial data with on-device AI assistance. No manual entry, no cloud processing, complete privacy.

sarim2000
โญ 627 Kotlin ๐Ÿ‘ค sarim2000 User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-07-18
61
keijiro/UnityMLStableDiffusion

Core ML Stable Diffusion on Unity

keijiro
โญ 605 C# ๐Ÿ‘ค keijiro User ๐Ÿ• Updated 2024-09-21 ๐Ÿ“… Created 2023-03-20
62
huggingface/swift-chat

Mac app to demonstrate swift-transformers

huggingface
โญ 592 Swift ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2024-07-29 ๐Ÿ“… Created 2023-05-11
63
Samsung/ONE

On-device Neural Engine

Samsung
โญ 584 Python ๐Ÿ‘ค Samsung Organization ๐Ÿ• Updated 2026-07-24 ๐Ÿ“… Created 2020-04-16
64
PrismML-Eng/Bonsai-Image-Demo

Generate images locally

PrismML-Eng
โญ 561 PowerShell ๐Ÿ‘ค PrismML-Eng Organization ๐Ÿ• Updated 2026-09-08 ๐Ÿ“… Created 2026-05-05
65
FluidInference/FluidUse

Local computer use on Apple silicon: on-device typed decisions with laya and form filling with CUA-S1-FORMS, driven through the macOS Accessibility API

FluidInference
โญ 547 Swift ๐Ÿ‘ค FluidInference Organization ๐Ÿ• Updated 2026-10-28 ๐Ÿ“… Created 2026-09-21
66
d2forum/19th

The 19th D2 Terminal Technology Conference "Hot ยท AI"

d2forum
โญ 536 ๐Ÿ‘ค d2forum Organization ๐Ÿ• Updated 2025-03-11 ๐Ÿ“… Created 2025-03-10
67
xybrid-ai/xybrid

Cross-platform on-device AI toolkit

xybrid-ai
โญ 527 Rust ๐Ÿ‘ค xybrid-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-12-13
68
NimbleEdge/deliteAI

On-device Agentic AI platform

NimbleEdge
โญ 519 C++ ๐Ÿ‘ค NimbleEdge Organization ๐Ÿ• Updated 2026-03-29 ๐Ÿ“… Created 2025-05-05
69
dineshsoudagar/local-llms-on-android

Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.

dineshsoudagar
โญ 501 Kotlin ๐Ÿ‘ค dineshsoudagar User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-05-04