Git Stars Git Stars

#on-device-llm Repositories

Discover 6 active open source GitHub repositories tagged with #on-device-llm, accumulating 20,672 total stars (averaging 3,445 stars per project). Leading this topic is drumih/turbo-fieldfare with 7,432 stars.

6
Total Repositories
20,672
Total Stars
3,445
Avg Stars/Repo
1
drumih/turbo-fieldfare

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

drumih
โญ 7,432 Swift ๐Ÿ‘ค drumih User ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2026-07-17
2
google-ai-edge/LiteRT-LM

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

google-ai-edge
โญ 6,913 C++ ๐Ÿ‘ค google-ai-edge Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-04-14
3
Vali-98/ChatterUI

A frontend for running models on mobile or connecting to your preferred API providers.

Vali-98
โญ 2,927 TypeScript ๐Ÿ‘ค Vali-98 User ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2023-10-18
4
OpenBMB/AgentCPM-GUI

AgentCPM-GUI: An on-device GUI agent for operating Android apps, enhancing reasoning ability with reinforcement fine-tuning for efficient task execution.

OpenBMB
โญ 1,431 Python ๐Ÿ‘ค OpenBMB Organization ๐Ÿ• Updated 2026-01-11 ๐Ÿ“… Created 2025-05-13
5
HazyResearch/minions

Big & Small LLMs working together

HazyResearch
โญ 1,394 Python ๐Ÿ‘ค HazyResearch Organization ๐Ÿ• Updated 2026-03-12 ๐Ÿ“… Created 2025-02-03
6
TencentCloudADP/youtu-tip

Youtu-Tip: Tap for Intelligence, Keep on Device.

TencentCloudADP
โญ 586 Python ๐Ÿ‘ค TencentCloudADP Organization ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2025-12-31

Frequently Asked Questions

1

What is the most popular #on-device-llm repository on GitHub?

The top ranked open source #on-device-llm project on GitHub is drumih/turbo-fieldfare with 7,432 stars. Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

2

Which programming languages are most used in #on-device-llm repositories?

Among the top ranked #on-device-llm projects on GitHub, the most common programming languages are Python, Swift, C++, TypeScript.

3

How is the #on-device-llm repository ranking calculated?

We track 6 active open source repositories tagged with #on-device-llm (500+ stars), totaling 20,672 stars with an average of 3,445 stars per repository. Rankings update daily from the GitHub API.