Git Stars Git Stars

#llama-cpp Repositories

Discover 69 active open source GitHub repositories tagged with #llama-cpp, accumulating 212,421 total stars (averaging 3,078 stars per project). Leading this topic is QwenLM/Qwen3 with 27,753 stars.

69
Total Repositories
212,421
Total Stars
3,078
Avg Stars/Repo
1
QwenLM/Qwen3

Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud.

QwenLM
โญ 27,753 Python ๐Ÿ‘ค QwenLM Organization ๐Ÿ• Updated 2026-01-09 ๐Ÿ“… Created 2024-02-05
2
mozilla-ai/llamafile

Distribute and run LLMs with a single file.

mozilla-ai
โญ 26,681 C++ ๐Ÿ‘ค mozilla-ai Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2023-09-10
3
altic-dev/FluidVoice

The fastest and only macOS dictation app with on-device STT and a custom-trained AI enhancement model. Windows and iOS TestFlight available! Android and Linux waitlists are open! A local alternative to Wispr Flow. Follow https://x.com/fluidvoiceapp for more.

altic-dev
โญ 13,189 Swift ๐Ÿ‘ค altic-dev User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-09-21
4
getumbrel/llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

getumbrel
โญ 10,990 TypeScript ๐Ÿ‘ค getumbrel Organization ๐Ÿ• Updated 2024-04-23 ๐Ÿ“… Created 2023-07-22
5
QwenAudio/SenseVoice

Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.

QwenAudio
โญ 9,797 C ๐Ÿ‘ค QwenAudio Organization ๐Ÿ• Updated 2026-09-30 ๐Ÿ“… Created 2024-07-03
6
xorbitsai/inference

Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

xorbitsai
โญ 9,667 Python ๐Ÿ‘ค xorbitsai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-06-14
7
a-ghorbani/pocketpal-ai

An app that brings language models directly to your phone.

a-ghorbani
โญ 9,644 TypeScript ๐Ÿ‘ค a-ghorbani User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2024-08-25
8
Osmantic/ODS

ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.

Osmantic
โญ 7,882 Python ๐Ÿ‘ค Osmantic Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-02-09
9
ARahim3/DigUp

Search your computer by what's in your files: photos, PDFs, documents, recordings, videos, and code. On-device on Mac, Windows, and Linux, built on Google DeepMind's EmbeddingGemma 2.

ARahim3
โญ 6,484 Swift ๐Ÿ‘ค ARahim3 User ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2026-10-08
10
nat/openplayground

An LLM playground you can run on your laptop

nat
โญ 6,342 TypeScript ๐Ÿ‘ค nat User ๐Ÿ• Updated 2026-02-06 ๐Ÿ“… Created 2023-02-26
11
defog-ai/sqlcoder

SoTA LLM for converting natural language questions to SQL queries

defog-ai
โญ 3,971 Jupyter Notebook ๐Ÿ‘ค defog-ai Organization ๐Ÿ• Updated 2024-05-23 ๐Ÿ“… Created 2023-08-17
12
SciSharp/LLamaSharp

A C#/.NET library to run LLM (๐Ÿฆ™LLaMA/LLaVA) on your local device efficiently.

SciSharp
โญ 3,826 C# ๐Ÿ‘ค SciSharp Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-05-09
13
AtomicBot-ai/atomic-agent

Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

AtomicBot-ai
โญ 3,589 TypeScript ๐Ÿ‘ค AtomicBot-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-21
14
nicedreamzapp/claude-code-local

Hit your Claude Code usage limit? Keep going free and offline on a local model: Qwen 3.8, Gemma 4, and Qwen 4 the day it ships. Runs on Apple Silicon Macs (MLX), Linux and Windows (llama.cpp) with no API key. Your code stays home.

nicedreamzapp
โญ 3,525 Python ๐Ÿ‘ค nicedreamzapp User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-03-26
15
off-grid-ai/OGAM

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac โ€” GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.

off-grid-ai
โญ 3,406 TypeScript ๐Ÿ‘ค off-grid-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-01-29
16
SharpAI/DeepCamera

Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent โ€” watches, understands, remembers & guards your home via Telegram, Discord or Slack. Pluggable AI skills. OpenAI, Google, Anthropic or local AI. Runs on Mac Mini & AI PC.

SharpAI
โญ 3,144 JavaScript ๐Ÿ‘ค SharpAI Organization ๐Ÿ• Updated 2026-09-17 ๐Ÿ“… Created 2019-03-05
17
Luce-Org/lucebox

Lucebox inference engine for heterogeneous hardware & consumer GPUs

Luce-Org
โญ 3,024 C++ ๐Ÿ‘ค Luce-Org Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-03
18
FrigadeHQ/yogurt

Private AI meeting notes that stay on your computer. No meeting bot. Free and open source for Mac, Windows and Linux. An alternative to Granola, Otter and Fireflies.

FrigadeHQ
โญ 2,828 TypeScript ๐Ÿ‘ค FrigadeHQ Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-11-10
19
Mobile-Artificial-Intelligence/maid

Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.

Mobile-Artificial-Intelligence
โญ 2,785 TypeScript ๐Ÿ‘ค Mobile-Artificial-Intelligence Organization ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2023-10-17
20
antoinezambelli/forge

A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows

antoinezambelli
โญ 2,268 Python ๐Ÿ‘ค antoinezambelli User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-02-16
21
withcatai/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level.

withcatai
โญ 2,207 TypeScript ๐Ÿ‘ค withcatai Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-08-12
22
XiongjieDai/GPU-Benchmarks-on-LLM-Inference

Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?

XiongjieDai
โญ 1,862 Jupyter Notebook ๐Ÿ‘ค XiongjieDai User ๐Ÿ• Updated 2024-05-13 ๐Ÿ“… Created 2023-07-19
23
ggml-org/Llama-macOS

A cosy home for your LLMs.

ggml-org
โญ 1,852 Swift ๐Ÿ‘ค ggml-org Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2025-06-30
24
Roy3838/Observer

The micro-agent orchestrator that monitors anything for you. Runs entirely locally. Open source.

Roy3838
โญ 1,814 TypeScript ๐Ÿ‘ค Roy3838 User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-02-05
25
microsoft/edgeai-for-beginners

This course is designed to guide beginners through the exciting world of Edge AI, covering fundamental concepts, popular models, inference techniques, device-specific applications, model optimization, and the development of intelligent Edge AI agents.

microsoft
โญ 1,784 Jupyter Notebook ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2025-06-27
26
StartLuxLabs/StartLux-Decision

Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.

StartLuxLabs
โญ 1,780 Python ๐Ÿ‘ค StartLuxLabs Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2026-09-29
27
undreamai/LLMUnity

Create characters in Unity with LLMs!

undreamai
โญ 1,740 C# ๐Ÿ‘ค undreamai Organization ๐Ÿ• Updated 2026-04-29 ๐Ÿ“… Created 2023-12-27
28
thetahealth/mirobody

Mirror your body in data. One standard, every source, one complete picture of you: a self-hosted health record built from lab reports, wearables and genetics, with every number traced to its source and a built-in MCP server. Run it with Docker and one LLM key, or keep every model local on llama.cpp.

thetahealth
โญ 1,645 Python ๐Ÿ‘ค thetahealth Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-11-29
29
QwenAudio/Fun-ASR

Fun-ASR speech recognition models, with native Hugging Face Transformers support for Fun-ASR-Nano and separate FunASR, vLLM and llama.cpp deployment paths.

QwenAudio
โญ 1,614 C ๐Ÿ‘ค QwenAudio Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-12-15
30
ollaya-dev/ollaya

Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 29 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/systemone. The TypeSafe SDK works unchanged: set its base URL and pick an open model. CLI, desktop app, Docker, MCP server, public bench.

ollaya-dev
โญ 1,473 Rust ๐Ÿ‘ค ollaya-dev Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-09-23
31
synchopate/llama-modchip

Zero-GPU CPU inference for 30Bโ€“284B MoE models (Qwen3.8 176.5B cold-cache certified in 28.26/48.35 GiB Cgroup v2, DeepSeek-V4 284B, Nemotron-30B) + RouteCrack 2.0.

synchopate
โญ 1,398 Python ๐Ÿ‘ค synchopate User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-10-29
32
gotzmann/llama.go

llama.go is like llama.cpp in pure Golang!

gotzmann
โญ 1,396 Go ๐Ÿ‘ค gotzmann User ๐Ÿ• Updated 2024-09-20 ๐Ÿ“… Created 2023-03-19
33
ciddwd/overlay-translator

Open-source no-root Android real-time screen translator for games, visual novels, and manga. Supports on-device and cloud OCR, offline LLMs, multiple translation services, on-screen translations, and text-to-speech (TTS).

ciddwd
โญ 1,369 Kotlin ๐Ÿ‘ค ciddwd User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-06-22
34
Soulmate-Halo/heterogeneous-gpu-pd-lab

Accelerate sparse, large-memory hosts using dense-compute cards, including the AI Max+ 395, M3 512G, and DGX Spark.

Soulmate-Halo
โญ 1,288 C++ ๐Ÿ‘ค Soulmate-Halo User ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2026-09-01
35
wici-ai/inferssd

Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

wici-ai
โญ 1,277 C++ ๐Ÿ‘ค wici-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-10-22
36
OpenBuddy/OpenBuddy

Open Multilingual Chatbot for Everyone

OpenBuddy
โญ 1,274 ๐Ÿ‘ค OpenBuddy Organization ๐Ÿ• Updated 2025-06-08 ๐Ÿ“… Created 2023-04-26
37
StayLameBro/backburner

Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable

StayLameBro
โญ 1,195 Python ๐Ÿ‘ค StayLameBro User ๐Ÿ• Updated 2026-11-07 ๐Ÿ“… Created 2026-10-01
38
FuJacob/cotabby

Cotabby is local AI autocomplete for your entire Mac. Open source. On device. Everywhere you type.

FuJacob
โญ 1,126 Swift ๐Ÿ‘ค FuJacob User ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2026-04-04
39
hyperionaidev/smolmaxxing

Maximizing the ability to run different LLMs on the smallest devices possible

hyperionaidev
โญ 1,079 C ๐Ÿ‘ค hyperionaidev Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-11-04
40
docker/compose-for-agents

Build and run AI agents using Docker Compose. A collection of ready-to-use examples for orchestrating open-source LLMs, tools, and agent runtimes.

docker
โญ 1,075 TypeScript ๐Ÿ‘ค docker Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2025-05-09
41
mybigday/llama.rn

React Native binding of llama.cpp

mybigday
โญ 1,074 C ๐Ÿ‘ค mybigday Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-08-02
42
Helldez/BigMoeOnEdge

Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, or edge device. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

Helldez
โญ 1,066 C++ ๐Ÿ‘ค Helldez User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-07-10
43
intel/AI-Playground

AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intelยฎ Arcโ„ข GPU.

intel
โญ 1,043 TypeScript ๐Ÿ‘ค intel Organization ๐Ÿ• Updated 2026-10-30 ๐Ÿ“… Created 2024-07-10
โญ 1,033 CSS ๐Ÿ‘ค susiai Organization ๐Ÿ• Updated 2026-01-20 ๐Ÿ“… Created 2017-11-25
45
kennss/SiliconScope

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

kennss
โญ 1,026 Swift ๐Ÿ‘ค kennss User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-06-08
46
sgaofen/humanizer-local-model

Rewrites AI drafts so they read like a person wrote them โ€” runs locally, keeps the facts

sgaofen
โญ 1,010 Python ๐Ÿ‘ค sgaofen User ๐Ÿ• Updated 2026-10-19 ๐Ÿ“… Created 2026-09-11
47
OleksandrChekhovskyi/hax

A minimalist, terminal-native coding agent written in C.

OleksandrChekhovskyi
โญ 1,006 C ๐Ÿ‘ค OleksandrChekhovskyi User ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2026-04-24
48
huggingface/AnyLanguageModel

An API-compatible, drop-in replacement for Apple's Foundation Models framework with support for custom language model providers.

huggingface
โญ 990 Swift ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-10-05
49
feder-cr/jev

jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices, and scores with probabilities, on your laptop's CPU.

feder-cr
โญ 970 C++ ๐Ÿ‘ค feder-cr User ๐Ÿ• Updated 2026-10-18 ๐Ÿ“… Created 2024-08-15
50
alvarobartt/hf-mem

A CLI to estimate inference memory requirements for Hugging Face models, written in Python.

alvarobartt
โญ 956 Python ๐Ÿ‘ค alvarobartt User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-12-22

Frequently Asked Questions

1

What is the most popular #llama-cpp repository on GitHub?

The top ranked open source #llama-cpp project on GitHub is QwenLM/Qwen3 with 27,753 stars. Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud.

2

Which programming languages are most used in #llama-cpp repositories?

Among the top ranked #llama-cpp projects on GitHub, the most common programming languages are Python, TypeScript, C++, Swift.

3

How is the #llama-cpp repository ranking calculated?

We track 69 active open source repositories tagged with #llama-cpp (500+ stars), totaling 212,421 stars with an average of 3,078 stars per repository. Rankings update daily from the GitHub API.