#llama-cpp Repositories
Discover 69 active open source GitHub repositories tagged with #llama-cpp, accumulating 212,421 total stars (averaging 3,078 stars per project). Leading this topic is QwenLM/Qwen3 with 27,753 stars.
69 repositories total
The fastest and only macOS dictation app with on-device STT and a custom-trained AI enhancement model. Windows and iOS TestFlight available! Android and Linux waitlists are open! A local alternative to Wispr Flow. Follow https://x.com/fluidvoiceapp for more.
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
Search your computer by what's in your files: photos, PDFs, documents, recordings, videos, and code. On-device on Mac, Windows, and Linux, built on Google DeepMind's EmbeddingGemma 2.
A C#/.NET library to run LLM (๐ฆLLaMA/LLaVA) on your local device efficiently.
Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
Hit your Claude Code usage limit? Keep going free and offline on a local model: Qwen 3.8, Gemma 4, and Qwen 4 the day it ships. Runs on Apple Silicon Macs (MLX), Linux and Windows (llama.cpp) with no API key. Your code stays home.
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac โ GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent โ watches, understands, remembers & guards your home via Telegram, Discord or Slack. Pluggable AI skills. OpenAI, Google, Anthropic or local AI. Runs on Mac Mini & AI PC.
Private AI meeting notes that stay on your computer. No meeting bot. Free and open source for Mac, Windows and Linux. An alternative to Granola, Otter and Fireflies.
Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.
A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level.
Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?
The micro-agent orchestrator that monitors anything for you. Runs entirely locally. Open source.
This course is designed to guide beginners through the exciting world of Edge AI, covering fundamental concepts, popular models, inference techniques, device-specific applications, model optimization, and the development of intelligent Edge AI agents.
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
Mirror your body in data. One standard, every source, one complete picture of you: a self-hosted health record built from lab reports, wearables and genetics, with every number traced to its source and a built-in MCP server. Run it with Docker and one LLM key, or keep every model local on llama.cpp.
Fun-ASR speech recognition models, with native Hugging Face Transformers support for Fun-ASR-Nano and separate FunASR, vLLM and llama.cpp deployment paths.
Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 29 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/systemone. The TypeSafe SDK works unchanged: set its base URL and pick an open model. CLI, desktop app, Docker, MCP server, public bench.
Zero-GPU CPU inference for 30Bโ284B MoE models (Qwen3.8 176.5B cold-cache certified in 28.26/48.35 GiB Cgroup v2, DeepSeek-V4 284B, Nemotron-30B) + RouteCrack 2.0.
Open-source no-root Android real-time screen translator for games, visual novels, and manga. Supports on-device and cloud OCR, offline LLMs, multiple translation services, on-screen translations, and text-to-speech (TTS).
Accelerate sparse, large-memory hosts using dense-compute cards, including the AI Max+ 395, M3 512G, and DGX Spark.
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable
Cotabby is local AI autocomplete for your entire Mac. Open source. On device. Everywhere you type.
Maximizing the ability to run different LLMs on the smallest devices possible
Build and run AI agents using Docker Compose. A collection of ready-to-use examples for orchestrating open-source LLMs, tools, and agent runtimes.
Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, or edge device. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intelยฎ Arcโข GPU.
Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking
Rewrites AI drafts so they read like a person wrote them โ runs locally, keeps the facts
An API-compatible, drop-in replacement for Apple's Foundation Models framework with support for custom language model providers.
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices, and scores with probabilities, on your laptop's CPU.
A CLI to estimate inference memory requirements for Hugging Face models, written in Python.
Frequently Asked Questions
What is the most popular #llama-cpp repository on GitHub?
The top ranked open source #llama-cpp project on GitHub is QwenLM/Qwen3 with 27,753 stars. Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud.
Which programming languages are most used in #llama-cpp repositories?
Among the top ranked #llama-cpp projects on GitHub, the most common programming languages are Python, TypeScript, C++, Swift.
How is the #llama-cpp repository ranking calculated?
We track 69 active open source repositories tagged with #llama-cpp (500+ stars), totaling 212,421 stars with an average of 3,078 stars per repository. Rankings update daily from the GitHub API.