#local-llm Repositories
Discover 122 active open source GitHub repositories tagged with #local-llm, accumulating 383,928 total stars (averaging 3,146 stars per project). Leading this topic is HKUDS/nanobot with 50,249 stars.
122 repositories total
An open-source coding agent for your terminal, written in Rust. It works with any model, can split one task across several agents, and every line of it is yours to read.
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.
FreeAskInternet is a completely free, PRIVATE and LOCALLY running search aggregator & answer generate using MULTI LLMs, without GPU needed. The user can ask a question and the system will make a multi engine search and combine the search result to LLM and generate the answer based on search results. It's all FREE to use.
Self-hosted TypeScript agent runtime with durable approvals and verifiable run records. Own it, approve it, audit it.
Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On-prem, BYOK across Speech-to-Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.
Local-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android, and browser runtimes. Apache-2.0 SDK.
This is the Personality Core for GLaDOS, the first steps towards a real-life implementation of the AI from the Portal series by Valve.
A self-hosted job search and resume builder app that writes tailored resumes and cover letters from your profile.
Opinionated paranoid text spacing in JavaScript, with on-device AI semantic judgment
The all-in-one local AI studio for your desktop: chat, image and video generation and a coding agent in one free, open source app. Windows and Linux. No Docker, no terminal, no cloud required.
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4ร faster than Apple's MLX (mlx-lm) on the same weights.
Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open data, open model choice (incl. local).
Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
Hit your Claude Code usage limit? Keep going free and offline on a local model: Qwen 3.8, Gemma 4, and Qwen 4 the day it ships. Runs on Apple Silicon Macs (MLX), Linux and Windows (llama.cpp) with no API key. Your code stays home.
Linger is an open-source personal agent that runs entirely on your PC. We aim to break Big Techโs grip on AI by bringing powerful local AI to everyday computers through efficient modelโharness co-design, so everyone can run their own.
Run GLM-5.3 (744B), DeepSeek-V4.1-Flash (748B), MiniMax-M3.1-Flash (428B), GLM-5.3-Flash (321B), and Hy4-Flash (220B) on your own GPUs โ starting from 8 GB of VRAM, with NVIDIA and AMD support, one dashboard, and an OpenAI- and Anthropic-compatible API.
A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally
Open-source desktop AI agent for tools, files, knowledge, workflows, and real deliverables.
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.
Professional AI research tool for Zotero: chat with PDFs, search your entire library, Literature Radar, AutoPilot. 30+ LLMs or local models; built-in MCP server. Chat with your pocket Zotero on iPhone โ https://www.docsagent.app
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
GraphRAG using Local LLMs - Features robust API and multiple apps for Indexing/Prompt Tuning/Query/Chat/Visualizing/Etc. This is meant to be the ultimate GraphRAG/KG local LLM app.
Local AI app and inference engine for agents. Run open-weight LLMs locally โ private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
Synthadoc: An open-source LLM knowledge compilation engine that turns raw documents into structured, local-first wikis. A transparent, human-readable alternative to traditional RAG, which can be self-managed and self-improved without the use of any tools.
Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs
The ultimate zero-install, portable local AI environment. Run high-quality, uncensored LLMs (Gemma, Qwen, NemoMix) directly from any USB drive or SSD. Fully air-gapped, cross-platform (Win/Mac/Linux), and privacy-first with persistent chat history.
Yes, it's another chat over documents implementation... but this one is entirely local!
The micro-agent orchestrator that monitors anything for you. Runs entirely locally. Open source.
Capri โ Free, open-source AI desktop pet, gaming overlay, and voice companion for Windows. A visual GUI for Claude Code, Ollama, DeepSeek, and MCP. Joins Discord calls, launches Steam games, comments on gameplay, and automates on-screen tasks offline.
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
Row-Bot: a local-first AI assistant that gets real work done. It remembers what matters, works in your files, code, designs, browser and apps, runs workflows and agents, and tells you when something needs you, asking before anything risky. Use your ChatGPT, Claude or Grok plan, an API key or local models. Your data stays on your machine.
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
Open-source AI computer builds, from 2-GPU desktops to 8-GPU servers: CAD, BOM, BIOS, and build guides. Get the case kit with PCIe risers, or ask us for a free fit check.
Open-source Grok bot. Gawk bots automate your menial work via AI models and build you microapps to manage the outcome, so that you have a false sense of control.
Frequently Asked Questions
What is the most popular #local-llm repository on GitHub?
The top ranked open source #local-llm project on GitHub is HKUDS/nanobot with 50,249 stars. Your lightweight open-source personal agent.
Which programming languages are most used in #local-llm repositories?
Among the top ranked #local-llm projects on GitHub, the most common programming languages are Python, TypeScript, Rust, C++.
How is the #local-llm repository ranking calculated?
We track 122 active open source repositories tagged with #local-llm (500+ stars), totaling 383,928 stars with an average of 3,146 stars per repository. Rankings update daily from the GitHub API.