Git Stars Git Stars

#local-llm Repositories

Discover 122 active open source GitHub repositories tagged with #local-llm, accumulating 383,928 total stars (averaging 3,146 stars per project). Leading this topic is HKUDS/nanobot with 50,249 stars.

122
Total Repositories
383,928
Total Stars
3,146
Avg Stars/Repo
1
HKUDS/nanobot

Your lightweight open-source personal agent.

HKUDS
โญ 50,249 Python ๐Ÿ‘ค HKUDS Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-01
2
codewhale-hq/Codewhale

An open-source coding agent for your terminal, written in Rust. It works with any model, can split one task across several agents, and every line of it is yours to read.

codewhale-hq
โญ 41,193 Rust ๐Ÿ‘ค codewhale-hq Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-01-19
3
mozilla-ai/llamafile

Distribute and run LLMs with a single file.

mozilla-ai
โญ 26,681 C++ ๐Ÿ‘ค mozilla-ai Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2023-09-10
4
netease-youdao/QAnything

Question and Answer based on Anything.

netease-youdao
โญ 14,210 Python ๐Ÿ‘ค netease-youdao User ๐Ÿ• Updated 2026-09-23 ๐Ÿ“… Created 2024-01-03
5
MakazhanAlpamys/Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

MakazhanAlpamys
โญ 10,703 Python ๐Ÿ‘ค MakazhanAlpamys User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-20
6
LearningCircuit/local-deep-research

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.

LearningCircuit
โญ 9,618 Python ๐Ÿ‘ค LearningCircuit User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-02-09
7
langchain-ai/local-deep-researcher

Fully local web research and report writing assistant

langchain-ai
โญ 9,415 Python ๐Ÿ‘ค langchain-ai Organization ๐Ÿ• Updated 2026-10-15 ๐Ÿ“… Created 2024-12-04
8
nashsu/FreeAskInternet

FreeAskInternet is a completely free, PRIVATE and LOCALLY running search aggregator & answer generate using MULTI LLMs, without GPU needed. The user can ask a question and the system will make a multi engine search and combine the search result to LLM and generate the answer based on search results. It's all FREE to use.

nashsu
โญ 8,734 Python ๐Ÿ‘ค nashsu User ๐Ÿ• Updated 2024-04-18 ๐Ÿ“… Created 2024-04-05
9
weaviate/Verba

Retrieval Augmented Generation (RAG) chatbot powered by Weaviate

weaviate
โญ 7,716 Python ๐Ÿ‘ค weaviate Organization ๐Ÿ• Updated 2026-05-11 ๐Ÿ“… Created 2023-07-28
10
open-multi-agent/open-multi-agent

Self-hosted TypeScript agent runtime with durable approvals and verifiable run records. Own it, approve it, audit it.

open-multi-agent
โญ 7,067 TypeScript ๐Ÿ‘ค open-multi-agent Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2026-03-31
11
dograh-hq/dograh

Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On-prem, BYOK across Speech-to-Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.

dograh-hq
โญ 6,240 Python ๐Ÿ‘ค dograh-hq Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2025-09-09
12
maziyarpanahi/openmed

Local-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android, and browser runtimes. Apache-2.0 SDK.

maziyarpanahi
โญ 5,832 Python ๐Ÿ‘ค maziyarpanahi User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-10-04
13
dnhkng/GLaDOS

This is the Personality Core for GLaDOS, the first steps towards a real-life implementation of the AI from the Portal series by Valve.

dnhkng
โญ 5,781 Python ๐Ÿ‘ค dnhkng User ๐Ÿ• Updated 2026-10-11 ๐Ÿ“… Created 2023-03-23
14
ngxson/smolvlm-realtime-webcam

Real-time webcam demo with SmolVLM and llama.cpp server

ngxson
โญ 5,555 HTML ๐Ÿ‘ค ngxson User ๐Ÿ• Updated 2025-05-12 ๐Ÿ“… Created 2025-05-12
15
AienTech/dossier

A self-hosted job search and resume builder app that writes tailored resumes and cover letters from your profile.

AienTech
โญ 5,349 TypeScript ๐Ÿ‘ค AienTech User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-10-03
16
vinta/pangu.js

Opinionated paranoid text spacing in JavaScript, with on-device AI semantic judgment

vinta
โญ 4,860 TypeScript ๐Ÿ‘ค vinta User ๐Ÿ• Updated 2026-10-24 ๐Ÿ“… Created 2012-02-21
17
PurpleDoubleD/locally-uncensored

The all-in-one local AI studio for your desktop: chat, image and video generation and a coding agent in one free, open source app. Windows and Linux. No Docker, no terminal, no cloud required.

PurpleDoubleD
โญ 4,530 TypeScript ๐Ÿ‘ค PurpleDoubleD User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-03-24
18
raullenchai/Rapid-MLX

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4ร— faster than Apple's MLX (mlx-lm) on the same weights.

raullenchai
โญ 4,168 Python ๐Ÿ‘ค raullenchai User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-25
19
langroid/langroid

Harness LLMs with Multi-Agent Programming

langroid
โญ 4,153 Python ๐Ÿ‘ค langroid Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-04-16
20
deta/surf

Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open data, open model choice (incl. local).

deta
โญ 3,646 TypeScript ๐Ÿ‘ค deta Organization ๐Ÿ• Updated 2026-08-24 ๐Ÿ“… Created 2025-10-20
21
AtomicBot-ai/atomic-agent

Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

AtomicBot-ai
โญ 3,589 TypeScript ๐Ÿ‘ค AtomicBot-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-21
22
nicedreamzapp/claude-code-local

Hit your Claude Code usage limit? Keep going free and offline on a local model: Qwen 3.8, Gemma 4, and Qwen 4 the day it ships. Runs on Apple Silicon Macs (MLX), Linux and Windows (llama.cpp) with no API key. Your code stays home.

nicedreamzapp
โญ 3,525 Python ๐Ÿ‘ค nicedreamzapp User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-03-26
23
simplexai-labs/linger

Linger is an open-source personal agent that runs entirely on your PC. We aim to break Big Techโ€™s grip on AI by bringing powerful local AI to everyday computers through efficient modelโ€“harness co-design, so everyone can run their own.

simplexai-labs
โญ 3,188 TypeScript ๐Ÿ‘ค simplexai-labs Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-11-10
24
mw00/project-maya

Run GLM-5.3 (744B), DeepSeek-V4.1-Flash (748B), MiniMax-M3.1-Flash (428B), GLM-5.3-Flash (321B), and Hy4-Flash (220B) on your own GPUs โ€” starting from 8 GB of VRAM, with NVIDIA and AMD support, one dashboard, and an OpenAI- and Anthropic-compatible API.

mw00
โญ 3,140 C++ ๐Ÿ‘ค mw00 User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-10-06
25
zachlatta/freeflow

Free & fast alternative to Wispr Flow

zachlatta
โญ 3,137 Swift ๐Ÿ‘ค zachlatta User ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2026-02-15
26
rafska/awesome-local-llm

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

rafska
โญ 3,079 ๐Ÿ‘ค rafska User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2025-06-03
27
Pinvou/pinvou-agent

Open-source desktop AI agent for tools, files, knowledge, workflows, and real deliverables.

Pinvou
โญ 3,043 Rust ๐Ÿ‘ค Pinvou Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-07-24
28
syv-ai/HyperQwen

Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.

syv-ai
โญ 2,778 Python ๐Ÿ‘ค syv-ai Organization ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2026-08-15
29
itayinbarr/little-coder

A harness optimized for smaller LLMs

itayinbarr
โญ 2,736 TypeScript ๐Ÿ‘ค itayinbarr User ๐Ÿ• Updated 2026-09-18 ๐Ÿ“… Created 2026-04-11
30
youssofal/MTPLX

The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.

youssofal
โญ 2,729 Python ๐Ÿ‘ค youssofal User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-05-02
31
papersgpt/papersgpt-for-zotero

Professional AI research tool for Zotero: chat with PDFs, search your entire library, Literature Radar, AutoPilot. 30+ LLMs or local models; built-in MCP server. Chat with your pocket Zotero on iPhone โ†’ https://www.docsagent.app

papersgpt
โญ 2,714 JavaScript ๐Ÿ‘ค papersgpt User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2024-11-22
32
ddalcu/mlx-serve

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

ddalcu
โญ 2,528 Zig ๐Ÿ‘ค ddalcu User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-17
33
severian42/GraphRAG-Local-UI

GraphRAG using Local LLMs - Features robust API and multiple apps for Indexing/Prompt Tuning/Query/Chat/Visualizing/Etc. This is meant to be the ultimate GraphRAG/KG local LLM app.

severian42
โญ 2,283 Python ๐Ÿ‘ค severian42 User ๐Ÿ• Updated 2024-11-09 ๐Ÿ“… Created 2024-07-14
34
fikrikarim/parlor

On-device, real-time multimodal AI with features similar to GPT-Live

fikrikarim
โญ 2,117 Python ๐Ÿ‘ค fikrikarim User ๐Ÿ• Updated 2026-08-03 ๐Ÿ“… Created 2026-04-05
35
inferstep/ATLAS

Adaptive Test-time Learning and Autonomous Specialization

inferstep
โญ 2,114 Python ๐Ÿ‘ค inferstep Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-02-01
36
ex3ndr/llama-coder

Replace Copilot local AI

ex3ndr
โญ 2,079 TypeScript ๐Ÿ‘ค ex3ndr User ๐Ÿ• Updated 2024-05-13 ๐Ÿ“… Created 2023-11-20
37
AtomicBot-ai/Atomic-Chat

Local AI app and inference engine for agents. Run open-weight LLMs locally โ€” private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

AtomicBot-ai
โญ 2,040 TypeScript ๐Ÿ‘ค AtomicBot-ai Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-03-31
38
axoviq-ai/synthadoc

Synthadoc: An open-source LLM knowledge compilation engine that turns raw documents into structured, local-first wikis. A transparent, human-readable alternative to traditional RAG, which can be self-managed and self-improved without the use of any tools.

axoviq-ai
โญ 1,998 Python ๐Ÿ‘ค axoviq-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-11
39
travisvn/openai-edge-tts

Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs

travisvn
โญ 1,962 Python ๐Ÿ‘ค travisvn User ๐Ÿ• Updated 2025-07-01 ๐Ÿ“… Created 2024-10-09
40
kimjammer/Neuro

A recreation of Neuro-Sama originally created in 7 days.

kimjammer
โญ 1,960 Python ๐Ÿ‘ค kimjammer User ๐Ÿ• Updated 2025-01-17 ๐Ÿ“… Created 2024-01-07
41
techjarves/USB-Uncensored-LLM

The ultimate zero-install, portable local AI environment. Run high-quality, uncensored LLMs (Gemma, Qwen, NemoMix) directly from any USB drive or SSD. Fully air-gapped, cross-platform (Win/Mac/Linux), and privacy-first with persistent chat history.

techjarves
โญ 1,835 HTML ๐Ÿ‘ค techjarves User ๐Ÿ• Updated 2026-06-06 ๐Ÿ“… Created 2026-04-14
42
jacoblee93/fully-local-pdf-chatbot

Yes, it's another chat over documents implementation... but this one is entirely local!

jacoblee93
โญ 1,815 TypeScript ๐Ÿ‘ค jacoblee93 User ๐Ÿ• Updated 2025-12-06 ๐Ÿ“… Created 2023-09-17
43
Roy3838/Observer

The micro-agent orchestrator that monitors anything for you. Runs entirely locally. Open source.

Roy3838
โญ 1,814 TypeScript ๐Ÿ‘ค Roy3838 User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-02-05
44
edgerunners-2/capri-ai-desktop

Capri โ€” Free, open-source AI desktop pet, gaming overlay, and voice companion for Windows. A visual GUI for Claude Code, Ollama, DeepSeek, and MCP. Joins Discord calls, launches Steam games, comments on gameplay, and automates on-screen tasks offline.

edgerunners-2
โญ 1,735 Python ๐Ÿ‘ค edgerunners-2 User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-08-15
45
nobodywho-ooo/nobodywho

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

nobodywho-ooo
โญ 1,699 Rust ๐Ÿ‘ค nobodywho-ooo Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2024-09-03
46
siddsachar/row-bot

Row-Bot: a local-first AI assistant that gets real work done. It remembers what matters, works in your files, code, designs, browser and apps, runs workflows and agents, and tells you when something needs you, asking before anything risky. Use your ChatGPT, Claude or Grok plan, an API key or local models. Your data stays on your machine.

siddsachar
โญ 1,695 Python ๐Ÿ‘ค siddsachar User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-03-06
47
razzant/ouroboros

Ouroboros โ€” self-creating AI agent. Born Feb 16, 2026.

razzant
โญ 1,690 Python ๐Ÿ‘ค razzant User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-11
48
waybarrios/vllm-mlx

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

waybarrios
โญ 1,657 Python ๐Ÿ‘ค waybarrios User ๐Ÿ• Updated 2026-11-07 ๐Ÿ“… Created 2025-12-06
49
autonomous-ai/Personal-AI-Computer

Open-source AI computer builds, from 2-GPU desktops to 8-GPU servers: CAD, BOM, BIOS, and build guides. Get the case kit with PCIe risers, or ask us for a free fit check.

autonomous-ai
โญ 1,601 ๐Ÿ‘ค autonomous-ai Organization ๐Ÿ• Updated 2026-11-05 ๐Ÿ“… Created 2025-08-22
50
najmuzzaman-mohammad/gawkbot

Open-source Grok bot. Gawk bots automate your menial work via AI models and build you microapps to manage the outcome, so that you have a false sense of control.

najmuzzaman-mohammad
โญ 1,586 Go ๐Ÿ‘ค najmuzzaman-mohammad User ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2026-03-25

Frequently Asked Questions

1

What is the most popular #local-llm repository on GitHub?

The top ranked open source #local-llm project on GitHub is HKUDS/nanobot with 50,249 stars. Your lightweight open-source personal agent.

2

Which programming languages are most used in #local-llm repositories?

Among the top ranked #local-llm projects on GitHub, the most common programming languages are Python, TypeScript, Rust, C++.

3

How is the #local-llm repository ranking calculated?

We track 122 active open source repositories tagged with #local-llm (500+ stars), totaling 383,928 stars with an average of 3,146 stars per repository. Rankings update daily from the GitHub API.