Git Stars Git Stars

#local-llm Repositories

122
Total Repositories
383,928
Total Stars
3,146
Avg Stars/Repo
51
theroyallab/tabbyAPI

The official API server for Exllama. OAI compatible, lightweight, and fast.

theroyallab
โญ 1,531 Python ๐Ÿ‘ค theroyallab Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2023-11-10
52
ARahim3/mlx-tune

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning โ€” natively on MLX. Unsloth-compatible API.

ARahim3
โญ 1,475 Python ๐Ÿ‘ค ARahim3 User ๐Ÿ• Updated 2026-06-23 ๐Ÿ“… Created 2026-01-03
53
jofizcd/Soul-of-Waifu

๐ŸŒŒ Give a soul to your favorite characters. Soul of Waifu is a desktop roleplay & AI companion app featuring Live2D/VRM avatars, voice chat & local LLM. Evolve together across immersive chat, RPG adventures, and your desktop.

jofizcd
โญ 1,474 Python ๐Ÿ‘ค jofizcd User ๐Ÿ• Updated 2026-08-28 ๐Ÿ“… Created 2023-09-02
54
obsei/obsei

Open-source, privacy-first Voice of Customer analytics. A self-hosted alternative to Enterpret and Unwrap that strips PII from feedback before any LLM sees it.

obsei
โญ 1,454 Python ๐Ÿ‘ค obsei Organization ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2020-10-25
55
peonist-ai/halogen-flash-server

Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.

peonist-ai
โญ 1,412 Shell ๐Ÿ‘ค peonist-ai Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2026-08-26
56
synchopate/llama-modchip

Zero-GPU CPU inference for 30Bโ€“284B MoE models (Qwen3.8 176.5B cold-cache certified in 28.26/48.35 GiB Cgroup v2, DeepSeek-V4 284B, Nemotron-30B) + RouteCrack 2.0.

synchopate
โญ 1,398 Python ๐Ÿ‘ค synchopate User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-10-29
57
linyiLYi/voice-assistant

A simple toy demo of a local voice assistant with whisper and large language model.

linyiLYi
โญ 1,329 Python ๐Ÿ‘ค linyiLYi User ๐Ÿ• Updated 2024-04-30 ๐Ÿ“… Created 2023-12-09
58
simplexai-labs/PolyStrata

Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder, and MiniCPM-V on a second engine built for PolyStrata. One-click installation for Windows and Linux, with an OpenAI/Anthropic API on localhost.

simplexai-labs
โญ 1,324 C++ ๐Ÿ‘ค simplexai-labs Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2026-10-06
59
ASCIT31/Dark-Moon

Open-source autonomous AI penetration testing. 50 specialist agents across web, API, cloud, Active Directory, Kubernetes, CI/CD and AI/LLM (OWASP LLM Top 10), with an evidence-checked attack-path graph. Runs on a local LLM behind a Privacy Gateway. Integrates with GitHub, GitLab, Jenkins, VS Code, JetBrains, n8n, Grafana & Splunk.

ASCIT31
โญ 1,279 Python ๐Ÿ‘ค ASCIT31 Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-11-26
60
wici-ai/inferssd

Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

wici-ai
โญ 1,277 C++ ๐Ÿ‘ค wici-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-10-22
61
HelgeSverre/ollama-gui

A Web Interface for chatting with your local LLMs via the ollama API

HelgeSverre
โญ 1,272 TypeScript ๐Ÿ‘ค HelgeSverre User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-10-08
62
DasterProkio/awesome-ai-companion

Open-source AI companions, desktop pets, long-term memory & proactive chat. A comprehensive directory of open-source human-AI romance projects. Enable your local machine AI to exist independently of official platforms, equipped with memory and proactivity.

DasterProkio
โญ 1,248 HTML ๐Ÿ‘ค DasterProkio User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-07-03
63
0xSojalSec/LLMs-local

List of awesome platforms, tools, and resources for running LLMs locally

0xSojalSec
โญ 1,206 ๐Ÿ‘ค 0xSojalSec User ๐Ÿ• Updated 2026-06-10 ๐Ÿ“… Created 2025-12-17
64
StayLameBro/backburner

Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable

StayLameBro
โญ 1,195 Python ๐Ÿ‘ค StayLameBro User ๐Ÿ• Updated 2026-11-07 ๐Ÿ“… Created 2026-10-01
65
mrphrazer/reverser_ai

Provides automated reverse engineering assistance through the use of local large language models (LLMs) on consumer hardware.

mrphrazer
โญ 1,176 Python ๐Ÿ‘ค mrphrazer User ๐Ÿ• Updated 2026-05-20 ๐Ÿ“… Created 2024-03-17
66
AllAboutAI-YT/easy-local-rag

SuperEasy 100% Local RAG with Ollama + Email RAG

AllAboutAI-YT
โญ 1,175 Python ๐Ÿ‘ค AllAboutAI-YT User ๐Ÿ• Updated 2024-06-04 ๐Ÿ“… Created 2024-04-15
67
agents-io/PokeClaw

PokeClaw (PocketClaw) โ€” first on-device AI that controls your Android phone. Gemma 4, no cloud, no API key. Poke is short for Pocket.

agents-io
โญ 1,165 Kotlin ๐Ÿ‘ค agents-io Organization ๐Ÿ• Updated 2026-06-02 ๐Ÿ“… Created 2026-04-06
68
hyperionaidev/smolmaxxing

Maximizing the ability to run different LLMs on the smallest devices possible

hyperionaidev
โญ 1,079 C ๐Ÿ‘ค hyperionaidev Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-11-04
69
pguso/agents-from-scratch

Build AI agents from first principles using a local LLM - no frameworks, no cloud APIs, no hidden reasoning.

pguso
โญ 1,079 Python ๐Ÿ‘ค pguso User ๐Ÿ• Updated 2026-07-25 ๐Ÿ“… Created 2025-12-22
70
mrkrsl/web-search-mcp

A simple, locally hosted Web Search MCP server for use with Local LLMs

mrkrsl
โญ 1,072 TypeScript ๐Ÿ‘ค mrkrsl User ๐Ÿ• Updated 2025-08-08 ๐Ÿ“… Created 2025-06-27
71
pepperoni21/ollama-rs

A simple and easy-to-use library for interacting with the Ollama API.

pepperoni21
โญ 1,062 Rust ๐Ÿ‘ค pepperoni21 User ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-11-02
72
metadist/synaplan

Own the flow: one open-source AI platform for your knowledge, models and channels โ€“ web, WhatsApp, email, Outlook, Nextcloud & ownCloud. Local and cloud models side by side, with the cost on every answer.

metadist
โญ 1,045 PHP ๐Ÿ‘ค metadist Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-03-30
73
PotterRemember37/Capri-AI-Desktop

Capri โ€” an Edgerunners-inspired AI agent for your desktop. Supports Claude 3.7, Claude Code, OpenAI, and local Ollama/LLaMA. A customizable AI waifu companion with voice chat.

PotterRemember37
โญ 1,040 Python ๐Ÿ‘ค PotterRemember37 User ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2026-08-15
74
jegly/Box

The most advanced, fully offline client-side AI suite on Android today.

jegly
โญ 1,035 Kotlin ๐Ÿ‘ค jegly User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-17
75
kennss/SiliconScope

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

kennss
โญ 1,026 Swift ๐Ÿ‘ค kennss User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-06-08
76
wangeai/K3Flight

Run Kimi K3 locally on CPU with ~55GB measured runtime RAM. A single-file Linux inference server powered by cPilot Runtime.

wangeai
โญ 1,019 HTML ๐Ÿ‘ค wangeai Organization ๐Ÿ• Updated 2026-07-31 ๐Ÿ“… Created 2026-07-30
77
sgaofen/humanizer-local-model

Rewrites AI drafts so they read like a person wrote them โ€” runs locally, keeps the facts

sgaofen
โญ 1,010 Python ๐Ÿ‘ค sgaofen User ๐Ÿ• Updated 2026-10-19 ๐Ÿ“… Created 2026-09-11
78
OleksandrChekhovskyi/hax

A minimalist, terminal-native coding agent written in C.

OleksandrChekhovskyi
โญ 1,006 C ๐Ÿ‘ค OleksandrChekhovskyi User ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2026-04-24
79
patruff/ollama-mcp-bridge

Bridge between Ollama and MCP servers, enabling local LLMs to use Model Context Protocol tools

patruff
โญ 973 TypeScript ๐Ÿ‘ค patruff User ๐Ÿ• Updated 2025-04-20 ๐Ÿ“… Created 2024-12-12
80
feder-cr/jev

jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices, and scores with probabilities, on your laptop's CPU.

feder-cr
โญ 970 C++ ๐Ÿ‘ค feder-cr User ๐Ÿ• Updated 2026-10-18 ๐Ÿ“… Created 2024-08-15
81
kossakovsky/selfhost-ai

One-command installer for a self-hosted AI stack on your own server: n8n, Ollama, Open WebUI, OpenClaw, Dify, Flowise, Supabase, ComfyUI, Qdrant & 30+ tools. Docker Compose, automatic HTTPS via Caddy, built-in monitoring. Free Zapier/Make alternative.

kossakovsky
โญ 964 Shell ๐Ÿ‘ค kossakovsky User ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2025-05-05
82
orneryd/NornicDB

Nornicdb is a distributed low-latency, Graph+Vector, Temporal MVCC with all sub-ms HNSW search, graph traversal, and writes. Using Neo4j Bolt/Cypher and qdrant's gRPC means you can switch with no changes while adding intelligent features like schemas, managed embeddings, reranking+llm, GPU accel, Auto-TLP, Policy-based Memory Decay, and MCP server.

orneryd
โญ 933 Go ๐Ÿ‘ค orneryd User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-12-06
83
mrdbourke/simple-local-rag

Build a RAG (Retrieval Augmented Generation) pipeline from scratch and have it all run locally.

mrdbourke
โญ 923 Jupyter Notebook ๐Ÿ‘ค mrdbourke User ๐Ÿ• Updated 2024-05-25 ๐Ÿ“… Created 2024-03-13
84
hehehai/VoxtMini

Voice input for macOS with local models: transcribe, translate, and rewrite in any app. The successor to Voxt.

hehehai
โญ 916 Go ๐Ÿ‘ค hehehai User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-26
85
genex-games/genex-desktop

Open-source desktop app for AI-native game development. Build in Unreal Engine, Unity, Godot, Roblox, or Three.js with any AI, including local models.

genex-games
โญ 901 TypeScript ๐Ÿ‘ค genex-games Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-10-02
86
bernardo-bruning/ollama-copilot

Proxy that allows you to use ollama as a copilot like Github copilot

bernardo-bruning
โญ 887 Go ๐Ÿ‘ค bernardo-bruning User ๐Ÿ• Updated 2026-09-14 ๐Ÿ“… Created 2024-04-25
87
Pangu-Immortal/MagicWX

Android 17 local LLM prototype with Jetpack Compose and ONNX Runtime for offline AI inference experiments.

Pangu-Immortal
โญ 864 Kotlin ๐Ÿ‘ค Pangu-Immortal User ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2019-05-08
88
gavamedia/deltafin

Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.

gavamedia
โญ 862 Rust ๐Ÿ‘ค gavamedia Organization ๐Ÿ• Updated 2026-10-04 ๐Ÿ“… Created 2026-07-28
89
kytmanov/obsidian-llm-wiki-local

Karpathyโ€™s LLM Wiki, 100% local with Ollama. Drop Markdown notes โ†’ AI extracts concepts โ†’ your Obsidian wiki auto-links and grows. Zero sharing. Your notes stay yours.

kytmanov
โญ 855 Python ๐Ÿ‘ค kytmanov User ๐Ÿ• Updated 2026-05-26 ๐Ÿ“… Created 2026-04-07
90
nace-ai/kapitsa

Blazing-fast Apple Silicon inference engine optimized for Qwen & Nemotron. Compatible with the OpenAI and Anthropic APIs. Built by the team at nace.ai

nace-ai
โญ 840 C++ ๐Ÿ‘ค nace-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-10-16
91
jonigl/mcp-client-for-ollama

Harness the power of local LLMs with this TUI MCP Client for Ollama. Featuring all core MCP primitives (tools, prompts, resources), agent mode, multi-server, model switching, streaming responses, human-in-the-loop, thinking mode, model params config, system prompts, and saved preferences.

jonigl
โญ 837 Python ๐Ÿ‘ค jonigl User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2025-04-23
92
nkasmanoff/pi-card

Raspberry Pi Voice Assistant

nkasmanoff
โญ 808 Python ๐Ÿ‘ค nkasmanoff User ๐Ÿ• Updated 2024-12-22 ๐Ÿ“… Created 2024-05-04
93
tetherto/qvac

Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS, Windows, Android, iOS.

tetherto
โญ 806 TypeScript ๐Ÿ‘ค tetherto Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-01-03
94
karthik-codex/Autogen_GraphRAG_Ollama

Microsoft's GraphRAG + AutoGen + Ollama + Chainlit = Fully Local & Free Multi-Agent RAG Superbot

karthik-codex
โญ 761 Python ๐Ÿ‘ค karthik-codex User ๐Ÿ• Updated 2024-07-20 ๐Ÿ“… Created 2024-07-07
95
ILikeAI/AlwaysReddy

AlwaysReddy is a LLM voice assistant that is always just a hotkey away.

ILikeAI
โญ 760 Python ๐Ÿ‘ค ILikeAI User ๐Ÿ• Updated 2025-03-04 ๐Ÿ“… Created 2024-01-24
96
jart/emacs-copilot

Large language model code completion for Emacs

jart
โญ 758 Emacs Lisp ๐Ÿ‘ค jart User ๐Ÿ• Updated 2024-01-07 ๐Ÿ“… Created 2023-12-31
97
ARahim3/mlx-dspark

Up to 4ร— faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding โ€” Gemma-4, Qwen3.8, Muse-Glimmer, Nemotron, LFM2.5, Ornith-1.0, ternary Bonsai-27B.

ARahim3
โญ 743 Python ๐Ÿ‘ค ARahim3 User ๐Ÿ• Updated 2026-11-08 ๐Ÿ“… Created 2026-06-29
98
notatestuser/ds4-control

macOS menubar app for fast local DeepSeek V4.1, with 1M context.

notatestuser
โญ 740 Swift ๐Ÿ‘ค notatestuser User ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2026-05-29
99
prabanta-dev/janas

37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

prabanta-dev
โญ 738 C ๐Ÿ‘ค prabanta-dev Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-09-20
100
andersrex/notesollama

Use Ollama to talk to local LLMs in Apple Notes

andersrex
โญ 711 Swift ๐Ÿ‘ค andersrex User ๐Ÿ• Updated 2025-08-04 ๐Ÿ“… Created 2024-02-19