Git Stars Git Stars

#local-llm Repositories

122
Total Repositories
383,928
Total Stars
3,146
Avg Stars/Repo
101
travisvn/chatterbox-tts-api

Local, OpenAI-compatible text-to-speech (TTS) API using Chatterbox, enabling users to generate voice cloned speech anywhere the OpenAI API is used (e.g. Open WebUI, AnythingLLM, etc.)

travisvn
โญ 700 Python ๐Ÿ‘ค travisvn User ๐Ÿ• Updated 2025-12-23 ๐Ÿ“… Created 2025-05-31
102
gensyn-ai/codeassist

A completely private and local AI coding assistant, developed by Gensyn. It helps you practice programming problems and train a novel assistant to help you code.

gensyn-ai
โญ 699 Python ๐Ÿ‘ค gensyn-ai Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2025-10-31
103
codingmoh/open-codex

Fully open-source command-line AI assistant inspired by OpenAI Codex, supporting local language models.

codingmoh
โญ 696 Python ๐Ÿ‘ค codingmoh User ๐Ÿ• Updated 2026-10-20 ๐Ÿ“… Created 2025-03-29
104
carloslfu/slotstream

Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16โ€“64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

carloslfu
โญ 674 Swift ๐Ÿ‘ค carloslfu User ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2026-08-28
105
leonickson1/Swiftlet

Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.

leonickson1
โญ 667 Swift ๐Ÿ‘ค leonickson1 User ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2026-08-03
106
Nehanth/pooled

Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.

Nehanth
โญ 658 JavaScript ๐Ÿ‘ค Nehanth User ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2026-09-01
107
NightMean/OlliteRT

Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source

NightMean
โญ 645 Kotlin ๐Ÿ‘ค NightMean User ๐Ÿ• Updated 2026-11-07 ๐Ÿ“… Created 2026-04-06
108
ServiceStack/llms

LLM Client, Server API and UI

ServiceStack
โญ 631 JavaScript ๐Ÿ‘ค ServiceStack Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-09-23
109
runebookai/tome

a magical LLM desktop client that makes it easy for *anyone* to use LLMs and MCP

runebookai
โญ 630 Svelte ๐Ÿ‘ค runebookai Organization ๐Ÿ• Updated 2025-10-20 ๐Ÿ“… Created 2025-04-25
110
jaylfc/taOS

Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full web desktop + app store, and auto-clustering across the consumer hardware you already have (Orange/Raspberry Pi, Mac mini, gaming PC).

jaylfc
โญ 609 Python ๐Ÿ‘ค jaylfc User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-04-05
111
abacusai/abacusai-bot

100% free, open-source personal agents for your messaging apps, tools, and services

abacusai
โญ 601 TypeScript ๐Ÿ‘ค abacusai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-09-11
112
heider-x/vela

AI-powered IDE for novel writing โ€” local LLM + RAG, privacy-first, BYOK. For web fiction authors and creative writers.

heider-x
โญ 593 TypeScript ๐Ÿ‘ค heider-x User ๐Ÿ• Updated 2026-10-19 ๐Ÿ“… Created 2026-04-21
113
vstorm-co/agenticos

Open-source, self-hosted AI agent platform for your company's AI teammates. Build, run and govern agents on your own servers and models: shared chat, RAG, skills, a real browser, 4,700+ MCP servers, budgets, approvals and an audit trail. An alternative to ChatGPT Enterprise and Grok Bot. Apache-2.0, built on Pydantic AI.

vstorm-co
โญ 589 Python ๐Ÿ‘ค vstorm-co Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-07-31
114
aristoapp/awesome-second-brain

A curated solutions to building a self-evolving second brain that helps AI agents understand your personal and team context.

aristoapp
โญ 586 ๐Ÿ‘ค aristoapp Organization ๐Ÿ• Updated 2026-07-13 ๐Ÿ“… Created 2026-01-12
115
DilawarShafiq/nietzschian-debugger

It won't fix your bug. It'll fix you. The debugger that hands the question back instead of the answer.

DilawarShafiq
โญ 562 Python ๐Ÿ‘ค DilawarShafiq User ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2026-02-24
116
ibrahimcetin/reins

Local AI chat for iPhone, iPad and Mac. Connect Ollama, LM Studio or any OpenAI-compatible server, or run MLX models on-device. Includes tools and web search.

ibrahimcetin
โญ 561 Dart ๐Ÿ‘ค ibrahimcetin User ๐Ÿ• Updated 2026-10-14 ๐Ÿ“… Created 2024-11-11
117
FrigadeHQ/hob

An easier way to use AI on your own computer. A free, open-source alternative to Claude and ChatGPT that runs open-weight models like Gemma and gpt-oss locally on Mac, Windows and Linux. Private, and works offline.

FrigadeHQ
โญ 556 TypeScript ๐Ÿ‘ค FrigadeHQ Organization ๐Ÿ• Updated 2026-10-30 ๐Ÿ“… Created 2026-10-14
118
Indras-Mirror/Xolotl

Xolotl: run DeepSeek-V4.1-Flash, all 552B parameters, as a local coding agent on one gaming PC (RTX 4090 + 110 GB RAM): ~33 tok/s agent, ~41 fast, 512K context. Plus Inkling-2-Mini (Thinking Machines, own engine + MTP drafter), GLM-5.3-Flash, Qwen3.8, LFM3-Omni. MoE experts tiered across VRAM, RAM, and NVMe (Xolotl Direct). OpenAI + Anthropic API.

Indras-Mirror
โญ 549 C++ ๐Ÿ‘ค Indras-Mirror User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-10-06
119
Yzw202011/OmniSpace

A local-first, full-stack AI creative workstation: five modulesโ€”AI chat, AI comics, comic drama creation, writing desk, and knowledge learning; multi-engine local inference with vLLM / llama.cpp / Transformers, intelligent VRAM scheduling, bulkhead isolation and self-healing. For learning purposes only; feedback and discussion are welcome. (The latest progress, excluding the plugin system, cannot currently be committed to the repository due to protocol restrictions.)

Yzw202011
โญ 536 Python ๐Ÿ‘ค Yzw202011 User ๐Ÿ• Updated 2026-09-20 ๐Ÿ“… Created 2026-08-23
120
mantisfury/ArkhamMirror

Local-first AI-powered document intelligence platform for investigative journalism

mantisfury
โญ 507 Python ๐Ÿ‘ค mantisfury User ๐Ÿ• Updated 2026-01-25 ๐Ÿ“… Created 2025-11-25
121
dineshsoudagar/local-llms-on-android

Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.

dineshsoudagar
โญ 501 Kotlin ๐Ÿ‘ค dineshsoudagar User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-05-04
122
withcatai/catai

Run an AI โœจ assistant locally! with a simple API for Node.js ๐Ÿš€

withcatai
โญ 500 TypeScript ๐Ÿ‘ค withcatai Organization ๐Ÿ• Updated 2025-11-16 ๐Ÿ“… Created 2023-03-25