#local-llm Repositories
122 repositories total
Local, OpenAI-compatible text-to-speech (TTS) API using Chatterbox, enabling users to generate voice cloned speech anywhere the OpenAI API is used (e.g. Open WebUI, AnythingLLM, etc.)
A completely private and local AI coding assistant, developed by Gensyn. It helps you practice programming problems and train a novel assistant to help you code.
Fully open-source command-line AI assistant inspired by OpenAI Codex, supporting local language models.
Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16โ64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.
Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.
Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source
a magical LLM desktop client that makes it easy for *anyone* to use LLMs and MCP
Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full web desktop + app store, and auto-clustering across the consumer hardware you already have (Orange/Raspberry Pi, Mac mini, gaming PC).
100% free, open-source personal agents for your messaging apps, tools, and services
AI-powered IDE for novel writing โ local LLM + RAG, privacy-first, BYOK. For web fiction authors and creative writers.
Open-source, self-hosted AI agent platform for your company's AI teammates. Build, run and govern agents on your own servers and models: shared chat, RAG, skills, a real browser, 4,700+ MCP servers, budgets, approvals and an audit trail. An alternative to ChatGPT Enterprise and Grok Bot. Apache-2.0, built on Pydantic AI.
A curated solutions to building a self-evolving second brain that helps AI agents understand your personal and team context.
It won't fix your bug. It'll fix you. The debugger that hands the question back instead of the answer.
Local AI chat for iPhone, iPad and Mac. Connect Ollama, LM Studio or any OpenAI-compatible server, or run MLX models on-device. Includes tools and web search.
An easier way to use AI on your own computer. A free, open-source alternative to Claude and ChatGPT that runs open-weight models like Gemma and gpt-oss locally on Mac, Windows and Linux. Private, and works offline.
Xolotl: run DeepSeek-V4.1-Flash, all 552B parameters, as a local coding agent on one gaming PC (RTX 4090 + 110 GB RAM): ~33 tok/s agent, ~41 fast, 512K context. Plus Inkling-2-Mini (Thinking Machines, own engine + MTP drafter), GLM-5.3-Flash, Qwen3.8, LFM3-Omni. MoE experts tiered across VRAM, RAM, and NVMe (Xolotl Direct). OpenAI + Anthropic API.
A local-first, full-stack AI creative workstation: five modulesโAI chat, AI comics, comic drama creation, writing desk, and knowledge learning; multi-engine local inference with vLLM / llama.cpp / Transformers, intelligent VRAM scheduling, bulkhead isolation and self-healing. For learning purposes only; feedback and discussion are welcome. (The latest progress, excluding the plugin system, cannot currently be committed to the repository due to protocol restrictions.)
Local-first AI-powered document intelligence platform for investigative journalism
Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.