#local-ai Repositories
Discover 93 active open source GitHub repositories tagged with #local-ai, accumulating 386,204 total stars (averaging 4,152 stars per project). Leading this topic is Mintplex-Labs/anything-llm with 68,480 stars.
93 repositories total
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
Privacy-first AI meeting note taker for Windows, macOS and Linux. Free and open source (MIT). On-device Whisper/Parakeet transcription and speaker diarization, with no meeting bot. Open-source alternative to Granola, Otter and Fireflies. https://meetily.ai
YC (S26) | Screenpipe finds the work worth automating | Continuously record computer work locally, discover recurring workflows, and hand the result to any agent you already use.
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
PC voice input tool, offline recognition, high accuracy, low latency, supports hotwords and LLM polishing. Hold CapsLock or mouse side button X2 to speak, release to automatically display on screen.
Native MLX runtime for Laya typed decision models โ 7โ14 ms short decisions on M3 Max. No text generation, PyTorch, or cloud API.
โก Pure-Rust WebGPU inference engine โ OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
Use OCR in Windows quickly and easily with Text Grab. With optional background process and notifications.
The all-in-one local AI studio for your desktop: chat, image and video generation and a coding agent in one free, open source app. Windows and Linux. No Docker, no terminal, no cloud required.
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4ร faster than Apple's MLX (mlx-lm) on the same weights.
Open-source AI coding assistant for VS Code. Coding agent, code completion, chat, edits and reviews with local or hosted models. Your models, your infrastructure.
Hit your Claude Code usage limit? Keep going free and offline on a local model: Qwen 3.8, Gemma 4, and Qwen 4 the day it ships. Runs on Apple Silicon Macs (MLX), Linux and Windows (llama.cpp) with no API key. Your code stays home.
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac โ GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent โ watches, understands, remembers & guards your home via Telegram, Discord or Slack. Pluggable AI skills. OpenAI, Google, Anthropic or local AI. Runs on Mac Mini & AI PC.
A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally
Free, open-source file toolkit for PDFs, images, video and audio. Compress, convert, OCR, remove backgrounds and transcribe on your own server with one Docker command. 200+ tools, local AI, REST API. An alternative to iLovePDF, TinyWow, CloudConvert and remove.bg.
Private AI meeting notes that stay on your computer. No meeting bot. Free and open source for Mac, Windows and Linux. An alternative to Granola, Otter and Fireflies.
The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.
Local AI song generator with an editable score โ YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.
A 100% private and local AI assistant for your desktop. Always present, able to jump into conversations. Supports unlimited MCP tools and unlimited memory with self-learning. A free WisprFlow alternative with dictation support. Runs on macOS, Windows, and Linux.
Open-source local AI audio & music studio for macOS & Windows. TTS, voice cloning, songs with lyrics, and multi-track scores โ 100% offline, zero API fees.
Personal AI agent harness for macOS, Windows, Linux, Android & iOS. New: Skales Scout, persistent AI agents that keep working on your desktop, each optionally in its own virtual machine. Chat, coding (Skales Code), Flow, automations, computer use, browser, voice, MCP, local LLMs (Ollama). BYOK, 26 providers. No Docker, no terminal.
Local AI app and inference engine for agents. Run open-weight LLMs locally โ private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
๐ฆญ A cross-device desktop AI agent with memory, autonomous goals, dynamic workflows, and headless deployment | A cross-platform desktop AI assistant with memory, persistent goal pursuit, dynamic multi-agent orchestration, and the ability to run as a service continuously on a NAS or in the cloud
A privacy-preserving Raspberry Pi home security camera that uses advanced end-to-end encryption.
A cross-platform Flutter app that runs uncensored, 100% offline open-source AI models (GGUF) directly on your Android, iOS, or PC. No cloud, no filters, total privacy.
Free, open-source voice typing for macOS and Windows. Local speech-to-text with Whisper and Parakeet, also works offline.
Local Laya typed decisions on Apple Core ML and Neural Engine. Validated ports, ~5 ms short decisions on M3 Max, reproducible speed and energy benchmarks.
Nativ is an open-source local AI app for Mac. It runs open AI models on Apple Silicon, and nothing leaves your Mac.
Open-source AI computer builds, from 2-GPU desktops to 8-GPU servers: CAD, BOM, BIOS, and build guides. Get the case kit with PCIe risers, or ask us for a free fit check.
A local-first AI agent workspace for multi-agent collaboration, agent orchestration, scoped permissions, evidence-aware runs, and human-in-the-loop decisions.
A starter kit to build *local-only* AI apps that cost $0 to run -- starting with document Q&A. Written in Javascript
PhoneClaw turns phones into local AI agent runtimes with on-device models, native mobile Skills, LiveLand, and optional Mac Gateway inference.
Frequently Asked Questions
What is the most popular #local-ai repository on GitHub?
The top ranked open source #local-ai project on GitHub is Mintplex-Labs/anything-llm with 68,480 stars. Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
Which programming languages are most used in #local-ai repositories?
Among the top ranked #local-ai projects on GitHub, the most common programming languages are Python, TypeScript, Rust, JavaScript.
How is the #local-ai repository ranking calculated?
We track 93 active open source repositories tagged with #local-ai (500+ stars), totaling 386,204 stars with an average of 4,152 stars per repository. Rankings update daily from the GitHub API.