Git Stars Git Stars

#local-inference Repositories

Discover 19 active open source GitHub repositories tagged with #local-inference, accumulating 116,603 total stars (averaging 6,137 stars per project). Leading this topic is oobabooga/textgen with 47,736 stars.

19
Total Repositories
116,603
Total Stars
6,137
Avg Stars/Repo
1
oobabooga/textgen

Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

oobabooga
โญ 47,736 Python ๐Ÿ‘ค oobabooga User ๐Ÿ• Updated 2026-08-17 ๐Ÿ“… Created 2022-12-21
2
mozilla-ai/llamafile

Distribute and run LLMs with a single file.

mozilla-ai
โญ 26,681 C++ ๐Ÿ‘ค mozilla-ai Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2023-09-10
3
Tiiny-AI/PowerInfer

High-speed Large Language Model Serving for Local Deployment

Tiiny-AI
โญ 9,893 C++ ๐Ÿ‘ค Tiiny-AI Organization ๐Ÿ• Updated 2026-05-11 ๐Ÿ“… Created 2023-12-15
4
nat/openplayground

An LLM playground you can run on your laptop

nat
โญ 6,342 TypeScript ๐Ÿ‘ค nat User ๐Ÿ• Updated 2026-02-06 ๐Ÿ“… Created 2023-02-26
โญ 3,574 Python ๐Ÿ‘ค XiaoMi Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-11-06
6
linyiLYi/bilibot

A local chatbot fine-tuned by bilibili user comments.

linyiLYi
โญ 3,176 Python ๐Ÿ‘ค linyiLYi User ๐Ÿ• Updated 2024-05-15 ๐Ÿ“… Created 2024-05-06
7
Mininglamp-AI/Mano-P

Mano-P: Open-source GUI-VLA agent for edge devices. #1 on OSWorld (specialized, 58.2%). Runs locally on Apple M4 Mac mini/MacBook โ€” no data leaves your device. Mano-P is an open-source GUI-VLA project that supports local inference on Mac mini/MacBook or via compute stick, enabling purely vision-driven cross-platform GUI automation operations. Data is processed entirely locally, supporting planning and execution of complex multi-step tasks.

Mininglamp-AI
โญ 2,855 ๐Ÿ‘ค Mininglamp-AI Organization ๐Ÿ• Updated 2026-06-25 ๐Ÿ“… Created 2026-03-25
8
janhq/ichigo

Local realtime voice AI

janhq
โญ 2,493 Python ๐Ÿ‘ค janhq Organization ๐Ÿ• Updated 2025-11-26 ๐Ÿ“… Created 2024-07-02
9
mainframecomputer/fullmoon-ios

chat with private and local large language models

mainframecomputer
โญ 2,255 Swift ๐Ÿ‘ค mainframecomputer Organization ๐Ÿ• Updated 2025-05-05 ๐Ÿ“… Created 2024-10-09
10
SaiAkhil066/CORTEX-AI-SUPER-RAG

CORTEX RAG is an enterprise retrieval and knowledge assistant that helps teams find accurate answers from company data with citations, permission-aware retrieval, and fast deployment.

SaiAkhil066
โญ 1,980 Python ๐Ÿ‘ค SaiAkhil066 User ๐Ÿ• Updated 2026-09-28 ๐Ÿ“… Created 2025-01-30
11
browser-use/macOS-use

Make Mac apps accessible for AI agents

browser-use
โญ 1,948 Python ๐Ÿ‘ค browser-use Organization ๐Ÿ• Updated 2025-03-05 ๐Ÿ“… Created 2025-01-23
12
ollaya-dev/ollaya

Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 29 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/systemone. The TypeSafe SDK works unchanged: set its base URL and pick an open model. CLI, desktop app, Docker, MCP server, public bench.

ollaya-dev
โญ 1,473 Rust ๐Ÿ‘ค ollaya-dev Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-09-23
13
TheAiSingularity/graphrag-local-ollama

Local models support for Microsoft's graphrag using ollama (llama3, mistral, gemma2 phi3)- LLM & Embedding extraction

TheAiSingularity
โญ 1,111 Python ๐Ÿ‘ค TheAiSingularity User ๐Ÿ• Updated 2026-05-08 ๐Ÿ“… Created 2024-07-08
โญ 983 TypeScript ๐Ÿ‘ค hinterdupfinger User ๐Ÿ• Updated 2024-06-21 ๐Ÿ“… Created 2023-09-19
15
huggingface/meshgen

Use AI Agents directly in Blender.

huggingface
โญ 950 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-10-22 ๐Ÿ“… Created 2024-10-14
16
ardanlabs/kronk

Go With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stable-diffusion.cpp directly integrated into your Go applications. Kronk provides a high-level API and production ready model server.

ardanlabs
โญ 871 Go ๐Ÿ‘ค ardanlabs Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-11-18
17
ochyai/vibe-local

Free AI coding environment: Ollama + Python

ochyai
โญ 804 Python ๐Ÿ‘ค ochyai User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-22
18
Phocinae/Phocinae-Largha-150M-v1

Spotted seal โ€” Phocinae-Largha-150M-v1: a 144.3M bilingual decision model. Tiny model. Big decisions. Little seal, big decisions.

Phocinae
โญ 797 Python ๐Ÿ‘ค Phocinae Organization ๐Ÿ• Updated 2026-10-20 ๐Ÿ“… Created 2026-10-08
19
alesha-pro/tools

Tools, ComfyUI workflows and benchmark configs from a 4x RTX 3090 local-inference rig

alesha-pro
โญ 702 HTML ๐Ÿ‘ค alesha-pro User ๐Ÿ• Updated 2026-09-28 ๐Ÿ“… Created 2026-08-07

Frequently Asked Questions

1

What is the most popular #local-inference repository on GitHub?

The top ranked open source #local-inference project on GitHub is oobabooga/textgen with 47,736 stars. Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

2

Which programming languages are most used in #local-inference repositories?

Among the top ranked #local-inference projects on GitHub, the most common programming languages are Python, C++, TypeScript, Swift.

3

How is the #local-inference repository ranking calculated?

We track 19 active open source repositories tagged with #local-inference (500+ stars), totaling 116,603 stars with an average of 6,137 stars per repository. Rankings update daily from the GitHub API.