#local-inference Repositories
Discover 19 active open source GitHub repositories tagged with #local-inference, accumulating 116,603 total stars (averaging 6,137 stars per project). Leading this topic is oobabooga/textgen with 47,736 stars.
19 repositories total
Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.
Mano-P: Open-source GUI-VLA agent for edge devices. #1 on OSWorld (specialized, 58.2%). Runs locally on Apple M4 Mac mini/MacBook โ no data leaves your device. Mano-P is an open-source GUI-VLA project that supports local inference on Mac mini/MacBook or via compute stick, enabling purely vision-driven cross-platform GUI automation operations. Data is processed entirely locally, supporting planning and execution of complex multi-step tasks.
CORTEX RAG is an enterprise retrieval and knowledge assistant that helps teams find accurate answers from company data with citations, permission-aware retrieval, and fast deployment.
Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 29 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/systemone. The TypeSafe SDK works unchanged: set its base URL and pick an open model. CLI, desktop app, Docker, MCP server, public bench.
Local models support for Microsoft's graphrag using ollama (llama3, mistral, gemma2 phi3)- LLM & Embedding extraction
Go With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stable-diffusion.cpp directly integrated into your Go applications. Kronk provides a high-level API and production ready model server.
Spotted seal โ Phocinae-Largha-150M-v1: a 144.3M bilingual decision model. Tiny model. Big decisions. Little seal, big decisions.
Tools, ComfyUI workflows and benchmark configs from a 4x RTX 3090 local-inference rig
Frequently Asked Questions
What is the most popular #local-inference repository on GitHub?
The top ranked open source #local-inference project on GitHub is oobabooga/textgen with 47,736 stars. Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.
Which programming languages are most used in #local-inference repositories?
Among the top ranked #local-inference projects on GitHub, the most common programming languages are Python, C++, TypeScript, Swift.
How is the #local-inference repository ranking calculated?
We track 19 active open source repositories tagged with #local-inference (500+ stars), totaling 116,603 stars with an average of 6,137 stars per repository. Rankings update daily from the GitHub API.