Git Stars Git Stars

#llamacpp Repositories

Discover 49 active open source GitHub repositories tagged with #llamacpp, accumulating 215,151 total stars (averaging 4,390 stars per project). Leading this topic is janhq/jan with 45,982 stars.

49
Total Repositories
215,151
Total Stars
4,390
Avg Stars/Repo
1
janhq/jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

janhq
โญ 45,982 Rust ๐Ÿ‘ค janhq Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-08-17
2
khoj-ai/khoj

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

khoj-ai
โญ 38,195 Python ๐Ÿ‘ค khoj-ai Organization ๐Ÿ• Updated 2026-08-02 ๐Ÿ“… Created 2021-08-16
3
llmware-ai/llmware

Unified framework for building enterprise RAG pipelines with small, specialized models

llmware-ai
โญ 14,820 Python ๐Ÿ‘ค llmware-ai Organization ๐Ÿ• Updated 2026-10-01 ๐Ÿ“… Created 2023-09-29
4
getumbrel/llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

getumbrel
โญ 10,990 TypeScript ๐Ÿ‘ค getumbrel Organization ๐Ÿ• Updated 2024-04-23 ๐Ÿ“… Created 2023-07-22
5
RunanywhereAI/runanywhere-sdks

Production ready toolkit to run AI locally

RunanywhereAI
โญ 10,354 C++ ๐Ÿ‘ค RunanywhereAI Organization ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2025-07-22
6
xorbitsai/inference

Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

xorbitsai
โญ 9,667 Python ๐Ÿ‘ค xorbitsai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-06-14
7
reorproject/reor

Private & local AI personal knowledge management app for high entropy people.

reorproject
โญ 8,533 JavaScript ๐Ÿ‘ค reorproject Organization ๐Ÿ• Updated 2025-05-13 ๐Ÿ“… Created 2023-11-27
8
cactus-compute/engine

2-bit quantization, kernels, and runtime for consumer devices.

cactus-compute
โญ 6,200 C++ ๐Ÿ‘ค cactus-compute Organization ๐Ÿ• Updated 2026-11-05 ๐Ÿ“… Created 2025-04-23
9
Michael-A-Kuykendall/shimmy

โšก Pure-Rust WebGPU inference engine โ€” OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Michael-A-Kuykendall
โญ 6,020 Rust ๐Ÿ‘ค Michael-A-Kuykendall User ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2025-08-28
10
serge-chat/serge

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

serge-chat
โญ 5,720 Svelte ๐Ÿ‘ค serge-chat Organization ๐Ÿ• Updated 2025-11-21 ๐Ÿ“… Created 2023-03-19
11
JohnSnowLabs/spark-nlp

State of the Art Natural Language Processing

JohnSnowLabs
โญ 4,162 Scala ๐Ÿ‘ค JohnSnowLabs Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2017-09-24
12
SciSharp/LLamaSharp

A C#/.NET library to run LLM (๐Ÿฆ™LLaMA/LLaVA) on your local device efficiently.

SciSharp
โญ 3,826 C# ๐Ÿ‘ค SciSharp Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-05-09
13
twinnydotdev/twinny

Open-source AI coding assistant for VS Code. Coding agent, code completion, chat, edits and reviews with local or hosted models. Your models, your infrastructure.

twinnydotdev
โญ 3,703 TypeScript ๐Ÿ‘ค twinnydotdev Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-08-21
โญ 3,537 Shell ๐Ÿ‘ค PrismML-Eng Organization ๐Ÿ• Updated 2026-11-05 ๐Ÿ“… Created 2026-03-25
15
Josh-XT/AGiXT

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

Josh-XT
โญ 3,214 Python ๐Ÿ‘ค Josh-XT User ๐Ÿ• Updated 2026-07-28 ๐Ÿ“… Created 2023-04-17
16
SilasMarvin/lsp-ai

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

SilasMarvin
โญ 3,182 Rust ๐Ÿ‘ค SilasMarvin User ๐Ÿ• Updated 2025-01-07 ๐Ÿ“… Created 2023-11-24
17
containers/ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

containers
โญ 3,116 Python ๐Ÿ‘ค containers Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2024-07-24
18
floneum/kalosm

Instant, controllable, local pre-trained AI models in Rust

floneum
โญ 2,236 Rust ๐Ÿ‘ค floneum Organization ๐Ÿ• Updated 2026-10-24 ๐Ÿ“… Created 2023-05-24
19
AtomicBot-ai/Atomic-Chat

Local AI app and inference engine for agents. Run open-weight LLMs locally โ€” private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

AtomicBot-ai
โญ 2,040 TypeScript ๐Ÿ‘ค AtomicBot-ai Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-03-31
20
sybil-solutions/local-studio

Control panel for VLLM, Sglang, llama.cpp, exllamav3

sybil-solutions
โญ 1,854 TypeScript ๐Ÿ‘ค sybil-solutions Organization ๐Ÿ• Updated 2026-10-26 ๐Ÿ“… Created 2025-12-17
21
alexpinel/Dot

Text-To-Speech, RAG, and LLMs. All local!

alexpinel
โญ 1,848 JavaScript ๐Ÿ‘ค alexpinel User ๐Ÿ• Updated 2024-12-09 ๐Ÿ“… Created 2024-03-15
22
intentee/paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale ๐Ÿ“๐Ÿฆ™ Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

intentee
โญ 1,694 Rust ๐Ÿ‘ค intentee Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2024-04-27
23
alexrozanski/LlamaChat

Chat with your favourite LLaMA models in a native macOS app

alexrozanski
โญ 1,502 Swift ๐Ÿ‘ค alexrozanski User ๐Ÿ• Updated 2026-06-17 ๐Ÿ“… Created 2023-03-26
24
jofizcd/Soul-of-Waifu

๐ŸŒŒ Give a soul to your favorite characters. Soul of Waifu is a desktop roleplay & AI companion app featuring Live2D/VRM avatars, voice chat & local LLM. Evolve together across immersive chat, RPG adventures, and your desktop.

jofizcd
โญ 1,474 Python ๐Ÿ‘ค jofizcd User ๐Ÿ• Updated 2026-08-28 ๐Ÿ“… Created 2023-09-02
25
benman1/generative_ai_with_langchain

Build production-ready LLM applications and advanced agents using Python, LangChain, and LangGraph. This is the companion repository for the book on generative AI with LangChain.

benman1
โญ 1,460 Jupyter Notebook ๐Ÿ‘ค benman1 User ๐Ÿ• Updated 2026-09-26 ๐Ÿ“… Created 2023-07-11
26
awaescher/OllamaSharp

The easiest way to use Ollama in .NET

awaescher
โญ 1,416 C# ๐Ÿ‘ค awaescher User ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2023-10-15
27
ngxson/wllama

WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

ngxson
โญ 1,400 TypeScript ๐Ÿ‘ค ngxson User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-03-13
28
RahulSChand/gpu_poor

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

RahulSChand
โญ 1,383 JavaScript ๐Ÿ‘ค RahulSChand User ๐Ÿ• Updated 2024-12-03 ๐Ÿ“… Created 2023-09-12
29
vercel/modelfusion

The TypeScript library for building AI applications.

vercel
โญ 1,307 TypeScript ๐Ÿ‘ค vercel Organization ๐Ÿ• Updated 2024-07-19 ๐Ÿ“… Created 2023-05-25
30
Dicklesworthstone/swiss_army_llama

A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.

Dicklesworthstone
โญ 1,053 Python ๐Ÿ‘ค Dicklesworthstone User ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2023-08-08
31
jegly/Box

The most advanced, fully offline client-side AI suite on Android today.

jegly
โญ 1,035 Kotlin ๐Ÿ‘ค jegly User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-17
32
XHToken/Spark-X2.6

Spark-x2.6 open model series. Pushing the Limits of Agentic Capabilities in On-Device Models

XHToken
โญ 927 ๐Ÿ‘ค XHToken Organization ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2026-08-24
33
shubham0204/SmolChat-Android

Running any GGUF SLMs/LLMs locally, on-device in Android

shubham0204
โญ 915 Kotlin ๐Ÿ‘ค shubham0204 User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2024-11-10
34
huggingface/llm-ls

LSP server leveraging LLMs for code completion (and more?)

huggingface
โญ 887 Rust ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-09-23 ๐Ÿ“… Created 2023-08-10
35
dvgodoy/FineTuningLLMs

Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"

dvgodoy
โญ 878 Jupyter Notebook ๐Ÿ‘ค dvgodoy User ๐Ÿ• Updated 2026-02-28 ๐Ÿ“… Created 2024-08-15
36
varunvasudeva1/llm-server-docs

End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.

varunvasudeva1
โญ 853 ๐Ÿ‘ค varunvasudeva1 User ๐Ÿ• Updated 2026-06-30 ๐Ÿ“… Created 2024-03-26
37
mukel/llama3.java

Llama 3+ inference in pure Java

mukel
โญ 818 Java ๐Ÿ‘ค mukel User ๐Ÿ• Updated 2026-04-24 ๐Ÿ“… Created 2024-04-25
38
pythops/tenere

๐Ÿค– TUI for LLMs

pythops
โญ 685 Rust ๐Ÿ‘ค pythops User ๐Ÿ• Updated 2026-05-10 ๐Ÿ“… Created 2023-04-05
39
hybridgroup/yzma

Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

hybridgroup
โญ 677 Go ๐Ÿ‘ค hybridgroup Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2025-09-21
40
Maximilian-Winter/llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

Maximilian-Winter
โญ 663 Python ๐Ÿ‘ค Maximilian-Winter User ๐Ÿ• Updated 2026-03-09 ๐Ÿ“… Created 2023-12-29
41
Fast-Editor/Lynkr

Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.

Fast-Editor
โญ 642 JavaScript ๐Ÿ‘ค Fast-Editor Organization ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2025-12-03
42
andrewkchan/yalm

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

andrewkchan
โญ 597 C++ ๐Ÿ‘ค andrewkchan User ๐Ÿ• Updated 2025-09-13 ๐Ÿ“… Created 2024-10-02
43
xNul/code-llama-for-vscode

Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.

xNul
โญ 569 Python ๐Ÿ‘ค xNul User ๐Ÿ• Updated 2024-07-31 ๐Ÿ“… Created 2023-08-25
44
kelindar/search

Go library for embedded vector search and semantic embeddings using llama.cpp

kelindar
โญ 561 Go ๐Ÿ‘ค kelindar User ๐Ÿ• Updated 2026-09-19 ๐Ÿ“… Created 2024-09-29
45
yassa9/qwen600

Static suckless single batch CUDA-only qwen3-0.6B mini inference engine

yassa9
โญ 559 Cuda ๐Ÿ‘ค yassa9 User ๐Ÿ• Updated 2025-09-08 ๐Ÿ“… Created 2025-09-06
46
xybrid-ai/xybrid

Cross-platform on-device AI toolkit

xybrid-ai
โญ 527 Rust ๐Ÿ‘ค xybrid-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-12-13
47
moxin-org/Moxin-LLM

Moxin is a family of fully open-source and reproducible LLMs

moxin-org
โญ 526 Python ๐Ÿ‘ค moxin-org Organization ๐Ÿ• Updated 2025-07-02 ๐Ÿ“… Created 2024-12-03
48
QwenLM/QwQ

QwQ is the reasoning model series developed by Qwen team, Alibaba Cloud.

QwenLM
โญ 516 Python ๐Ÿ‘ค QwenLM Organization ๐Ÿ• Updated 2025-03-27 ๐Ÿ“… Created 2025-03-11
49
BrowserOperator/browser-operator-core

Browser Operator - The AI browser with a built-in multi-agent platform! An open-source alternative to ChatGPT Atlas, Perplexity Comet, Dia, and Microsoft Copilot Edge Browser

BrowserOperator
โญ 514 TypeScript ๐Ÿ‘ค BrowserOperator Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2025-05-10

Frequently Asked Questions

1

What is the most popular #llamacpp repository on GitHub?

The top ranked open source #llamacpp project on GitHub is janhq/jan with 45,982 stars. Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

2

Which programming languages are most used in #llamacpp repositories?

Among the top ranked #llamacpp projects on GitHub, the most common programming languages are Python, Rust, TypeScript, JavaScript.

3

How is the #llamacpp repository ranking calculated?

We track 49 active open source repositories tagged with #llamacpp (500+ stars), totaling 215,151 stars with an average of 4,390 stars per repository. Rankings update daily from the GitHub API.