Git Stars Git Stars

#llama-cpp Repositories

69
Total Repositories
212,421
Total Stars
3,078
Avg Stars/Repo
51
cobanov/PS5LM

llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8

cobanov
โญ 868 C++ ๐Ÿ‘ค cobanov User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-10-01
52
nace-ai/kapitsa

Blazing-fast Apple Silicon inference engine optimized for Qwen & Nemotron. Compatible with the OpenAI and Anthropic APIs. Built by the team at nace.ai

nace-ai
โญ 840 C++ ๐Ÿ‘ค nace-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-10-16
53
OrionStarAI/Orion

Orion-14B is a family of models includes a 14B foundation LLM, and a series of models: a chat model, a long context model, a quantized model, a RAG fine-tuned model, and an Agent fine-tuned model. The Orion-14B model series includes a 14 billion parameter multilingual foundation LLM and a series of related derivative models, including a chat model, a long context model, a quantized model, a RAG fine-tuned model, and an Agent fine-tuned model, etc.

OrionStarAI
โญ 801 Python ๐Ÿ‘ค OrionStarAI Organization ๐Ÿ• Updated 2024-06-03 ๐Ÿ“… Created 2024-01-17
55
timmyy123/LLM-Hub

Local LLM, image, video, and music generator

timmyy123
โญ 665 C ๐Ÿ‘ค timmyy123 User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2025-07-08
56
the-crypt-keeper/can-ai-code

Self-evaluating interview for AI coders

the-crypt-keeper
โญ 600 Python ๐Ÿ‘ค the-crypt-keeper User ๐Ÿ• Updated 2025-06-21 ๐Ÿ“… Created 2023-05-27
57
llmmanorg/llmman

Run any agent on any model, models stored as OCI images

llmmanorg
โญ 598 Rust ๐Ÿ‘ค llmmanorg Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-03-22
58
gokayfem/ComfyUI_VLM_nodes

ComfyUI nodes for vision-language models: Qwen3-VL, Moondream 3, Florence-2, SmolVLM2, InternVL, Gemma 3, MiniCPM-V. Plus open-vocabulary detection, SAM2/SAM3 segmentation, video temporal reasoning, GGUF via llama.cpp, and hosted LLM/VLM APIs.

gokayfem
โญ 592 Python ๐Ÿ‘ค gokayfem User ๐Ÿ• Updated 2026-08-08 ๐Ÿ“… Created 2024-01-24
59
WisdomShell/codeshell-vscode

An intelligent coding assistant plugin for Visual Studio Code, developed based on CodeShell

WisdomShell
โญ 579 TypeScript ๐Ÿ‘ค WisdomShell Organization ๐Ÿ• Updated 2024-05-09 ๐Ÿ“… Created 2023-10-19
60
oriveo/oriveo

Open-source, bring-your-own-key (BYOK) multi-model AI chat client for iOS, Android and the web. One LLM client for OpenAI, Anthropic, Google Gemini, OpenRouter, DeepSeek and ten more providers, plus any OpenAI-, Anthropic- or Gemini-compatible endpoint โ€” Ollama, LM Studio, llama.cpp, vLLM. Local-first, self-hostable, no account. AGPL-3.0.

oriveo
โญ 567 Swift ๐Ÿ‘ค oriveo Organization ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2026-09-03
61
spark-arena/sparkrun

sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems. Live support: https://discord.com/invite/GH5kRgv6ZD

spark-arena
โญ 567 Python ๐Ÿ‘ค spark-arena Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2026-02-16
62
FrigadeHQ/hob

An easier way to use AI on your own computer. A free, open-source alternative to Claude and ChatGPT that runs open-weight models like Gemma and gpt-oss locally on Mac, Windows and Linux. Private, and works offline.

FrigadeHQ
โญ 556 TypeScript ๐Ÿ‘ค FrigadeHQ Organization ๐Ÿ• Updated 2026-10-30 ๐Ÿ“… Created 2026-10-14
63
automataIA/graphrag-rs

GraphRAG-rs is a high-performance, state-of-the-art Rust implementation of GraphRAG (Graph-based Retrieval Augmented Generation) that builds knowledge graphs from documents and enables natural language querying with configurable entity extraction and local LLM integration

automataIA
โญ 541 Rust ๐Ÿ‘ค automataIA User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2025-09-21
64
Yzw202011/OmniSpace

A local-first, full-stack AI creative workstation: five modulesโ€”AI chat, AI comics, comic drama creation, writing desk, and knowledge learning; multi-engine local inference with vLLM / llama.cpp / Transformers, intelligent VRAM scheduling, bulkhead isolation and self-healing. For learning purposes only; feedback and discussion are welcome. (The latest progress, excluding the plugin system, cannot currently be committed to the repository due to protocol restrictions.)

Yzw202011
โญ 536 Python ๐Ÿ‘ค Yzw202011 User ๐Ÿ• Updated 2026-09-20 ๐Ÿ“… Created 2026-08-23
65
lucasjinreal/Crane

A pure Rust-based inference engine for LLMs, VLMs, VLAs, TTS, and OCR, powered by Candle and Rust. An alternative to llama.cpp that's much simpler and cleaner.

lucasjinreal
โญ 534 Rust ๐Ÿ‘ค lucasjinreal User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2025-03-19
66
wizardAEI/Gomoon

Gomoon, a large model-based desktop efficiency tool

wizardAEI
โญ 520 TypeScript ๐Ÿ‘ค wizardAEI User ๐Ÿ• Updated 2026-02-27 ๐Ÿ“… Created 2023-11-20
67
bofenghuang/vigogne

French instruction-following and chat models

bofenghuang
โญ 506 Jupyter Notebook ๐Ÿ‘ค bofenghuang User ๐Ÿ• Updated 2024-12-05 ๐Ÿ“… Created 2023-03-24
68
AudarAI/Audar-ASR-V1

Arabic-first generative speech recognition โ€” Audar-ASR-V1 (Flash + Turbo). #1 on the Open Universal Arabic ASR Leaderboard. Model cards, benchmarks & inference.

AudarAI
โญ 503 Python ๐Ÿ‘ค AudarAI Organization ๐Ÿ• Updated 2026-08-22 ๐Ÿ“… Created 2026-07-06
69
withcatai/catai

Run an AI โœจ assistant locally! with a simple API for Node.js ๐Ÿš€

withcatai
โญ 500 TypeScript ๐Ÿ‘ค withcatai Organization ๐Ÿ• Updated 2025-11-16 ๐Ÿ“… Created 2023-03-25