#llamacpp Repositories
Discover 49 active open source GitHub repositories tagged with #llamacpp, accumulating 215,151 total stars (averaging 4,390 stars per project). Leading this topic is janhq/jan with 45,982 stars.
49 repositories total
Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.
Unified framework for building enterprise RAG pipelines with small, specialized models
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
โก Pure-Rust WebGPU inference engine โ OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.
A C#/.NET library to run LLM (๐ฆLLaMA/LLaVA) on your local device efficiently.
Open-source AI coding assistant for VS Code. Coding agent, code completion, chat, edits and reviews with local or hosted models. Your models, your infrastructure.
AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.
LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
Local AI app and inference engine for agents. Run open-weight LLMs locally โ private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale ๐๐ฆ Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
๐ Give a soul to your favorite characters. Soul of Waifu is a desktop roleplay & AI companion app featuring Live2D/VRM avatars, voice chat & local LLM. Evolve together across immersive chat, RPG adventures, and your desktop.
Build production-ready LLM applications and advanced agents using Python, LangChain, and LangGraph. This is the companion repository for the book on generative AI with LangChain.
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.
Spark-x2.6 open model series. Pushing the Limits of Agentic Capabilities in On-Device Models
Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"
End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.
Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O
Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.
Browser Operator - The AI browser with a built-in multi-agent platform! An open-source alternative to ChatGPT Atlas, Perplexity Comet, Dia, and Microsoft Copilot Edge Browser
Frequently Asked Questions
What is the most popular #llamacpp repository on GitHub?
The top ranked open source #llamacpp project on GitHub is janhq/jan with 45,982 stars. Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
Which programming languages are most used in #llamacpp repositories?
Among the top ranked #llamacpp projects on GitHub, the most common programming languages are Python, Rust, TypeScript, JavaScript.
How is the #llamacpp repository ranking calculated?
We track 49 active open source repositories tagged with #llamacpp (500+ stars), totaling 215,151 stars with an average of 4,390 stars per repository. Rankings update daily from the GitHub API.