Git Stars Git Stars

#llm Repositories

2,308
Total Repositories
14.8M
Total Stars
6,391
Avg Stars/Repo

2,314 repositories total

701
b4rtaz/distributed-llama

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

b4rtaz
โญ 3,141 C++ ๐Ÿ‘ค b4rtaz User ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2023-12-04
702
mw00/project-maya

Run GLM-5.3 (744B), DeepSeek-V4.1-Flash (748B), MiniMax-M3.1-Flash (428B), GLM-5.3-Flash (321B), and Hy4-Flash (220B) on your own GPUs โ€” starting from 8 GB of VRAM, with NVIDIA and AMD support, one dashboard, and an OpenAI- and Anthropic-compatible API.

mw00
โญ 3,140 C++ ๐Ÿ‘ค mw00 User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-10-06
703
itsdecodingai/second-brain-ai-assistant-course

Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.

itsdecodingai
โญ 3,138 Jupyter Notebook ๐Ÿ‘ค itsdecodingai Organization ๐Ÿ• Updated 2026-04-06 ๐Ÿ“… Created 2024-12-30
704
LLMQuant/quant-mind

QuantMind is an open source agent-native knowledge extraction and retrieval framework for quantitative finance.

LLMQuant
โญ 3,137 Python ๐Ÿ‘ค LLMQuant Organization ๐Ÿ• Updated 2026-08-15 ๐Ÿ“… Created 2025-03-14
705
vllm-project/vllm-ascend

Community maintained hardware plugin for vLLM on Huawei Ascend

vllm-project
โญ 3,128 Python ๐Ÿ‘ค vllm-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-01-29
706
containers/ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

containers
โญ 3,116 Python ๐Ÿ‘ค containers Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2024-07-24
707
ridgerchu/matmulfreellm

Implementation for MatMul-free LM.

ridgerchu
โญ 3,102 Python ๐Ÿ‘ค ridgerchu User ๐Ÿ• Updated 2026-09-06 ๐Ÿ“… Created 2024-04-23
708
cheshire-cat-ai/core

AI agent microservice

cheshire-cat-ai
โญ 3,095 Python ๐Ÿ‘ค cheshire-cat-ai Organization ๐Ÿ• Updated 2026-07-29 ๐Ÿ“… Created 2023-02-08
709
openlake-project/openlake

OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

openlake-project
โญ 3,089 Rust ๐Ÿ‘ค openlake-project Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-04-27
710
MemMachine/MemMachine

Universal memory layer for AI Agents. It provides scalable, extensible, and interoperable memory storage and retrieval to streamline AI agent state management for next-generation autonomous systems.

MemMachine
โญ 3,089 Python ๐Ÿ‘ค MemMachine Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-08-15
711
run-llama/LlamaIndexTS

Data framework for your LLM applications. Focus on server side solution

run-llama
โญ 3,081 TypeScript ๐Ÿ‘ค run-llama Organization ๐Ÿ• Updated 2026-03-11 ๐Ÿ“… Created 2023-06-13
712
chrisryugj/kordoc

๐Ÿ“„ Let AI read and write Korean official documents. Convert HWP, HWPX, PDF, Office files, and scanned images to Markdownโ€”and Markdown back to official HWPX documents. Fill in forms, compare old and new versions, and edit while preserving formatting. Library, CLI, and MCP server | Korean documents for AI: HWP, HWPX, PDF, Office files, and scans to Markdown, and Markdown back to HWPX. Library, CLI, and MCP server.

chrisryugj
โญ 3,079 TypeScript ๐Ÿ‘ค chrisryugj User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-03-28
713
rafska/awesome-local-llm

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

rafska
โญ 3,079 ๐Ÿ‘ค rafska User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2025-06-03
714
MiniMax-AI/Mini-Agent

A minimal yet professional single agent demo project that showcases the core execution pipeline and production-grade features of agents.

MiniMax-AI
โญ 3,078 Python ๐Ÿ‘ค MiniMax-AI Organization ๐Ÿ• Updated 2026-02-14 ๐Ÿ“… Created 2025-10-31
715
QiuYannnn/Local-File-Organizer

An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.

QiuYannnn
โญ 3,069 Python ๐Ÿ‘ค QiuYannnn User ๐Ÿ• Updated 2024-10-21 ๐Ÿ“… Created 2024-09-21
716
Simon-He95/markstream-vue

Multi-framework streaming Markdown renderers for AI apps: Vue/Nuxt, React/Next.js, Octane, SolidJS, Svelte, Angular, and Vue 2. Mermaid, KaTeX, streaming code blocks, SSR, and virtualized histories.

Simon-He95
โญ 3,058 Vue ๐Ÿ‘ค Simon-He95 User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-05-22
717
pinecone-io/examples

Jupyter Notebooks to help you get hands-on with Pinecone vector databases

pinecone-io
โญ 3,047 Jupyter Notebook ๐Ÿ‘ค pinecone-io Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2021-03-09
718
Pinvou/pinvou-agent

Open-source desktop AI agent for tools, files, knowledge, workflows, and real deliverables.

Pinvou
โญ 3,043 Rust ๐Ÿ‘ค Pinvou Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-07-24
719
vercel-labs/opensrc

Fetch source code for npm packages to give AI coding agents deeper context

vercel-labs
โญ 3,040 Rust ๐Ÿ‘ค vercel-labs Organization ๐Ÿ• Updated 2026-09-16 ๐Ÿ“… Created 2026-01-06
720
datawhalechina/diy-llm

Covers pre-training data, Tokenizers, Transformers, MoE, distributed training, scaling laws, inference, and alignment. 6 progressive coding assignments for full-stack LLM learning.

datawhalechina
โญ 3,035 Jupyter Notebook ๐Ÿ‘ค datawhalechina Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-11-24
721
zinja-coder/jadx-ai-mcp

Plugin for JADX to integrate MCP server

zinja-coder
โญ 3,023 Java ๐Ÿ‘ค zinja-coder User ๐Ÿ• Updated 2026-10-19 ๐Ÿ“… Created 2025-04-07
722
Dicklesworthstone/llm_aided_ocr

Enhances Tesseract OCR output using LLMs (local or API) for error correction, smart chunking, and markdown formatting of scanned PDFs

Dicklesworthstone
โญ 3,012 Python ๐Ÿ‘ค Dicklesworthstone User ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2023-07-26
723
ElricLiu/AutoGPT-Next-Web

Assemble, configure, and deploy autonomous AI Agents in your browser. One-click deploy your private AutoGPT web app for free.

ElricLiu
โญ 3,006 TypeScript ๐Ÿ‘ค ElricLiu User ๐Ÿ• Updated 2025-02-10 ๐Ÿ“… Created 2023-04-15
724
thu-pacman/chitu

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

thu-pacman
โญ 3,005 Python ๐Ÿ‘ค thu-pacman Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-02-20
725
Zleap-AI/SAG

A new SOTA for RAG โ€” an original retrieval architecture and an open-source knowledge base for humans and agents.

Zleap-AI
โญ 3,004 Python ๐Ÿ‘ค Zleap-AI Organization ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2025-11-07
726
Alisa0808/vox-director

Turn one topic into a finished Vox-style paper-collage explainer/ad video โ€” automated end to end on Atlas Cloud + ffmpeg. An agent skill.

Alisa0808
โญ 2,999 Python ๐Ÿ‘ค Alisa0808 User ๐Ÿ• Updated 2026-10-05 ๐Ÿ“… Created 2026-07-10
727
codedogQBY/ReadAny

AI-powered cross-platform e-book reader with semantic search, RAG chat, local vector store, notes, TTS, and WebDAV sync.

codedogQBY
โญ 2,994 TypeScript ๐Ÿ‘ค codedogQBY User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-02-25
728
sherlockchou86/VideoPipe

A cross-platform video structuring (video analysis) framework based on CV models & mLLM.

sherlockchou86
โญ 2,994 C++ ๐Ÿ‘ค sherlockchou86 User ๐Ÿ• Updated 2026-02-25 ๐Ÿ“… Created 2022-08-26
729
NeptuneHub/AudioMuse-AI

AudioMuse-AI uses sonic analysis to rediscover forgotten songs, uncover hidden connections in your music library, and generate intelligent playlists for Navidrome, Jellyfin, LMS, Lyrion, Emby and Plex: no metadata or external services required.

NeptuneHub
โญ 2,988 Python ๐Ÿ‘ค NeptuneHub User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-05-24
730
michaelfeil/infinity

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

michaelfeil
โญ 2,988 C++ ๐Ÿ‘ค michaelfeil User ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2023-10-11
731
ax-llm/ax

The pretty much "official" DSPy framework for Typescript

ax-llm
โญ 2,987 TypeScript ๐Ÿ‘ค ax-llm Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-02-23
732
moltis-org/moltis

A secure persistent personal agent server in Rust. One binary, sandboxed execution, multi-provider LLMs, voice, memory, Telegram, WhatsApp, Discord, Teams, and MCP tools. Secure by design, runs on your hardware.

moltis-org
โญ 2,978 Rust ๐Ÿ‘ค moltis-org Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2026-01-29
733
ashishpatel26/LLM-Finetuning

LLM Finetuning with peft

ashishpatel26
โญ 2,970 Jupyter Notebook ๐Ÿ‘ค ashishpatel26 User ๐Ÿ• Updated 2025-08-01 ๐Ÿ“… Created 2023-06-08
734
OpenMind/OM1

Modular AI HAL (Hardware Abstraction Layer) for Robots

OpenMind
โญ 2,967 Go ๐Ÿ‘ค OpenMind Organization ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2025-01-08
735
supabase-community/database-build

In-browser Postgres sandbox with AI assistance (formerly postgres.new)

supabase-community
โญ 2,948 TypeScript ๐Ÿ‘ค supabase-community Organization ๐Ÿ• Updated 2026-06-03 ๐Ÿ“… Created 2024-07-22
736
lightseekorg/tokenspeed

TokenSpeed is a speed-of-light LLM inference engine.

lightseekorg
โญ 2,944 Python ๐Ÿ‘ค lightseekorg Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-05-06
737
gmpetrov/databerry

The no-code platform for building custom LLM Agents

gmpetrov
โญ 2,942 ๐Ÿ‘ค gmpetrov User ๐Ÿ• Updated 2024-06-17 ๐Ÿ“… Created 2023-03-27
738
qingchencloud/clawpanel

๐Ÿฆž OpenClaw & Hermes Agent Multi-Engine AI Management Panel โ€” Built-in AI Assistant (Tool Calling + Image Recognition + Multimodal), One-Click Install | Tauri v2 Cross-Platform Desktop App | 11 Languages

qingchencloud
โญ 2,936 JavaScript ๐Ÿ‘ค qingchencloud Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2026-02-26
739
jeremylongshore/tons-of-skills-marketplace

Model-agnostic agent-skills platform with a harness-free canonical layer, verified adapters, and the ccpi package manager. Explore at tonsofskills.com.

jeremylongshore
โญ 2,935 Python ๐Ÿ‘ค jeremylongshore User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-10-10
740
InternLM/InternLM-XComposer

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

InternLM
โญ 2,925 Python ๐Ÿ‘ค InternLM Organization ๐Ÿ• Updated 2025-05-26 ๐Ÿ“… Created 2023-09-26
741
jnsahaj/lumen

Beautiful git diff viewer, generate commits with AI, get summary of changes, all from the CLI

jnsahaj
โญ 2,924 Rust ๐Ÿ‘ค jnsahaj User ๐Ÿ• Updated 2026-09-17 ๐Ÿ“… Created 2024-10-28
742
n8n-io/nod

Open-source personal agent with its own computer. It chases invoices, preps your calls, and cancels trials on real websitesโ€”and asks before it acts. Runs on your machine with the model you choose. By n8n.

n8n-io
โญ 2,920 TypeScript ๐Ÿ‘ค n8n-io Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-09-25
743
sahibzada-allahyar/Formal-Verification-RSI

Formal verification for AI: a Lean 4 + Dafny proof checker that catches fake AI proofs (reward hacking), and verified recursive self-improvement (RSI) for coding agents. AI for math, physics and software engineering.

sahibzada-allahyar
โญ 2,910 Python ๐Ÿ‘ค sahibzada-allahyar User ๐Ÿ• Updated 2026-10-22 ๐Ÿ“… Created 2025-02-22
744
xzf-thu/VoiceMem

Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.

xzf-thu
โญ 2,905 Python ๐Ÿ‘ค xzf-thu User ๐Ÿ• Updated 2026-09-14 ๐Ÿ“… Created 2026-08-17
745
microsoft/genaiscript

Automatable GenAI Scripting

microsoft
โญ 2,897 TypeScript ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-05-21 ๐Ÿ“… Created 2023-08-17
746
luo-junyu/Awesome-Agent-Papers

[Up-to-date] Large Language Model Agent: A Survey on Methodology, Applications and Challenges

luo-junyu
โญ 2,877 ๐Ÿ‘ค luo-junyu User ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2025-03-21
747
Gentleman-Programming/gentle-shell

Gentle Shell is a Pi-native workspace for AI-assisted development, bringing parallel coding agents, live tasks, Git diffs, persistent memory, and permission controls into one terminal interface. Powered by Gentle AI and Organic Driven Development (ODD).

Gentleman-Programming
โญ 2,864 TypeScript ๐Ÿ‘ค Gentleman-Programming Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-05-10
748
jgravelle/jcodemunch-mcp

Symbol-level code retrieval for AI agents: fetch the function you need, not the whole file. Runs locally. 96.2% fewer tokens per lookup on average than grep-and-read on our 15-lookup benchmark. Works with Claude Code, Cursor, Codex, and any MCP client. Free for non-commercial use; commercial use requires a one-time license.

jgravelle
โญ 2,856 Python ๐Ÿ‘ค jgravelle User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-09
749
spcl/graph-of-thoughts

Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"

spcl
โญ 2,848 Python ๐Ÿ‘ค spcl Organization ๐Ÿ• Updated 2026-03-24 ๐Ÿ“… Created 2023-08-18
750
icereed/paperless-gpt

Use LLMs and LLM Vision (OCR) to handle paperless-ngx - Document Digitalization powered by AI

icereed
โญ 2,847 Go ๐Ÿ‘ค icereed User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-09-23