#llm Repositories
2,314 repositories total
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Run GLM-5.3 (744B), DeepSeek-V4.1-Flash (748B), MiniMax-M3.1-Flash (428B), GLM-5.3-Flash (321B), and Hy4-Flash (220B) on your own GPUs โ starting from 8 GB of VRAM, with NVIDIA and AMD support, one dashboard, and an OpenAI- and Anthropic-compatible API.
Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.
QuantMind is an open source agent-native knowledge extraction and retrieval framework for quantitative finance.
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
OpenLake is a high performance storage engine for efficient LLM inference and GPU Training
Universal memory layer for AI Agents. It provides scalable, extensible, and interoperable memory storage and retrieval to streamline AI agent state management for next-generation autonomous systems.
๐ Let AI read and write Korean official documents. Convert HWP, HWPX, PDF, Office files, and scanned images to Markdownโand Markdown back to official HWPX documents. Fill in forms, compare old and new versions, and edit while preserving formatting. Library, CLI, and MCP server | Korean documents for AI: HWP, HWPX, PDF, Office files, and scans to Markdown, and Markdown back to HWPX. Library, CLI, and MCP server.
A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally
A minimal yet professional single agent demo project that showcases the core execution pipeline and production-grade features of agents.
An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.
Multi-framework streaming Markdown renderers for AI apps: Vue/Nuxt, React/Next.js, Octane, SolidJS, Svelte, Angular, and Vue 2. Mermaid, KaTeX, streaming code blocks, SSR, and virtualized histories.
Open-source desktop AI agent for tools, files, knowledge, workflows, and real deliverables.
Covers pre-training data, Tokenizers, Transformers, MoE, distributed training, scaling laws, inference, and alignment. 6 progressive coding assignments for full-stack LLM learning.
Enhances Tesseract OCR output using LLMs (local or API) for error correction, smart chunking, and markdown formatting of scanned PDFs
Assemble, configure, and deploy autonomous AI Agents in your browser. One-click deploy your private AutoGPT web app for free.
High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
A new SOTA for RAG โ an original retrieval architecture and an open-source knowledge base for humans and agents.
Turn one topic into a finished Vox-style paper-collage explainer/ad video โ automated end to end on Atlas Cloud + ffmpeg. An agent skill.
AI-powered cross-platform e-book reader with semantic search, RAG chat, local vector store, notes, TTS, and WebDAV sync.
A cross-platform video structuring (video analysis) framework based on CV models & mLLM.
AudioMuse-AI uses sonic analysis to rediscover forgotten songs, uncover hidden connections in your music library, and generate intelligent playlists for Navidrome, Jellyfin, LMS, Lyrion, Emby and Plex: no metadata or external services required.
Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
A secure persistent personal agent server in Rust. One binary, sandboxed execution, multi-provider LLMs, voice, memory, Telegram, WhatsApp, Discord, Teams, and MCP tools. Secure by design, runs on your hardware.
In-browser Postgres sandbox with AI assistance (formerly postgres.new)
๐ฆ OpenClaw & Hermes Agent Multi-Engine AI Management Panel โ Built-in AI Assistant (Tool Calling + Image Recognition + Multimodal), One-Click Install | Tauri v2 Cross-Platform Desktop App | 11 Languages
Model-agnostic agent-skills platform with a harness-free canonical layer, verified adapters, and the ccpi package manager. Explore at tonsofskills.com.
InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
Beautiful git diff viewer, generate commits with AI, get summary of changes, all from the CLI
Open-source personal agent with its own computer. It chases invoices, preps your calls, and cancels trials on real websitesโand asks before it acts. Runs on your machine with the model you choose. By n8n.
Formal verification for AI: a Lean 4 + Dafny proof checker that catches fake AI proofs (reward hacking), and verified recursive self-improvement (RSI) for coding agents. AI for math, physics and software engineering.
Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.
[Up-to-date] Large Language Model Agent: A Survey on Methodology, Applications and Challenges
Gentle Shell is a Pi-native workspace for AI-assisted development, bringing parallel coding agents, live tasks, Git diffs, persistent memory, and permission controls into one terminal interface. Powered by Gentle AI and Organic Driven Development (ODD).
Symbol-level code retrieval for AI agents: fetch the function you need, not the whole file. Runs locally. 96.2% fewer tokens per lookup on average than grep-and-read on our 15-lookup benchmark. Works with Claude Code, Cursor, Codex, and any MCP client. Free for non-commercial use; commercial use requires a one-time license.
Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
Use LLMs and LLM Vision (OCR) to handle paperless-ngx - Document Digitalization powered by AI