#llm Repositories
2,313 repositories total
๐ฅ Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generation ๐ฅ. Our toolkit integrates 40 pre-retrieved benchmark datasets and supports 7+ retrieval techniques, 24+ state-of-the-art Re-Ranking models, and multiple RAG methods.
An enterprise-grade AI agent platform offering comprehensive capabilities including intelligent dialogue, document-based knowledge Q&A, web search, RAG retrieval, the MCP tool protocol, and Skills extensions. It features a three-layer executor architecture, dual-channel hybrid retrieval, a composable chunking engine, conversation memory management, and full-stack observability. Every component has been deeply designed and rigorously refined through engineering.
A curated list of data science & AI guided projects to start building your portfolio
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, an iPhone app, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows, macOS, iOS, and Linux with full GPU capability.
โจReverse-engineered API for the Gemini web app. It can be used as a genuine API key for OpenAI, Gemini, and Claude.
Context compression for AI coding agents: compresses tool output before it enters the model, deduplicating repeats into 13-token references. Claude Code, Cursor, Codex, Kiro, Zed, and any MCP client. Rust, zero LLM calls.
Deploy langgenious/dify, an LLM based app on kubernetes with helm chart.
AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
๐พ OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
OpenChatBI is an intelligent chat-based BI tool powered by large language models, designed to help users query, analyze, and visualize data through natural language conversations. It uses LangGraph and LangChain to build chat agent and workflows that support natural language to SQL conversion and data analysis.
Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16โ64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
Flutter AI Skills and Rules for Claude, Codex, Cursor, and Other AI-Powered IDEs
Unified Go interface for Language Model (LLM) providers. Simplifies LLM integration with flexible prompt management and common task functions.
Scout: the open-source browser agent, by Outcrawl. Mirrored automatically from Outcrawl's own repository.
Official python implementation of UTCP. UTCP is an open standard that lets AI agents call any API directly, without extra middleware.
An AI-Powered README and Interactive Wiki Generator for Any Project. An AI-powered README and interactive Wiki generator for Chinese-language open-source DeepWiki.
Open-source AI interview assistant and meeting copilot: live answers during Zoom, Google Meet, and Teams calls, on-device transcription, hidden from screen sharing. A free alternative to Cluely, Interview Coder, and Final Round AI for Windows, macOS, and Linux.
On-device AI for Flutter โ Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.
AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.
A.S.E (AICGSecEval) is a repository-level AI-generated code security evaluation benchmark developed by Tencent Wukong Code Security Team.
[ICLR-2025-SLLM Spotlight ๐ฅ]MobiLlama : Small Language Model tailored for edge devices
AI Manus is a general-purpose AI agent system that supports running various tools and operations in a sandbox environment.
Source-available LLM router and AI cost optimizer. Routes simple prompts to cheap or local models and complex ones to premium models, automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor and OpenClaw. Self-hosted, no middleman.
DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference
AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.
Agent skill that steers the model away from its first, most average pick in creative work: names, ideas, logo, posters, UI.
Open-source AI Agent Customer Service Platform. Build AI agent teams with LLM orchestration, RAG knowledge base, multi-channel support, and human collaboration.
Use MCP and OpenAPI to safely control Proxmox VE VMs, LXCs, backups, and snapshots from LLMs and AI agents.
OpenMemory Chrome Extension: Long-term memory for ChatGPT, Claude, Perplexity, Grok etc
โจโจLatest Papers and Benchmarks in Reasoning with Foundation Models
The unofficial OpenAI SDK for Dart & Flutter. Full API coverage + OpenAI-compatible providers (Azure, DeepSeek, LM Studio, Ollama): Responses, Chat, Realtime, Videos, Batch, Fine-tuning.
AI Manus is a general-purpose AI Agent system that supports running various tools and operations in a sandbox environment.
Cell type annotation for single-cell RNA-seq using multi-LLM consensus
[ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
The main component of AI DIAL, which provides unified API to different chat completion and embedding models, assistants, and applications
Stanford CS329Z Engineering AI Agents Chinese tutorial: an AI agent course for Python developers, with 19 lectures and 4 hands-on projects, covering LLMs, RAG, tool calling, memory, multi-agent systems, evaluation, and safety. Complete Markdown, online and offline HTML. Chinese course notes.
Bilingual (Chinese + English) ML / LLM / diffusion / agent interview cheat sheets for AI autumn recruiting โ generated by ARIS /interview-cheatsheet, rendered by /render-html into single-file HTML that can be read anywhere โ plus a CVโDBLP fact-checked academic homepage generator and hand-authored long-form blogs ๐ฑ
Cut the tokens Claude Code loads at session start. A CLI that sets up a small CLAUDE.md with on-demand docs, measures startup tokens, and keeps them small.