Git Stars Git Stars

#llmops Repositories

111
Total Repositories
716,901
Total Stars
6,458
Avg Stars/Repo
51
ianarawjo/ChainForge

An open-source visual programming environment for battle-testing prompts to LLMs.

ianarawjo
โญ 3,044 TypeScript ๐Ÿ‘ค ianarawjo User ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2023-03-26
52
OpenPipe/OpenPipe

Turn expensive prompts into cheap fine-tuned models

OpenPipe
โญ 2,763 TypeScript ๐Ÿ‘ค OpenPipe Organization ๐Ÿ• Updated 2024-05-25 ๐Ÿ“… Created 2023-06-20
53
apache/hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

apache
โญ 2,631 Jupyter Notebook ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-02-23
54
data-infra/cube-studio

CubeStudio is an open-source cloud-native one-stop machine learning/deep learning/large model AI platform/MaaS/MLOps/artificial intelligence platform/training and inference platform, covering the full algorithm pipeline, multi-tenancy, computing power leasing platform, token relay, drag-and-drop task flow pipeline orchestration, multi-machine multi-card distributed training, hyperparameter search, inference services, VGPU virtualization, cloud-edge-device collaboration, edge computing, automated annotation platform, SFT fine-tuning/reward model/reinforcement learning training for large models like DeepSeek, multi-machine inference for large models with vLLM/Ollama/MindIE, private knowledge base LLMOps intelligent agents, AI model marketplace, support for domestic heterogeneous computing power scheduling (Ascend, Cambricon, Hygon, Moore Threads, Muxi, etc.), support for IB/RoCE/RDMA, and Xinchuang support.

data-infra
โญ 2,615 Python ๐Ÿ‘ค data-infra User ๐Ÿ• Updated 2026-10-12 ๐Ÿ“… Created 2024-07-02
55
apache/burr

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

apache
โญ 2,608 Python ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-01-29
56
bionic-gpt/bionic-gpt

Bionic is sovereign Agentic AI for the enterprise โ€” Runs on-premise and can securely work with your sensitive data and systems.

bionic-gpt
โญ 2,411 Rust ๐Ÿ‘ค bionic-gpt Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2023-07-07
57
dot-agent/nextpy

๐Ÿค–Self-Modifying Framework from the Future ๐Ÿ”ฎ World's First AMS

dot-agent
โญ 2,338 Python ๐Ÿ‘ค dot-agent Organization ๐Ÿ• Updated 2024-05-01 ๐Ÿ“… Created 2023-08-07
58
uptrain-ai/uptrain

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

uptrain-ai
โญ 2,337 Python ๐Ÿ‘ค uptrain-ai Organization ๐Ÿ• Updated 2024-08-18 ๐Ÿ“… Created 2022-11-07
59
future-agi/future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing ยท Evals ยท Simulations ยท Datasets ยท Gateway ยท Guardrails. Self-hostable. Apache 2.0.

future-agi
โญ 2,284 Python ๐Ÿ‘ค future-agi Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-23
60
tensorchord/envd

๐Ÿ•๏ธ Reproducible development environment for humans and agents

tensorchord
โญ 2,249 Go ๐Ÿ‘ค tensorchord Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2022-04-11
61
trypromptly/LLMStack

No-code multi-agent framework to build LLM Agents, workflows and applications with your data

trypromptly
โญ 2,245 Python ๐Ÿ‘ค trypromptly Organization ๐Ÿ• Updated 2024-12-11 ๐Ÿ“… Created 2023-08-06
62
ShenSeanChen/waku-agent

Waku Agent is an open-source AI agent harness you own: loop, memory, evals, and an always-on layer (event inbox, timers, approvals, outbox), in code that stays readable.

ShenSeanChen
โญ 2,206 Python ๐Ÿ‘ค ShenSeanChen User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-07-10
63
mcp-router/mcp-router

A Unified MCP Server Management App (MCP Manager).

mcp-router
โญ 2,149 TypeScript ๐Ÿ‘ค mcp-router Organization ๐Ÿ• Updated 2026-08-03 ๐Ÿ“… Created 2025-03-22
64
microsoft/aici

AICI: Prompts as (Wasm) Programs

microsoft
โญ 2,077 Rust ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2025-01-22 ๐Ÿ“… Created 2023-09-26
65
supervc-stack/VectorChord

Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.

supervc-stack
โญ 1,842 Rust ๐Ÿ‘ค supervc-stack User ๐Ÿ• Updated 2026-08-06 ๐Ÿ“… Created 2024-09-03
66
intentee/paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale ๐Ÿ“๐Ÿฆ™ Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

intentee
โญ 1,694 Rust ๐Ÿ‘ค intentee Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2024-04-27
67
AgentEra/Agently

[GenAI Application Development Framework] ๐Ÿš€ Build GenAI application quick and easy ๐Ÿ’ฌ Easy to interact with GenAI agent in code using structure data and chained-calls syntax ๐Ÿงฉ Use Event-Driven Flow *TriggerFlow* to manage complex GenAI working logic ๐Ÿ”€ Switch to any model without rewrite application code

AgentEra
โญ 1,673 Python ๐Ÿ‘ค AgentEra Organization ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2023-06-30
68
langwatch/better-agents

Standards for building agents, better

langwatch
โญ 1,562 TypeScript ๐Ÿ‘ค langwatch Organization ๐Ÿ• Updated 2026-06-03 ๐Ÿ“… Created 2025-04-19
69
alibaba/rtp-llm

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

alibaba
โญ 1,402 Python ๐Ÿ‘ค alibaba Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-12-27
70
Arize-ai/openinference

OpenTelemetry Instrumentation for AI Observability

Arize-ai
โญ 1,333 Python ๐Ÿ‘ค Arize-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-12-26
71
KusionStack/kusion

Declarative Intent Driven Platform Orchestrator for Internal Developer Platform (IDP).

KusionStack
โญ 1,322 Go ๐Ÿ‘ค KusionStack Organization ๐Ÿ• Updated 2026-10-30 ๐Ÿ“… Created 2022-05-05
72
SmythOS/sre

The SmythOS Runtime Environment (SRE) is an open-source, cloud-native runtime for agentic AI. Secure, modular, and production-ready, it lets developers build, run, and manage intelligent agents across local, cloud, and edge environments.

SmythOS
โญ 1,305 TypeScript ๐Ÿ‘ค SmythOS Organization ๐Ÿ• Updated 2026-04-03 ๐Ÿ“… Created 2025-06-07
73
plurai-ai/intellagent

A framework for comprehensive diagnosis and optimization of agents using simulated, realistic synthetic interactions

plurai-ai
โญ 1,266 Python ๐Ÿ‘ค plurai-ai Organization ๐Ÿ• Updated 2026-09-14 ๐Ÿ“… Created 2024-10-28
74
e2b-dev/awesome-ai-sdks

A database of SDKs, frameworks, libraries, and tools for creating, monitoring, debugging and deploying autonomous AI agents

e2b-dev
โญ 1,241 ๐Ÿ‘ค e2b-dev Organization ๐Ÿ• Updated 2026-07-09 ๐Ÿ“… Created 2023-08-05
75
Scale3-Labs/langtrace

Langtrace ๐Ÿ” is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. ๐Ÿš€๐Ÿ’ป๐Ÿ“Š

Scale3-Labs
โญ 1,236 TypeScript ๐Ÿ‘ค Scale3-Labs Organization ๐Ÿ• Updated 2025-11-17 ๐Ÿ“… Created 2024-03-30
76
Ricky-7-Yan/intelligent-audit-system

AuditPilot: auditable enterprise AI agents for evidence-grounded workflows, governed tools, evaluation harnesses, human review, and remediation delivery.

Ricky-7-Yan
โญ 1,182 Python ๐Ÿ‘ค Ricky-7-Yan User ๐Ÿ• Updated 2026-11-05 ๐Ÿ“… Created 2025-10-28
77
Jwuthri/Tracely-ai

Trace-native CI/CD for AI agents โ€” production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.

Jwuthri
โญ 1,122 Python ๐Ÿ‘ค Jwuthri User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-06-03
78
datadreamer-dev/DataDreamer

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. โ€‚ ๐Ÿค–๐Ÿ’ค

datadreamer-dev
โญ 1,112 Python ๐Ÿ‘ค datadreamer-dev Organization ๐Ÿ• Updated 2025-02-02 ๐Ÿ“… Created 2023-06-02
79
prometheus-eval/prometheus-eval

Evaluate your LLM's response with Prometheus and GPT4 ๐Ÿ’ฏ

prometheus-eval
โญ 1,087 Python ๐Ÿ‘ค prometheus-eval Organization ๐Ÿ• Updated 2025-04-25 ๐Ÿ“… Created 2024-04-18
80
dynamiq-ai/dynamiq

Dynamiq is an orchestration framework for agentic AI and LLM applications

dynamiq-ai
โญ 1,072 Python ๐Ÿ‘ค dynamiq-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-09-26
81
ajndkr/lanarky

The web framework for building LLM microservices [deprecated]

ajndkr
โญ 996 Python ๐Ÿ‘ค ajndkr User ๐Ÿ• Updated 2024-07-06 ๐Ÿ“… Created 2023-04-07
82
respanai/respan-gateway

Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini, and every other vendor. Any SDK, any model, any tool.

respanai
โญ 975 Rust ๐Ÿ‘ค respanai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-09-25
83
mozilla-ai/otari

Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

mozilla-ai
โญ 959 Python ๐Ÿ‘ค mozilla-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-02
84
msoedov/langcorn

โ›“๏ธ Serving LangChain LLM apps and agents automagically with FastApi. LLMops

msoedov
โญ 936 Python ๐Ÿ‘ค msoedov User ๐Ÿ• Updated 2024-07-15 ๐Ÿ“… Created 2023-04-14
85
onlyphantom/llm-python

Large Language Models (LLMs) tutorials & sample scripts, ft. langchain, openai, llamaindex, gpt, chromadb & pinecone

onlyphantom
โญ 932 Jupyter Notebook ๐Ÿ‘ค onlyphantom User ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2023-04-06
86
getmetal/motorhead

๐Ÿง  Motorhead is a memory and information retrieval server for LLMs.

getmetal
โญ 915 Rust ๐Ÿ‘ค getmetal Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-03-29
87
callmesora/llmops-python-package

Kickstart your LLMOps initiative with a flexible, robust, and productive Python package.

callmesora
โญ 897 Python ๐Ÿ‘ค callmesora User ๐Ÿ• Updated 2025-02-13 ๐Ÿ“… Created 2024-12-10
88
santifer/cv-santiago

Interactive CV with AI chat integration. Built with React 19, TypeScript, Claude API. Chat with my AI avatar about my experience.

santifer
โญ 871 HTML ๐Ÿ‘ค santifer User ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2026-01-23
89
NeumTry/NeumAI

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

NeumTry
โญ 864 Python ๐Ÿ‘ค NeumTry Organization ๐Ÿ• Updated 2024-01-15 ๐Ÿ“… Created 2023-09-14
90
jwuthri-cloud/Tracely-ai

Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable.

jwuthri-cloud
โญ 850 Python ๐Ÿ‘ค jwuthri-cloud User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-10-11
91
bosun-ai/swiftide

Fast, streaming indexing, query, and agentic LLM applications in Rust

bosun-ai
โญ 805 Rust ๐Ÿ‘ค bosun-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-06-09
92
Abilityai/trinity

Self-hosted AI Agents Platform for AI Native companies. Claude Code, Codex, Gemini, OpenCode agents. Apache 2.0.

Abilityai
โญ 792 Python ๐Ÿ‘ค Abilityai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-12-10
โญ 781 TypeScript ๐Ÿ‘ค langchain-ai Organization ๐Ÿ• Updated 2025-06-26 ๐Ÿ“… Created 2023-04-05
94
overmind-core/overmind

The platform for continuously improving AI agents.

overmind-core
โญ 771 Python ๐Ÿ‘ค overmind-core Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-03-27
95
Azure-Samples/contoso-chat

This sample has the full End2End process of creating RAG application with Prompty and Azure AI Foundry. It includes GPT-4 LLM application code, evaluations, deployment automation with AZD CLI, GitHub actions for evaluation and deployment and intent mapping for multiple LLM task mapping.

Azure-Samples
โญ 762 Bicep ๐Ÿ‘ค Azure-Samples Organization ๐Ÿ• Updated 2025-10-03 ๐Ÿ“… Created 2023-11-29
96
morsoli/llm-books

Practical Notes on Building Applications with LLMs

morsoli
โญ 761 Python ๐Ÿ‘ค morsoli User ๐Ÿ• Updated 2024-11-29 ๐Ÿ“… Created 2023-06-12
97
mikehasa/agentacct

See what your coding agents did and what it cost. Breaks each task down into work steps โ€” tools used, files changed, tests run, time and tokens spent. Local-first dashboard for Claude Code, Codex, OpenCode, and more. No login, no telemetry.

mikehasa
โญ 757 Python ๐Ÿ‘ค mikehasa User ๐Ÿ• Updated 2026-10-03 ๐Ÿ“… Created 2026-07-24
98
calmrocks/ai-engineer-notebooks

Hands-on, framework-free Colab notebooks for the AI Engineer / Forward Deployed Engineer (FDE) skill set โ€” model APIs, structured output, tool calling, RAG, evals-as-the-spine, agents (loop from scratch, tool design, guardrails, MCP, Skills), fine-tuning vs LoRA, prompt-injection/security, LLMOps, and customer craft. Runs on the free Groq API.

calmrocks
โญ 756 Jupyter Notebook ๐Ÿ‘ค calmrocks User ๐Ÿ• Updated 2026-11-07 ๐Ÿ“… Created 2026-08-11
99
Haohao-end/openagent

What if OpenAI Deep Research and Dify were one platform? OpenAgent โ€” harness architecture for rapidly building vertical AI agents, with deep reasoning loops, visual workflows, RAG, and A2A delegation.

Haohao-end
โญ 756 Python ๐Ÿ‘ค Haohao-end User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-06-20
100
liguodongiot/llm-resource

LLM Full-Stack High-Quality Resource Compilation

liguodongiot
โญ 723 Shell ๐Ÿ‘ค liguodongiot User ๐Ÿ• Updated 2025-07-15 ๐Ÿ“… Created 2023-08-27