Git Stars Git Stars

#llm-observability Repositories

Discover 30 active open source GitHub repositories tagged with #llm-observability, accumulating 151,448 total stars (averaging 5,048 stars per project). Leading this topic is langfuse/langfuse with 37,696 stars.

30
Total Repositories
151,448
Total Stars
5,048
Avg Stars/Repo
1
langfuse/langfuse

๐Ÿชข Open-source AI engineering platform: AI Gateway, agent observability, evaluations, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.

langfuse
โญ 37,696 TypeScript ๐Ÿ‘ค langfuse Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-05-18
2
comet-ml/opik

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

comet-ml
โญ 23,479 Java ๐Ÿ‘ค comet-ml Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-05-10
3
VoltAgent/voltagent

AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

VoltAgent
โญ 10,999 TypeScript ๐Ÿ‘ค VoltAgent Organization ๐Ÿ• Updated 2026-11-06 ๐Ÿ“… Created 2025-04-16
4
FailproofAI/failproofai

Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.

FailproofAI
โญ 9,904 TypeScript ๐Ÿ‘ค FailproofAI Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-06
5
maximhq/bifrost

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200ยตs of overhead at 5k RPS.

maximhq
โญ 9,886 Go ๐Ÿ‘ค maximhq Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-03-19
6
mnfst/llm-gateway

Open Source LLM Gateway ๐Ÿฆš

mnfst
โญ 7,651 TypeScript ๐Ÿ‘ค mnfst Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2022-09-27
7
Helicone/helicone

๐ŸงŠ Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 ๐Ÿ“

Helicone
โญ 6,292 TypeScript ๐Ÿ‘ค Helicone Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2023-01-31
8
coze-dev/coze-loop

Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.

coze-dev
โญ 5,799 Go ๐Ÿ‘ค coze-dev Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2025-06-24
9
latitude-dev/latitude-llm

Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces.

latitude-dev
โญ 4,756 TypeScript ๐Ÿ‘ค latitude-dev Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2024-06-28
10
pydantic/logfire

AI observability platform for production LLM and agent systems.

pydantic
โญ 4,564 Python ๐Ÿ‘ค pydantic Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-04-23
11
memodb-io/Acontext

Agent Skills as a Memory Layer

memodb-io
โญ 3,697 JavaScript ๐Ÿ‘ค memodb-io Organization ๐Ÿ• Updated 2026-07-14 ๐Ÿ“… Created 2025-07-16
12
lmnr-ai/lmnr

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

lmnr-ai
โญ 3,516 TypeScript ๐Ÿ‘ค lmnr-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-08-29
13
openlit/openlit

Same agent, smaller bill. The tools and infrastructure to get more work from your AI. Fewer tokens. Less compute. Lower cost.

openlit
โญ 3,094 TypeScript ๐Ÿ‘ค openlit Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2024-01-23
14
run-llama/sec-insights

A real world full-stack application using LlamaIndex

run-llama
โญ 2,601 TypeScript ๐Ÿ‘ค run-llama Organization ๐Ÿ• Updated 2025-03-12 ๐Ÿ“… Created 2023-09-05
15
future-agi/future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing ยท Evals ยท Simulations ยท Datasets ยท Gateway ยท Guardrails. Self-hostable. Apache 2.0.

future-agi
โญ 2,284 Python ๐Ÿ‘ค future-agi Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-23
16
Nutlope/llamatutor

An AI personal tutor built with Llama 3.1

Nutlope
โญ 2,053 TypeScript ๐Ÿ‘ค Nutlope User ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2024-07-19
17
badlogic/lemmy

Wrapper around tool using LLMs for agentic workflows

badlogic
โญ 1,641 TypeScript ๐Ÿ‘ค badlogic User ๐Ÿ• Updated 2025-08-13 ๐Ÿ“… Created 2025-05-23
18
traceroot-ai/traceroot

traceroot: the open-source platform that continuously improves your AI agents.

traceroot-ai
โญ 1,443 TypeScript ๐Ÿ‘ค traceroot-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-07-22
19
Jwuthri/Tracely-ai

Trace-native CI/CD for AI agents โ€” production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.

Jwuthri
โญ 1,122 Python ๐Ÿ‘ค Jwuthri User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-06-03
20
Continuum-AI-Corp/OrcaReplay

OrcaReplay โ€” Time travel for AI agents. Record, replay, fork, and debug any agent run with any model. Built by the OrcaRouter.ai team.

Continuum-AI-Corp
โญ 1,083 TypeScript ๐Ÿ‘ค Continuum-AI-Corp Organization ๐Ÿ• Updated 2026-10-01 ๐Ÿ“… Created 2026-08-29
21
JudgmentLabs/judgeval

The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.

JudgmentLabs
โญ 1,073 Python ๐Ÿ‘ค JudgmentLabs Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2024-10-25
22
ThinkWatchProject/ThinkWatch-Lite

Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.

ThinkWatchProject
โญ 946 TypeScript ๐Ÿ‘ค ThinkWatchProject Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-09-12
23
jwuthri-cloud/Tracely-ai

Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable.

jwuthri-cloud
โญ 850 Python ๐Ÿ‘ค jwuthri-cloud User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-10-11
24
ThinkWatchProject/ThinkWatch

Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call guards, rate limits, budgets, cost accounting and audit logs.

ThinkWatchProject
โญ 817 Rust ๐Ÿ‘ค ThinkWatchProject Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-02
25
LockedinLabs-AI/agent-console

Local-first observability for AI coding agents. Every Claude Code and Codex session's tokens, cache, models and cost, on this machine and every machine you connect through a self-hosted team hub. Presenting mode, policy hooks, Apple-signed and notarized macOS builds, attested releases. MIT.

LockedinLabs-AI
โญ 802 JavaScript ๐Ÿ‘ค LockedinLabs-AI Organization ๐Ÿ• Updated 2026-10-04 ๐Ÿ“… Created 2026-09-20
26
Abilityai/trinity

Self-hosted AI Agents Platform for AI Native companies. Claude Code, Codex, Gemini, OpenCode agents. Apache 2.0.

Abilityai
โญ 792 Python ๐Ÿ‘ค Abilityai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-12-10
27
databufflabs/databuff

DataBuff is an AI-native APM built on OpenTelemetry, with multi-agent troubleshooting out of the box.

databufflabs
โญ 729 Java ๐Ÿ‘ค databufflabs User ๐Ÿ• Updated 2026-10-06 ๐Ÿ“… Created 2026-06-18
28
comet-ml/opik-openclaw

๐Ÿฆž Official plugin for OpenClaw that exports agent traces to Opik. See and monitor agent behaviour, cost, tokens, errors and more.

comet-ml
โญ 723 TypeScript ๐Ÿ‘ค comet-ml Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-03-02
29
vinay-gatech/stocks-insights-ai-agent

Full Stack application for retrieving Stock Data and News using LLM, LangChain and LangGraph

vinay-gatech
โญ 715 Python ๐Ÿ‘ค vinay-gatech User ๐Ÿ• Updated 2024-12-08 ๐Ÿ“… Created 2024-12-08
30
Justin0504/Aegis

Runtime policy enforcement for AI agents. Cryptographic audit trail, human-in-the-loop approvals, kill switch. Zero code changes.

Justin0504
โญ 524 TypeScript ๐Ÿ‘ค Justin0504 User ๐Ÿ• Updated 2026-10-31 ๐Ÿ“… Created 2026-03-04

Frequently Asked Questions

1

What is the most popular #llm-observability repository on GitHub?

The top ranked open source #llm-observability project on GitHub is langfuse/langfuse with 37,696 stars. ๐Ÿชข Open-source AI engineering platform: AI Gateway, agent observability, evaluations, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.

2

Which programming languages are most used in #llm-observability repositories?

Among the top ranked #llm-observability projects on GitHub, the most common programming languages are TypeScript, Python, Java, Go.

3

How is the #llm-observability repository ranking calculated?

We track 30 active open source repositories tagged with #llm-observability (500+ stars), totaling 151,448 stars with an average of 5,048 stars per repository. Rankings update daily from the GitHub API.