Git Stars Git Stars

#agent-evaluation Repositories

Discover 19 active open source GitHub repositories tagged with #agent-evaluation, accumulating 83,117 total stars (averaging 4,374 stars per project). Leading this topic is ifixai-ai/iFixAi with 46,592 stars.

19
Total Repositories
83,117
Total Stars
4,374
Avg Stars/Repo
Programming Languages: Python Go TypeScript
1
ifixai-ai/iFixAi

Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

ifixai-ai
โญ 46,592 Python ๐Ÿ‘ค ifixai-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-04-27
2
Giskard-AI/giskard-oss

๐Ÿข Open-Source Evaluation & Testing library for LLM Agents

Giskard-AI
โญ 5,965 Python ๐Ÿ‘ค Giskard-AI Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2022-03-06
3
coze-dev/coze-loop

Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.

coze-dev
โญ 5,799 Go ๐Ÿ‘ค coze-dev Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2025-06-24
4
NVIDIA/SkillEvaluator

Multi-tier framework for evaluating AI agent skills and plugins with quality gates, security scanning, harness compatibility checks, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior. Ships reusable CI templates that bring every check to any repository.

NVIDIA
โญ 4,300 Python ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-06-24
5
truera/trulens

Evaluation and Tracking for LLM Experiments and AI Agents

truera
โญ 3,665 Python ๐Ÿ‘ค truera Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2020-11-02
6
future-agi/future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing ยท Evals ยท Simulations ยท Datasets ยท Gateway ยท Guardrails. Self-hostable. Apache 2.0.

future-agi
โญ 2,284 Python ๐Ÿ‘ค future-agi Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-23
7
Forethought-Technologies/AutoChain

AutoChain: Build lightweight, extensible, and testable LLM Agents

Forethought-Technologies
โญ 1,879 Python ๐Ÿ‘ค Forethought-Technologies Organization ๐Ÿ• Updated 2025-12-16 ๐Ÿ“… Created 2023-05-19
8
google-deepmind/bsuite

bsuite is a collection of carefully-designed experiments that investigate core capabilities of a reinforcement learning (RL) agent

google-deepmind
โญ 1,566 Python ๐Ÿ‘ค google-deepmind Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2019-08-02
9
alibaba/skill-up

Evaluate Agent Skills and environments. Evolve Skills with evidence.

alibaba
โญ 1,508 Go ๐Ÿ‘ค alibaba Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-05-09
10
TIGER-AI-Lab/ClawBench

Open-source benchmark for browser AI agents on daily tasks.

TIGER-AI-Lab
โญ 1,325 Python ๐Ÿ‘ค TIGER-AI-Lab Organization ๐Ÿ• Updated 2026-11-05 ๐Ÿ“… Created 2026-04-10
11
mozilla-ai/any-agent

A single interface to use and evaluate different agent frameworks

mozilla-ai
โญ 1,261 Python ๐Ÿ‘ค mozilla-ai Organization ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2025-03-25
12
Ricky-7-Yan/intelligent-audit-system

AuditPilot: auditable enterprise AI agents for evidence-grounded workflows, governed tools, evaluation harnesses, human review, and remediation delivery.

Ricky-7-Yan
โญ 1,182 Python ๐Ÿ‘ค Ricky-7-Yan User ๐Ÿ• Updated 2026-11-05 ๐Ÿ“… Created 2025-10-28
13
reacher-z/Awesome-CUA

Open, source-backed catalog of computer-use agents: reviewed papers, GUI models, datasets, benchmarks, tools, and reusable JSONL/SQLite data.

reacher-z
โญ 1,072 Python ๐Ÿ‘ค reacher-z User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-10-16
14
benchflow-ai/awesome-evals

A curated, non-BS library of the best resources for building and evaluating AI agents โ€” papers, blogs, talks, tools, benchmarks. Maintained by BenchFlow.

benchflow-ai
โญ 1,049 ๐Ÿ‘ค benchflow-ai Organization ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2026-06-24
15
microsoft/AIOpsLab

A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.

microsoft
โญ 1,036 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2024-10-11
16
chirpz-ai/pandaprobe

open source agent engineering platform: traces, evals, and metrics to debug and improve your AI agents. Integrates with LangGraph, CrewAI, Claude Agent SDK, and more.

chirpz-ai
โญ 868 Python ๐Ÿ‘ค chirpz-ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-12-16
17
jwuthri-cloud/Tracely-ai

Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable.

jwuthri-cloud
โญ 850 Python ๐Ÿ‘ค jwuthri-cloud User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-10-11
18
ruvnet/metaharness

๐Ÿ› ๏ธ The meta-harness for AI agents โ€” scaffold your own focused, branded agent harness with its own npx CLI, MCP server, memory, learning loop, and witness-signed releases. Works with Claude Code, Codex, pi.dev, Hermes, OpenClaw, and RVM (hardware-isolated sandbox).

ruvnet
โญ 759 TypeScript ๐Ÿ‘ค ruvnet User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-06-13
19
TIGER-AI-Lab/WebsiteBench

Can AI agents rebuild websites through browser exploration?

TIGER-AI-Lab
โญ 595 Python ๐Ÿ‘ค TIGER-AI-Lab Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2026-11-04

Frequently Asked Questions

1

What is the most popular #agent-evaluation repository on GitHub?

The top ranked open source #agent-evaluation project on GitHub is ifixai-ai/iFixAi with 46,592 stars. Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

2

Which programming languages are most used in #agent-evaluation repositories?

Among the top ranked #agent-evaluation projects on GitHub, the most common programming languages are Python, Go, TypeScript.

3

How is the #agent-evaluation repository ranking calculated?

We track 19 active open source repositories tagged with #agent-evaluation (500+ stars), totaling 83,117 stars with an average of 4,374 stars per repository. Rankings update daily from the GitHub API.