#agent-evaluation Repositories
Discover 19 active open source GitHub repositories tagged with #agent-evaluation, accumulating 83,117 total stars (averaging 4,374 stars per project). Leading this topic is ifixai-ai/iFixAi with 46,592 stars.
19 repositories total
Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.
Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.
Multi-tier framework for evaluating AI agent skills and plugins with quality gates, security scanning, harness compatibility checks, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior. Ships reusable CI templates that bring every check to any repository.
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing ยท Evals ยท Simulations ยท Datasets ยท Gateway ยท Guardrails. Self-hostable. Apache 2.0.
AutoChain: Build lightweight, extensible, and testable LLM Agents
bsuite is a collection of carefully-designed experiments that investigate core capabilities of a reinforcement learning (RL) agent
AuditPilot: auditable enterprise AI agents for evidence-grounded workflows, governed tools, evaluation harnesses, human review, and remediation delivery.
Open, source-backed catalog of computer-use agents: reviewed papers, GUI models, datasets, benchmarks, tools, and reusable JSONL/SQLite data.
A curated, non-BS library of the best resources for building and evaluating AI agents โ papers, blogs, talks, tools, benchmarks. Maintained by BenchFlow.
A holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.
open source agent engineering platform: traces, evals, and metrics to debug and improve your AI agents. Integrates with LangGraph, CrewAI, Claude Agent SDK, and more.
Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable.
๐ ๏ธ The meta-harness for AI agents โ scaffold your own focused, branded agent harness with its own npx CLI, MCP server, memory, learning loop, and witness-signed releases. Works with Claude Code, Codex, pi.dev, Hermes, OpenClaw, and RVM (hardware-isolated sandbox).
Frequently Asked Questions
What is the most popular #agent-evaluation repository on GitHub?
The top ranked open source #agent-evaluation project on GitHub is ifixai-ai/iFixAi with 46,592 stars. Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.
Which programming languages are most used in #agent-evaluation repositories?
Among the top ranked #agent-evaluation projects on GitHub, the most common programming languages are Python, Go, TypeScript.
How is the #agent-evaluation repository ranking calculated?
We track 19 active open source repositories tagged with #agent-evaluation (500+ stars), totaling 83,117 stars with an average of 4,374 stars per repository. Rankings update daily from the GitHub API.