Git Stars Git Stars

#ai-evaluation Repositories

Discover 10 active open source GitHub repositories tagged with #ai-evaluation, accumulating 70,473 total stars (averaging 7,047 stars per project). Leading this topic is ifixai-ai/iFixAi with 46,592 stars.

10
Total Repositories
70,473
Total Stars
7,047
Avg Stars/Repo
1
ifixai-ai/iFixAi

Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

ifixai-ai
โญ 46,592 Python ๐Ÿ‘ค ifixai-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-04-27
2
DataTalksClub/llm-zoomcamp

LLM Zoomcamp - a free online course about real-life applications of LLMs. In 10 weeks you will learn how to build an AI system that answers questions about your knowledge base. Register here ๐Ÿ‘‡๐Ÿผ

DataTalksClub
โญ 7,715 Jupyter Notebook ๐Ÿ‘ค DataTalksClub Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2024-03-26
3
microsoft/PyRIT

Open-source AI red teaming toolkit from Microsoft. Test generative AI systems with automated scans, adaptive multi-turn attacks, and a web UI.

microsoft
โญ 5,003 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-12-12
4
DenisSergeevitch/chatgpt-custom-instructions

My own Prompts for Custom instructions ChatGPT

DenisSergeevitch
โญ 2,819 ๐Ÿ‘ค DenisSergeevitch User ๐Ÿ• Updated 2026-03-14 ๐Ÿ“… Created 2024-11-29
โญ 2,059 JavaScript ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-12-08
6
google-deepmind/mathematics_dataset

This dataset code generates mathematical question and answer pairs, from a range of question types at roughly school-level difficulty.

google-deepmind
โญ 1,925 Python ๐Ÿ‘ค google-deepmind Organization ๐Ÿ• Updated 2024-12-23 ๐Ÿ“… Created 2019-03-27
7
rockingdingo/deepnlp

Deep Learning NLP Pipeline implemented on Tensorflow

rockingdingo
โญ 1,361 Python ๐Ÿ‘ค rockingdingo User ๐Ÿ• Updated 2024-10-11 ๐Ÿ“… Created 2016-10-27
8
openai/frontier-evals

OpenAI Frontier Evals

openai
โญ 1,345 Python ๐Ÿ‘ค openai Organization ๐Ÿ• Updated 2026-10-12 ๐Ÿ“… Created 2025-03-28
9
cvs-health/uqlm

[JMLR 2026] UQLM: A Python package for LLM hallucination detection using uncertainty quantification

cvs-health
โญ 1,215 Python ๐Ÿ‘ค cvs-health Organization ๐Ÿ• Updated 2026-11-08 ๐Ÿ“… Created 2025-04-17
10
microsoft/OptiGuide

GenAI for Optimization and Decision Intelligence

microsoft
โญ 734 Python ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2023-07-31

Frequently Asked Questions

1

What is the most popular #ai-evaluation repository on GitHub?

The top ranked open source #ai-evaluation project on GitHub is ifixai-ai/iFixAi with 46,592 stars. Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

2

Which programming languages are most used in #ai-evaluation repositories?

Among the top ranked #ai-evaluation projects on GitHub, the most common programming languages are Python, Jupyter Notebook, JavaScript.

3

How is the #ai-evaluation repository ranking calculated?

We track 10 active open source repositories tagged with #ai-evaluation (500+ stars), totaling 70,473 stars with an average of 7,047 stars per repository. Rankings update daily from the GitHub API.