Git Stars Git Stars

#ai-benchmarking Repositories

Discover 15 active open source GitHub repositories tagged with #ai-benchmarking, accumulating 27,721 total stars (averaging 1,848 stars per project). Leading this topic is henrythe9th/AI-Crash-Course with 6,274 stars.

15
Total Repositories
27,721
Total Stars
1,848
Avg Stars/Repo
1
henrythe9th/AI-Crash-Course

AI Crash Course to help busy builders catch up to the public frontier of AI research in 2 weeks

henrythe9th
โญ 6,274 ๐Ÿ‘ค henrythe9th User ๐Ÿ• Updated 2026-02-23 ๐Ÿ“… Created 2025-01-08
2
yoloytang/Awesome-LLMs-for-Video-Understanding

๐Ÿ”ฅ๐Ÿ”ฅ๐Ÿ”ฅ [IEEE TCSVT] Latest Papers, Codes and Datasets on Vid-LLMs.

yoloytang
โญ 3,310 ๐Ÿ‘ค yoloytang User ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2023-07-16
3
stanford-crfm/helm

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

stanford-crfm
โญ 2,975 Python ๐Ÿ‘ค stanford-crfm Organization ๐Ÿ• Updated 2026-09-01 ๐Ÿ“… Created 2021-11-29
4
togethercomputer/MoA

Together Mixture-Of-Agents (MoA) โ€“ 65.1% on AlpacaEval with OSS models

togethercomputer
โญ 2,903 Python ๐Ÿ‘ค togethercomputer Organization ๐Ÿ• Updated 2025-01-07 ๐Ÿ“… Created 2024-06-04
5
MineDojo/MineDojo

Building Open-Ended Embodied Agents with Internet-Scale Knowledge

MineDojo
โญ 2,108 Java ๐Ÿ‘ค MineDojo Organization ๐Ÿ• Updated 2024-03-18 ๐Ÿ“… Created 2022-06-18
6
ydyjya/Awesome-LLM-Safety

A curated list of safety-related papers, articles, and resources focused on Large Language Models (LLMs). This repository aims to provide researchers, practitioners, and enthusiasts with insights into the safety implications, challenges, and advancements surrounding these powerful models.

ydyjya
โญ 1,921 HTML ๐Ÿ‘ค ydyjya User ๐Ÿ• Updated 2026-07-12 ๐Ÿ“… Created 2023-10-29
7
openai/mle-bench

MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering

openai
โญ 1,801 Python ๐Ÿ‘ค openai Organization ๐Ÿ• Updated 2026-04-24 ๐Ÿ“… Created 2024-10-08
8
PromtEngineer/Verbi

A modular voice assistant application for experimenting with state-of-the-art transcription, response generation, and text-to-speech models. Supports OpenAI, Groq, Elevenlabs, CartesiaAI, and Deepgram APIs, plus local models via Ollama. Ideal for research and development in voice technology.

PromtEngineer
โญ 1,125 Python ๐Ÿ‘ค PromtEngineer User ๐Ÿ• Updated 2025-11-22 ๐Ÿ“… Created 2024-05-20
9
KCORES/kcores-llm-arena

LLM Arena by KCORES team

KCORES
โญ 960 HTML ๐Ÿ‘ค KCORES Organization ๐Ÿ• Updated 2025-04-29 ๐Ÿ“… Created 2025-02-12
10
DirtyHarryLYL/LLM-in-Vision

Recent LLM-based CV and related works. Welcome to comment/contribute!

DirtyHarryLYL
โญ 868 ๐Ÿ‘ค DirtyHarryLYL User ๐Ÿ• Updated 2025-03-08 ๐Ÿ“… Created 2023-03-10
11
SnowingFox/open-nof1.ai

An open-source AI trading platform in the real market,

SnowingFox
โญ 806 TypeScript ๐Ÿ‘ค SnowingFox User ๐Ÿ• Updated 2026-04-01 ๐Ÿ“… Created 2025-10-20
12
TAG-Research/TAG-Bench

TAG-Bench: A benchmark for table-augmented generation (TAG)

TAG-Research
โญ 766 Python ๐Ÿ‘ค TAG-Research Organization ๐Ÿ• Updated 2026-07-25 ๐Ÿ“… Created 2024-08-26
โญ 707 ๐Ÿ‘ค arcprize Organization ๐Ÿ• Updated 2025-05-22 ๐Ÿ“… Created 2025-03-17
14
facebookresearch/MLGym

MLGym A New Framework and Benchmark for Advancing AI Research Agents

facebookresearch
โญ 616 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2025-08-10 ๐Ÿ“… Created 2025-02-18
15
Fancy-MLLM/R1-Onevision

R1-onevision, a visual language model capable of deep CoT reasoning.

Fancy-MLLM
โญ 581 Python ๐Ÿ‘ค Fancy-MLLM User ๐Ÿ• Updated 2025-04-13 ๐Ÿ“… Created 2025-02-08

Frequently Asked Questions

1

What is the most popular #ai-benchmarking repository on GitHub?

The top ranked open source #ai-benchmarking project on GitHub is henrythe9th/AI-Crash-Course with 6,274 stars. AI Crash Course to help busy builders catch up to the public frontier of AI research in 2 weeks

2

Which programming languages are most used in #ai-benchmarking repositories?

Among the top ranked #ai-benchmarking projects on GitHub, the most common programming languages are Python, HTML, Java, TypeScript.

3

How is the #ai-benchmarking repository ranking calculated?

We track 15 active open source repositories tagged with #ai-benchmarking (500+ stars), totaling 27,721 stars with an average of 1,848 stars per repository. Rankings update daily from the GitHub API.