Git Stars Git Stars

#benchmark Repositories

193
Total Repositories
392,395
Total Stars
2,033
Avg Stars/Repo
151
facebookresearch/BenchMARL

BenchMARL is a library for benchmarking Multi-Agent Reinforcement Learning (MARL). BenchMARL allows to quickly compare different MARL algorithms, tasks, and models while being systematically grounded in its two core tenets: reproducibility and standardization.

facebookresearch
โญ 687 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2026-02-07 ๐Ÿ“… Created 2023-08-22
152
JuliaCI/BenchmarkTools.jl

A benchmarking framework for the Julia language

JuliaCI
โญ 685 Julia ๐Ÿ‘ค JuliaCI Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2016-02-23
153
ServiceNow/AgentLab

AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.

ServiceNow
โญ 668 Python ๐Ÿ‘ค ServiceNow Organization ๐Ÿ• Updated 2026-10-06 ๐Ÿ“… Created 2024-05-21
154
lukeed/uid

A tiny (130B to 205B) and fast utility to generate random IDs of fixed length

lukeed
โญ 668 JavaScript ๐Ÿ‘ค lukeed User ๐Ÿ• Updated 2024-09-27 ๐Ÿ“… Created 2020-03-03
155
Tencent/AICGSecEval

A.S.E (AICGSecEval) is a repository-level AI-generated code security evaluation benchmark developed by Tencent Wukong Code Security Team.

Tencent
โญ 667 Python ๐Ÿ‘ค Tencent Organization ๐Ÿ• Updated 2026-05-25 ๐Ÿ“… Created 2025-07-08
156
onejune2018/Awesome-LLM-Eval

Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. A curated list of tools, benchmarks/datasets, demos, leaderboards, and large models, primarily focused on the evaluation of foundation large models, aiming to explore the technological boundaries of generative AI.

onejune2018
โญ 661 ๐Ÿ‘ค onejune2018 User ๐Ÿ• Updated 2025-11-24 ๐Ÿ“… Created 2023-04-26
157
benedekrozemberczki/datasets

A repository of pretty cool datasets that I collected for network science and machine learning research.

benedekrozemberczki
โญ 657 ๐Ÿ‘ค benedekrozemberczki User ๐Ÿ• Updated 2025-12-20 ๐Ÿ“… Created 2019-04-07
158
Westlake-AI/openmixup

CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmark

Westlake-AI
โญ 656 Python ๐Ÿ‘ค Westlake-AI Organization ๐Ÿ• Updated 2025-10-15 ๐Ÿ“… Created 2021-12-30
159
run-llama/ParseBench

ParseBench - A Document Parsing Benchmark for AI Agents

run-llama
โญ 650 Python ๐Ÿ‘ค run-llama Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-10
160
Kotlin/kotlinx-benchmark

Kotlin multiplatform benchmarking toolkit

Kotlin
โญ 644 Kotlin ๐Ÿ‘ค Kotlin Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2018-12-18
161
onyx-dot-app/EnterpriseRAG-Bench

Dataset and benchmark for RAG on company internal documents.

onyx-dot-app
โญ 639 ๐Ÿ‘ค onyx-dot-app Organization ๐Ÿ• Updated 2026-09-03 ๐Ÿ“… Created 2026-02-19
162
HowieHwong/TrustLLM

[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

HowieHwong
โญ 635 Python ๐Ÿ‘ค HowieHwong User ๐Ÿ• Updated 2026-10-04 ๐Ÿ“… Created 2023-12-23
163
IndoNLP/indonlu

The first-ever vast natural language processing benchmark for Indonesian Language. We provide multiple downstream tasks, pre-trained IndoBERT models, and a starter code! (AACL-IJCNLP 2020)

IndoNLP
โญ 635 Jupyter Notebook ๐Ÿ‘ค IndoNLP Organization ๐Ÿ• Updated 2024-11-16 ๐Ÿ“… Created 2020-09-12
164
jsdelivr/globalping

A global network of probes to run network tests like ping, traceroute and DNS resolve

jsdelivr
โญ 630 TypeScript ๐Ÿ‘ค jsdelivr Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2022-02-19
165
piotrmurach/rspec-benchmark

Performance testing matchers for RSpec

piotrmurach
โญ 617 Ruby ๐Ÿ‘ค piotrmurach User ๐Ÿ• Updated 2024-03-16 ๐Ÿ“… Created 2016-01-17
166
Xtra-Computing/NIID-Bench

Federated Learning Benchmark - Federated Learning on Non-IID Data Silos: An Experimental Study (ICDE 2022)

Xtra-Computing
โญ 611 Python ๐Ÿ‘ค Xtra-Computing Organization ๐Ÿ• Updated 2024-02-26 ๐Ÿ“… Created 2021-01-08
167
KLUE-benchmark/KLUE

๐Ÿ“– Korean NLU Benchmark

KLUE-benchmark
โญ 606 ๐Ÿ‘ค KLUE-benchmark Organization ๐Ÿ• Updated 2026-06-30 ๐Ÿ“… Created 2020-11-16
168
FreedomIntelligence/TextClassificationBenchmark

A Benchmark of Text Classification in PyTorch

FreedomIntelligence
โญ 606 Python ๐Ÿ‘ค FreedomIntelligence Organization ๐Ÿ• Updated 2024-04-20 ๐Ÿ“… Created 2017-12-13
169
JailbreakBench/jailbreakbench

JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]

JailbreakBench
โญ 603 Python ๐Ÿ‘ค JailbreakBench Organization ๐Ÿ• Updated 2025-04-04 ๐Ÿ“… Created 2023-11-13
โญ 602 Python ๐Ÿ‘ค DavidZhangdw User ๐Ÿ• Updated 2026-06-15 ๐Ÿ“… Created 2019-11-17
171
Tencent-Hunyuan/CL-bench

CL-bench: A Benchmark for Context Learning

Tencent-Hunyuan
โญ 596 Python ๐Ÿ‘ค Tencent-Hunyuan Organization ๐Ÿ• Updated 2026-10-17 ๐Ÿ“… Created 2026-01-23
172
TIGER-AI-Lab/WebsiteBench

Can AI agents rebuild websites through browser exploration?

TIGER-AI-Lab
โญ 595 Python ๐Ÿ‘ค TIGER-AI-Lab Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2026-11-04
173
lance0/xfr

A modern iperf3 alternative with a live TUI, multi-client server, and QUIC support. Built in Rust.

lance0
โญ 591 Rust ๐Ÿ‘ค lance0 User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2026-01-31
174
Aixio-AI/aixio-layer-v2

Aixio Layer v2 recovers editable layers from flat designs where possible. 150-design benchmark vs Canva Magic Layers, Qwen-Image-Layer and GPT-6 Astra Ultra.

Aixio-AI
โญ 589 ๐Ÿ‘ค Aixio-AI Organization ๐Ÿ• Updated 2026-10-09 ๐Ÿ“… Created 2026-10-09
175
facebookresearch/meta-agents-research-environments

Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike static benchmarks, this platform introduces evolving environments where agents must adapt their strategies as new information becomes available, mirroring real-world challenges.

facebookresearch
โญ 581 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2026-09-30 ๐Ÿ“… Created 2025-09-11
176
lnx-search/rewrk

A more modern http framework benchmarker supporting HTTP/1 and HTTP/2 benchmarks.

lnx-search
โญ 570 Rust ๐Ÿ‘ค lnx-search Organization ๐Ÿ• Updated 2024-03-25 ๐Ÿ“… Created 2021-01-19
177
p-ranav/alpaca

Serialization library written in C++17 - Pack C++ structs into a compact byte-array without any macros or boilerplate code

p-ranav
โญ 564 C++ ๐Ÿ‘ค p-ranav User ๐Ÿ• Updated 2026-10-30 ๐Ÿ“… Created 2022-08-20
178
frol/completely-unscientific-benchmarks

Naive performance comparison of a few programming languages (JavaScript, Kotlin, Rust, Swift, Nim, Python, Go, Haskell, D, C++, Java, C#, Object Pascal, Ada, Lua, Ruby)

frol
โญ 557 C++ ๐Ÿ‘ค frol User ๐Ÿ• Updated 2026-07-02 ๐Ÿ“… Created 2018-05-12
179
turkaysoft/glow

Advanced System Analysis Software

turkaysoft
โญ 555 C# ๐Ÿ‘ค turkaysoft User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-10-04
180
SpeechColab/Leaderboard

SpeechIO Leaderboard: a large, robust, comprehensive, benchmarking platform for Automatic Speech Recognition.

SpeechColab
โญ 545 Python ๐Ÿ‘ค SpeechColab User ๐Ÿ• Updated 2025-03-29 ๐Ÿ“… Created 2021-02-07
181
petabridge/NBench

Performance benchmarking and testing framework for .NET applications :chart_with_upwards_trend:

petabridge
โญ 541 C# ๐Ÿ‘ค petabridge Organization ๐Ÿ• Updated 2024-09-10 ๐Ÿ“… Created 2015-11-02
182
krrishnarraj/clpeak

Peak compute, memory bandwidth and latency of CPUs, GPUs and NPUs: the same tests through every API that reaches a device. Command line and app for Windows, macOS, Linux and Android

krrishnarraj
โญ 540 C++ ๐Ÿ‘ค krrishnarraj User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2013-08-25
183
hank-whu/rpc-benchmark

Java RPC benchmark, inspired by https://www.techempower.com/benchmarks/

hank-whu
โญ 531 Java ๐Ÿ‘ค hank-whu User ๐Ÿ• Updated 2024-04-08 ๐Ÿ“… Created 2017-12-23
184
glmark2/glmark2

glmark2 is an OpenGL 2.0 and ES 2.0 benchmark.

glmark2
โญ 530 C ๐Ÿ‘ค glmark2 Organization ๐Ÿ• Updated 2025-09-29 ๐Ÿ“… Created 2014-02-11
185
v8/web-tooling-benchmark

JavaScript benchmark for common web developer workloads

v8
โญ 526 JavaScript ๐Ÿ‘ค v8 Organization ๐Ÿ• Updated 2026-06-08 ๐Ÿ“… Created 2017-10-18
186
GraphRAG-Bench/GraphRAG-Benchmark

The official repo of GraphRAG-Bench for evaluating GraphRAG models. "When to use Graphs in RAG: A Comprehensive Analysis for Graph Retrieval-Augmented Generation". (ICLR'26)

GraphRAG-Bench
โญ 525 Python ๐Ÿ‘ค GraphRAG-Bench User ๐Ÿ• Updated 2026-06-07 ๐Ÿ“… Created 2025-06-09
187
THUDM/LongCite

LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

THUDM
โญ 516 Python ๐Ÿ‘ค THUDM Organization ๐Ÿ• Updated 2024-12-31 ๐Ÿ“… Created 2024-08-31
188
bigcode-project/bigcodebench

[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI

bigcode-project
โญ 515 Python ๐Ÿ‘ค bigcode-project Organization ๐Ÿ• Updated 2026-01-03 ๐Ÿ“… Created 2024-04-29
189
basveeling/pcam

The PatchCamelyon (PCam) deep learning classification benchmark.

basveeling
โญ 514 Python ๐Ÿ‘ค basveeling User ๐Ÿ• Updated 2024-01-31 ๐Ÿ“… Created 2018-05-28
190
alexklwong/awesome-state-of-depth-completion

Current state of supervised and unsupervised depth completion methods

alexklwong
โญ 513 ๐Ÿ‘ค alexklwong User ๐Ÿ• Updated 2025-03-16 ๐Ÿ“… Created 2020-03-10
191
Chengjun023/agent-smith

Token overruns? Better call Smith! Better Call Smith. Adaptive model routing, a glassy Codex usage monitor, and reproducible benchmarks with receipts.

Chengjun023
โญ 510 Python ๐Ÿ‘ค Chengjun023 User ๐Ÿ• Updated 2026-10-01 ๐Ÿ“… Created 2026-09-30
192
agent-next/polymarket-paper-trader

Paper trading simulator for Polymarket

agent-next
โญ 509 Python ๐Ÿ‘ค agent-next Organization ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2026-03-01
193
SeekingDream/Static-to-Dynamic-LLMEval

The official GitHub repository of the paper "Recent advances in large language model benchmarks against data contamination: From static to dynamic evaluation"

SeekingDream
โญ 500 ๐Ÿ‘ค SeekingDream User ๐Ÿ• Updated 2026-09-28 ๐Ÿ“… Created 2025-02-21