Git Stars Git Stars

#benchmark Repositories

193
Total Repositories
392,395
Total Stars
2,033
Avg Stars/Repo
101
pytorch/benchmark

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.

pytorch
โญ 1,056 Python ๐Ÿ‘ค pytorch Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2017-05-26
102
redis/memtier_benchmark

NoSQL Redis and Memcache traffic generation and benchmarking tool.

redis
โญ 1,054 Python ๐Ÿ‘ค redis Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2013-06-27
103
python/pyperformance

Python Performance Benchmark Suite

python
โญ 1,044 Python ๐Ÿ‘ค python Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2016-08-17
104
Minqi824/ADBench

Official Implement of "ADBench: Anomaly Detection Benchmark", NeurIPS 2022.

Minqi824
โญ 1,029 Python ๐Ÿ‘ค Minqi824 User ๐Ÿ• Updated 2026-01-08 ๐Ÿ“… Created 2022-06-05
105
airspeed-velocity/asv

Airspeed Velocity: A simple Python benchmarking tool with web-based reporting

airspeed-velocity
โญ 1,023 Python ๐Ÿ‘ค airspeed-velocity Organization ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2013-11-07
106
Tiger3807861189/GLM-5.3-Flash-J-Space-Capability-Realization-Report

GLM-5.3-Flash ร— J-Space Capability Realization โ€” Benchmark Presentation of the J-Space Cognition Suite

Tiger3807861189
โญ 1,016 ๐Ÿ‘ค Tiger3807861189 User ๐Ÿ• Updated 2026-09-05 ๐Ÿ“… Created 2026-08-16
107
kubernetes/perf-tests

Performance tests and benchmarks

kubernetes
โญ 992 Go ๐Ÿ‘ค kubernetes Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2016-09-21
108
zhyever/Monocular-Depth-Estimation-Toolbox

Monocular Depth Estimation Toolbox based on MMSegmentation.

zhyever
โญ 970 Python ๐Ÿ‘ค zhyever User ๐Ÿ• Updated 2025-07-21 ๐Ÿ“… Created 2022-03-11
109
XiandaGuo/OpenStereo

OpenStereo: A Comprehensive Benchmark for Stereo Matching

XiandaGuo
โญ 960 Python ๐Ÿ‘ค XiandaGuo User ๐Ÿ• Updated 2026-08-13 ๐Ÿ“… Created 2023-03-20
110
NVIDIA/nvbench

CUDA Kernel Benchmarking Library

NVIDIA
โญ 952 Cuda ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2021-03-03
111
RoboDojo-Benchmark/RoboDojo

Official repository for RoboDojo

RoboDojo-Benchmark
โญ 943 Python ๐Ÿ‘ค RoboDojo-Benchmark Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-07-07
112
molecularsets/moses

Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Models

molecularsets
โญ 943 Python ๐Ÿ‘ค molecularsets Organization ๐Ÿ• Updated 2024-07-08 ๐Ÿ“… Created 2018-11-28
113
LesnyRumcajs/grpc_bench

Various gRPC benchmarks

LesnyRumcajs
โญ 941 Dockerfile ๐Ÿ‘ค LesnyRumcajs User ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2020-07-16
114
ohler55/agoo

A High Performance HTTP Server for Ruby

ohler55
โญ 934 C ๐Ÿ‘ค ohler55 User ๐Ÿ• Updated 2026-05-09 ๐Ÿ“… Created 2017-12-22
115
bencherdev/bencher

๐Ÿฐ Bencher - Continuous Benchmarking

bencherdev
โญ 933 Rust ๐Ÿ‘ค bencherdev Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-07-25
116
ai4co/rl4co

A PyTorch library for all things Reinforcement Learning (RL) for Combinatorial Optimization (CO)

ai4co
โญ 924 Python ๐Ÿ‘ค ai4co Organization ๐Ÿ• Updated 2026-09-14 ๐Ÿ“… Created 2023-02-23
117
VibeBench/VibeSearchBench

๐Ÿ” The hardest search benchmark in the wild โ€” vague, multi-turn, proactive. 200 long-horizon tasks with persona-driven progressive disclosure, scored by verifiable schema-free knowledge-graph evaluation. No vibes, just triplet F1.

VibeBench
โญ 915 Python ๐Ÿ‘ค VibeBench Organization ๐Ÿ• Updated 2026-05-28 ๐Ÿ“… Created 2026-05-20
118
chaitin/blazehttp

BlazeHTTP is a simple and easy-to-use WAF protection efficacy test tool. BlazeHTTP stands as a user-friendly WAF protection efficacy evaluation tool.

chaitin
โญ 910 Go ๐Ÿ‘ค chaitin Organization ๐Ÿ• Updated 2024-07-01 ๐Ÿ“… Created 2023-05-10
119
dvassallo/s3-benchmark

Measure Amazon S3's performance from any location.

dvassallo
โญ 907 Go ๐Ÿ‘ค dvassallo User ๐Ÿ• Updated 2024-01-19 ๐Ÿ“… Created 2019-04-02
120
keli-wen/agy-staff

Hire Google's Antigravity CLI (agy) as a fast Gemini staffer for Claude Code, OpenAI Codex, and DeepSeek Harness.

keli-wen
โญ 905 JavaScript ๐Ÿ‘ค keli-wen User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-08-18
121
xlang-ai/OpenCUA

[NeurIPS 2025 Spotlight] OpenCUA: Open Foundations for Computer-Use Agents

xlang-ai
โญ 877 Python ๐Ÿ‘ค xlang-ai Organization ๐Ÿ• Updated 2026-05-25 ๐Ÿ“… Created 2025-06-21
122
Purewhiter/mobilegym

[EMNLP 2026] MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research ยท Browser-hosted Android Simulator ยท Verifiable Evaluation ยท Scalable Online RL Training

Purewhiter
โญ 872 Python ๐Ÿ‘ค Purewhiter User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-05-14
123
DigitalInBlue/Celero

C++ Benchmark Authoring Library/Framework

DigitalInBlue
โญ 865 C++ ๐Ÿ‘ค DigitalInBlue User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2013-01-11
124
Ayanami0730/deep_research_bench

DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents

Ayanami0730
โญ 853 Python ๐Ÿ‘ค Ayanami0730 User ๐Ÿ• Updated 2026-09-29 ๐Ÿ“… Created 2025-06-13
125
moltar/typescript-runtime-type-benchmarks

๐Ÿ“Š Benchmark Comparison of Packages with Runtime Validation and TypeScript Support

moltar
โญ 837 TypeScript ๐Ÿ‘ค moltar User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2019-09-23
126
koaning/human-learn

Natural Intelligence is still a pretty good idea.

koaning
โญ 833 Jupyter Notebook ๐Ÿ‘ค koaning User ๐Ÿ• Updated 2026-03-09 ๐Ÿ“… Created 2020-07-11
127
suyoumo/ClawProBench

ClawProBench is a live-first benchmark harness for evaluating LLM agents in the OpenClaw runtime with deterministic grading and repeated-trial reliability.

suyoumo
โญ 829 Rust ๐Ÿ‘ค suyoumo User ๐Ÿ• Updated 2026-08-25 ๐Ÿ“… Created 2025-03-02
128
minio/warp

S3 benchmarking tool

minio
โญ 827 Go ๐Ÿ‘ค minio Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2019-09-19
129
TheAgentCompany/TheAgentCompany

An agent benchmark with tasks in a simulated software company.

TheAgentCompany
โญ 819 Python ๐Ÿ‘ค TheAgentCompany Organization ๐Ÿ• Updated 2025-11-17 ๐Ÿ“… Created 2024-03-11
130
hanabi1224/Programming-Language-Benchmarks

Yet another implementation of computer language benchmarks game

hanabi1224
โญ 802 C# ๐Ÿ‘ค hanabi1224 User ๐Ÿ• Updated 2025-07-31 ๐Ÿ“… Created 2021-01-27
131
TPC-Council/HammerDB

HammerDB: The industry standard open-source database benchmark

TPC-Council
โญ 799 Tcl ๐Ÿ‘ค TPC-Council Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2018-11-27
132
google-research/meta-dataset

A dataset of datasets for learning to learn from few examples

google-research
โญ 796 Jupyter Notebook ๐Ÿ‘ค google-research Organization ๐Ÿ• Updated 2024-05-24 ๐Ÿ“… Created 2019-03-05
133
maxim-saplin/CrossPlatformDiskTest

Windows, macOS and Android storage (HDD, SSD, RAM) speed testing/performance benchmarking app

maxim-saplin
โญ 796 C# ๐Ÿ‘ค maxim-saplin User ๐Ÿ• Updated 2024-09-12 ๐Ÿ“… Created 2018-09-30
134
sbt/sbt-jmh

"Trust no one, bench everything." - sbt plugin for JMH (Java Microbenchmark Harness)

sbt
โญ 796 Scala ๐Ÿ‘ค sbt Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2014-05-19
135
RobustBench/robustbench

RobustBench: a standardized adversarial robustness benchmark [NeurIPS 2021 Benchmarks and Datasets Track]

RobustBench
โญ 792 Python ๐Ÿ‘ค RobustBench Organization ๐Ÿ• Updated 2026-04-14 ๐Ÿ“… Created 2020-06-19
โญ 788 Python ๐Ÿ‘ค carlosferrazza User ๐Ÿ• Updated 2025-09-18 ๐Ÿ“… Created 2024-03-18
137
robocurve/inspect-robots

Open source evals for physical AI. Run any LLM/VLA on any arm/humanoid against any real/sim benchmark.

robocurve
โญ 776 Python ๐Ÿ‘ค robocurve Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2026-06-26
138
linkxzhou/http_bench

golang HTTP stress testing tool, support single and distributed, http/1, http/2 and http/3.

linkxzhou
โญ 757 Go ๐Ÿ‘ค linkxzhou User ๐Ÿ• Updated 2026-10-21 ๐Ÿ“… Created 2018-07-02
139
ModelTC/LightCompress

[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.

ModelTC
โญ 755 Python ๐Ÿ‘ค ModelTC Organization ๐Ÿ• Updated 2026-05-14 ๐Ÿ“… Created 2024-03-06
140
niklas-heer/speed-comparison

Single-threaded Leibniz ฯ€ microbenchmark across 75 implementations, with the source, pinned toolchain, and raw samples behind every timing.

niklas-heer
โญ 753 Python ๐Ÿ‘ค niklas-heer User ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2018-02-17
141
utsuboco/r3f-perf

Easily monitor your ThreeJS performances.

utsuboco
โญ 750 TypeScript ๐Ÿ‘ค utsuboco Organization ๐Ÿ• Updated 2024-12-20 ๐Ÿ“… Created 2021-01-01
142
klen/py-frameworks-bench

Another benchmark for some python frameworks

klen
โญ 720 Python ๐Ÿ‘ค klen User ๐Ÿ• Updated 2024-05-11 ๐Ÿ“… Created 2015-04-30
143
with-pebbly/aseprite-ai-artist

Your coding agent paints pixel art in the Aseprite window you already have open. MCP server + skills for Claude Code, omp, Codex, Gemini CLI and Cursor โ€” draws, looks at its work, animates and exports. Gallery and benchmark: pixeli.pebbly.space

with-pebbly
โญ 718 TypeScript ๐Ÿ‘ค with-pebbly Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2026-09-08
144
GoodStartLabs/AI_Diplomacy

Frontier Models playing the board game Diplomacy.

GoodStartLabs
โญ 716 Python ๐Ÿ‘ค GoodStartLabs Organization ๐Ÿ• Updated 2026-06-01 ๐Ÿ“… Created 2025-02-06
145
networknt/microservices-framework-benchmark

Raw benchmarks on throughput, latency and transfer of Hello World on popular microservices frameworks

networknt
โญ 716 C++ ๐Ÿ‘ค networknt Organization ๐Ÿ• Updated 2026-09-18 ๐Ÿ“… Created 2017-01-28
146
hyperledger-caliper/caliper

A blockchain benchmark framework to measure performance of multiple blockchain solutions https://wiki.hyperledger.org/display/caliper

hyperledger-caliper
โญ 708 JavaScript ๐Ÿ‘ค hyperledger-caliper Organization ๐Ÿ• Updated 2026-06-16 ๐Ÿ“… Created 2018-03-20
147
EverMind-AI/SkillCorpus

Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corporaโ€”with retrieval and evaluation tooling included.

EverMind-AI
โญ 706 Python ๐Ÿ‘ค EverMind-AI Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-08-11
148
TIGER-AI-Lab/VLM2Vec

This repo contains the code for "VLM2Vec / MMEB" [ICLR 2025], "VLM2Vec-V2 / MMEB-V2" [TMLR 2026], and "MMEB-V3" [COLM 2026]

TIGER-AI-Lab
โญ 705 Python ๐Ÿ‘ค TIGER-AI-Lab Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2024-10-07
149
google-deepmind/long-form-factuality

Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".

google-deepmind
โญ 698 Python ๐Ÿ‘ค google-deepmind Organization ๐Ÿ• Updated 2026-06-18 ๐Ÿ“… Created 2024-03-25
150
ucas-vg/PointTinyBenchmark

Point based and tiny object detection and localization code set of UCAS-VG

ucas-vg
โญ 689 Python ๐Ÿ‘ค ucas-vg Organization ๐Ÿ• Updated 2025-06-12 ๐Ÿ“… Created 2019-12-21