Git Stars Git Stars

#benchmark Repositories

193
Total Repositories
392,395
Total Stars
2,033
Avg Stars/Repo
51
Elanis/web-to-desktop-framework-comparison

An objective comparison of multiple frameworks that allow us to "transform" our web apps to desktop applications.

Elanis
โญ 2,007 JavaScript ๐Ÿ‘ค Elanis User ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2021-03-09
52
logpai/logparser

A machine learning toolkit for log parsing [ICSE'19, DSN'16]

logpai
โญ 1,977 Python ๐Ÿ‘ค logpai Organization ๐Ÿ• Updated 2025-06-10 ๐Ÿ“… Created 2015-08-05
53
benchflow-ai/skillsbench

SkillsBench evaluates how well skills work and how effective agents are at using them.

benchflow-ai
โญ 1,930 PDDL ๐Ÿ‘ค benchflow-ai Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2025-12-29
54
ashvardanian/less_slow.cpp

Playing around "Less Slow" coding practices in C++ 20, C, CUDA, PTX, & Assembly, from numerics & SIMD to coroutines, ranges, exception handling, networking and user-space IO

ashvardanian
โญ 1,929 C++ ๐Ÿ‘ค ashvardanian User ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2022-03-03
55
hotpath-rs/hotpath

Rust profiler for CPU, memory, SQL, HTTP, and async performance, with Prometheus and Grafana support.

hotpath-rs
โญ 1,928 Rust ๐Ÿ‘ค hotpath-rs Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-09-05
56
Lifelong-Robot-Learning/LIBERO

Benchmarking Knowledge Transfer in Lifelong Robot Learning

Lifelong-Robot-Learning
โญ 1,893 Jupyter Notebook ๐Ÿ‘ค Lifelong-Robot-Learning Organization ๐Ÿ• Updated 2025-03-15 ๐Ÿ“… Created 2023-04-08
58
Vchitect/VBench

[CVPR2024 Highlight] VBench - We Evaluate Video Generation

Vchitect
โญ 1,850 Python ๐Ÿ‘ค Vchitect Organization ๐Ÿ• Updated 2026-08-21 ๐Ÿ“… Created 2023-11-27
59
cyweb/hammer

Hammer DDos Script - Python 3

cyweb
โญ 1,826 Python ๐Ÿ‘ค cyweb User ๐Ÿ• Updated 2025-08-01 ๐Ÿ“… Created 2014-02-06
60
evalplus/evalplus

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024

evalplus
โญ 1,822 Python ๐Ÿ‘ค evalplus Organization ๐Ÿ• Updated 2025-10-02 ๐Ÿ“… Created 2023-04-15
61
StanfordVL/BEHAVIOR-1K

BEHAVIOR-1K: a platform for accelerating Embodied AI research. Join our Discord for support: https://discord.gg/bccR5vGFEx

StanfordVL
โญ 1,804 Python ๐Ÿ‘ค StanfordVL Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2021-12-17
62
mlcommons/training

Reference implementations of MLPerfยฎ training benchmarks

mlcommons
โญ 1,779 Python ๐Ÿ‘ค mlcommons Organization ๐Ÿ• Updated 2026-10-27 ๐Ÿ“… Created 2018-03-29
63
IntelLabs/fastRAG

Efficient Retrieval Augmentation and Generation Framework

IntelLabs
โญ 1,758 Python ๐Ÿ‘ค IntelLabs Organization ๐Ÿ• Updated 2025-01-09 ๐Ÿ“… Created 2023-01-23
64
martinus/nanobench

Simple, fast, accurate single-header microbenchmarking functionality for C++11/14/17/20

martinus
โญ 1,751 C++ ๐Ÿ‘ค martinus User ๐Ÿ• Updated 2026-09-07 ๐Ÿ“… Created 2019-10-05
65
sunlabuiuc/PyHealth

A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals, and imaging. 30+ models, reproducible pipelines.

sunlabuiuc
โญ 1,704 Python ๐Ÿ‘ค sunlabuiuc Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-08-03
66
mlcommons/inference

Reference implementations of MLPerfยฎ inference benchmarks

mlcommons
โญ 1,659 Python ๐Ÿ‘ค mlcommons Organization ๐Ÿ• Updated 2026-11-06 ๐Ÿ“… Created 2018-09-13
67
Farama-Foundation/D4RL

A collection of reference environments for offline reinforcement learning

Farama-Foundation
โญ 1,627 Python ๐Ÿ‘ค Farama-Foundation Organization ๐Ÿ• Updated 2024-11-18 ๐Ÿ“… Created 2020-04-12
68
MLGroupJLU/LLM-eval-survey

The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".

MLGroupJLU
โญ 1,615 ๐Ÿ‘ค MLGroupJLU User ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-07-02
69
facebookresearch/DomainBed

DomainBed is a suite to test domain generalization algorithms

facebookresearch
โญ 1,596 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2025-12-16 ๐Ÿ“… Created 2020-06-29
70
cheind/py-motmetrics

:bar_chart: Benchmark multiple object trackers (MOT) in Python

cheind
โญ 1,484 Python ๐Ÿ‘ค cheind User ๐Ÿ• Updated 2026-07-17 ๐Ÿ“… Created 2017-04-07
71
OpenGenerativeAI/llm-colosseum

Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM

OpenGenerativeAI
โญ 1,483 Jupyter Notebook ๐Ÿ‘ค OpenGenerativeAI Organization ๐Ÿ• Updated 2025-03-21 ๐Ÿ“… Created 2024-03-23
72
nvzqz/divan

Fast and simple benchmarking for Rust projects

nvzqz
โญ 1,468 Rust ๐Ÿ‘ค nvzqz User ๐Ÿ• Updated 2026-07-19 ๐Ÿ“… Created 2023-06-30
73
ionelmc/pytest-benchmark

pytest fixture for benchmarking code

ionelmc
โญ 1,459 Python ๐Ÿ‘ค ionelmc User ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2014-10-10
74
dadhi/FastExpressionCompiler

Fast Compiler for C# Expression Trees and the lightweight LightExpression alternative. Diagnostic and code generation tools for the expressions.

dadhi
โญ 1,379 C# ๐Ÿ‘ค dadhi User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2016-07-15
โญ 1,375 Python ๐Ÿ‘ค openai Organization ๐Ÿ• Updated 2024-01-21 ๐Ÿ“… Created 2021-10-20
76
MedMNIST/MedMNIST

[pip install medmnist] 18 Standardized Datasets for 2D and 3D Biomedical Image Classification

MedMNIST
โญ 1,367 Python ๐Ÿ‘ค MedMNIST Organization ๐Ÿ• Updated 2025-01-11 ๐Ÿ“… Created 2020-10-25
77
kengz/SLM-Lab

Modular Deep Reinforcement Learning framework in PyTorch. Companion library of the book "Foundations of Deep Reinforcement Learning".

kengz
โญ 1,366 Python ๐Ÿ‘ค kengz User ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2017-10-02
78
zzli2022/Awesome-System2-Reasoning-LLM

Latest Advances on System-2 Reasoning

zzli2022
โญ 1,351 Python ๐Ÿ‘ค zzli2022 User ๐Ÿ• Updated 2025-06-08 ๐Ÿ“… Created 2025-02-09
79
ScalingIntelligence/KernelBench

KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)

ScalingIntelligence
โญ 1,336 Jupyter Notebook ๐Ÿ‘ค ScalingIntelligence Organization ๐Ÿ• Updated 2026-03-24 ๐Ÿ“… Created 2024-10-25
80
TIGER-AI-Lab/ClawBench

Open-source benchmark for browser AI agents on daily tasks.

TIGER-AI-Lab
โญ 1,325 Python ๐Ÿ‘ค TIGER-AI-Lab Organization ๐Ÿ• Updated 2026-11-05 ๐Ÿ“… Created 2026-04-10
81
oxwhirl/smac

SMAC: The StarCraft Multi-Agent Challenge

oxwhirl
โญ 1,300 Python ๐Ÿ‘ค oxwhirl Organization ๐Ÿ• Updated 2024-02-18 ๐Ÿ“… Created 2019-01-08
82
stair-lab/kg-gen

[NeurIPS '25] Knowledge Graph Generation from Any Text

stair-lab
โญ 1,297 Python ๐Ÿ‘ค stair-lab Organization ๐Ÿ• Updated 2026-03-24 ๐Ÿ“… Created 2024-10-30
83
benchmark-action/github-action-benchmark

GitHub Action for continuous benchmarking to keep performance

benchmark-action
โญ 1,273 TypeScript ๐Ÿ‘ค benchmark-action Organization ๐Ÿ• Updated 2026-09-15 ๐Ÿ“… Created 2019-11-05
84
chunxiaoxx/nautilus-compass

Open memory and reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) โ€” by Nautilus Platform

chunxiaoxx
โญ 1,260 Python ๐Ÿ‘ค chunxiaoxx User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-04-27
85
myzhan/boomer

A better load generator for locust, written in golang.

myzhan
โญ 1,238 Go ๐Ÿ‘ค myzhan User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2016-02-18
86
pdebench/PDEBench

PDEBench: An Extensive Benchmark for Scientific Machine Learning

pdebench
โญ 1,233 Python ๐Ÿ‘ค pdebench Organization ๐Ÿ• Updated 2026-03-30 ๐Ÿ“… Created 2022-06-02
87
yfzhang114/Awesome-Multimodal-Large-Language-Models

Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models

yfzhang114
โญ 1,211 ๐Ÿ‘ค yfzhang114 User ๐Ÿ• Updated 2026-11-07 ๐Ÿ“… Created 2024-03-30
88
zilliztech/VectorDBBench

Benchmark for vector databases.

zilliztech
โญ 1,201 Python ๐Ÿ‘ค zilliztech Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-05-10
89
haydenjames/bench-scripts

A compilation of Linux server benchmarking scripts.

haydenjames
โญ 1,190 ๐Ÿ‘ค haydenjames User ๐Ÿ• Updated 2024-07-01 ๐Ÿ“… Created 2017-10-31
90
THUDM/LongBench

LongBench v2 and LongBench (ACL 25'&24')

THUDM
โญ 1,182 Python ๐Ÿ‘ค THUDM Organization ๐Ÿ• Updated 2025-01-15 ๐Ÿ“… Created 2023-07-29
91
ClickHouse/ClickBench

ClickBench: a Benchmark For Analytical Databases

ClickHouse
โญ 1,171 Shell ๐Ÿ‘ค ClickHouse Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-07-11
92
flow-project/flow

Computational framework for reinforcement learning in traffic control

flow-project
โญ 1,171 Python ๐Ÿ‘ค flow-project Organization ๐Ÿ• Updated 2024-07-27 ๐Ÿ“… Created 2017-08-24
93
chengtan9907/OpenSTL

OpenSTL: A Comprehensive Benchmark of Spatio-Temporal Predictive Learning

chengtan9907
โญ 1,165 Python ๐Ÿ‘ค chengtan9907 User ๐Ÿ• Updated 2026-03-01 ๐Ÿ“… Created 2022-07-27
94
opencv/opencv_zoo

Model Zoo For OpenCV DNN and Benchmarks.

opencv
โญ 1,140 Python ๐Ÿ‘ค opencv Organization ๐Ÿ• Updated 2026-10-20 ๐Ÿ“… Created 2021-07-29
95
xinxuxin/keystone-bench

A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.

xinxuxin
โญ 1,130 Python ๐Ÿ‘ค xinxuxin User ๐Ÿ• Updated 2026-10-19 ๐Ÿ“… Created 2026-09-07
96
kimwalisch/primesieve

๐Ÿš€ Fast prime number generator

kimwalisch
โญ 1,129 C++ ๐Ÿ‘ค kimwalisch User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2013-09-24
97
PKU-Alignment/omnisafe

JMLR: OmniSafe is an infrastructural framework for accelerating SafeRL research.

PKU-Alignment
โญ 1,122 Python ๐Ÿ‘ค PKU-Alignment Organization ๐Ÿ• Updated 2025-03-17 ๐Ÿ“… Created 2022-11-19
98
facebookresearch/co3d

Tooling for the Common Objects In 3D dataset.

facebookresearch
โญ 1,112 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2024-08-14 ๐Ÿ“… Created 2021-06-21
99
inikep/lzbench

lzbench is an in-memory benchmark of open-source compressors

inikep
โญ 1,102 C ๐Ÿ‘ค inikep User ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2015-10-31
100
ethz-spylab/agentdojo

A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.

ethz-spylab
โญ 1,062 Python ๐Ÿ‘ค ethz-spylab Organization ๐Ÿ• Updated 2026-06-02 ๐Ÿ“… Created 2024-02-29