#benchmark Repositories
193 repositories total
TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.
Airspeed Velocity: A simple Python benchmarking tool with web-based reporting
GLM-5.3-Flash ร J-Space Capability Realization โ Benchmark Presentation of the J-Space Cognition Suite
Monocular Depth Estimation Toolbox based on MMSegmentation.
Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Models
A PyTorch library for all things Reinforcement Learning (RL) for Combinatorial Optimization (CO)
๐ The hardest search benchmark in the wild โ vague, multi-turn, proactive. 200 long-horizon tasks with persona-driven progressive disclosure, scored by verifiable schema-free knowledge-graph evaluation. No vibes, just triplet F1.
BlazeHTTP is a simple and easy-to-use WAF protection efficacy test tool. BlazeHTTP stands as a user-friendly WAF protection efficacy evaluation tool.
Hire Google's Antigravity CLI (agy) as a fast Gemini staffer for Claude Code, OpenAI Codex, and DeepSeek Harness.
[EMNLP 2026] MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research ยท Browser-hosted Android Simulator ยท Verifiable Evaluation ยท Scalable Online RL Training
DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents
๐ Benchmark Comparison of Packages with Runtime Validation and TypeScript Support
ClawProBench is a live-first benchmark harness for evaluating LLM agents in the OpenClaw runtime with deterministic grading and repeated-trial reliability.
Yet another implementation of computer language benchmarks game
Windows, macOS and Android storage (HDD, SSD, RAM) speed testing/performance benchmarking app
"Trust no one, bench everything." - sbt plugin for JMH (Java Microbenchmark Harness)
RobustBench: a standardized adversarial robustness benchmark [NeurIPS 2021 Benchmarks and Datasets Track]
Open source evals for physical AI. Run any LLM/VLA on any arm/humanoid against any real/sim benchmark.
golang HTTP stress testing tool, support single and distributed, http/1, http/2 and http/3.
[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.
Single-threaded Leibniz ฯ microbenchmark across 75 implementations, with the source, pinned toolchain, and raw samples behind every timing.
Your coding agent paints pixel art in the Aseprite window you already have open. MCP server + skills for Claude Code, omp, Codex, Gemini CLI and Cursor โ draws, looks at its work, animates and exports. Gallery and benchmark: pixeli.pebbly.space
Raw benchmarks on throughput, latency and transfer of Hello World on popular microservices frameworks
A blockchain benchmark framework to measure performance of multiple blockchain solutions https://wiki.hyperledger.org/display/caliper
Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corporaโwith retrieval and evaluation tooling included.
This repo contains the code for "VLM2Vec / MMEB" [ICLR 2025], "VLM2Vec-V2 / MMEB-V2" [TMLR 2026], and "MMEB-V3" [COLM 2026]
Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".
Point based and tiny object detection and localization code set of UCAS-VG