#benchmarking Repositories
95 repositories total
collection of various resources devoted to performance and input lag optimization
3D LiDAR SLAM for point cloud map authoring, benchmarking, and Autoware-compatible map workflows.
[ICLR 2025 Oral] Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows
A collection of simple Elixir scripts that are using Mix.install/2.
Web Codegen Scorer is a tool for evaluating the quality of web code generated by LLMs.
This repo contains benchmarks used for testing the performance of all .NET Runtimes
Configurable Generation of Synthetic Schemas and Knowledge Graphs at Your Fingertips
Diffusion Model-Based Image Editing: A Survey (TPAMI 2025)
[Pedestron] Generalizable Pedestrian Detection: The Elephant In The Room. @ CVPR2021
Fast function to parse strings into double (binary64) floating-point values, enforces the RFC 7159 (JSON standard) grammar: 4x faster than strtod
Collective Knowledge (CK), Collective Mind (CM/CMX) and MLPerf automations: community-driven projects to learn how to run AI, ML, and other emerging workloads more efficiently and cost-effectively across diverse models, datasets, software, and hardware using MLPerf methodology and benchmarks.
Industrial-first evaluation benchmark for LLMs in the DevOps/AIOps domain.
Test domestic Docker registry image | View test results on the Actions tab details page
MCP-Universe is a comprehensive framework designed for RL training, benchmarking, and developing AI agents for general tool-use.
SpeechIO Leaderboard: a large, robust, comprehensive, benchmarking platform for Automatic Speech Recognition.
[EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627