Git Stars Git Stars

#machine-learning-evaluation Repositories

Discover 10 active open source GitHub repositories tagged with #machine-learning-evaluation, accumulating 11,993 total stars (averaging 1,199 stars per project). Leading this topic is stanford-crfm/helm with 2,975 stars.

10
Total Repositories
11,993
Total Stars
1,199
Avg Stars/Repo
Programming Languages: Python Jupyter Notebook
1
stanford-crfm/helm

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

stanford-crfm
โญ 2,975 Python ๐Ÿ‘ค stanford-crfm Organization ๐Ÿ• Updated 2026-09-01 ๐Ÿ“… Created 2021-11-29
2
numenta/NAB

The Numenta Anomaly Benchmark

numenta
โญ 2,062 Jupyter Notebook ๐Ÿ‘ค numenta Organization ๐Ÿ• Updated 2024-12-03 ๐Ÿ“… Created 2014-05-06
3
tensorflow/model-analysis

Model analysis tools for TensorFlow

tensorflow
โญ 1,271 Python ๐Ÿ‘ค tensorflow Organization ๐Ÿ• Updated 2026-08-14 ๐Ÿ“… Created 2018-03-23
4
bigcode-project/bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.

bigcode-project
โญ 1,054 Python ๐Ÿ‘ค bigcode-project Organization ๐Ÿ• Updated 2025-07-22 ๐Ÿ“… Created 2022-08-09
5
NannyML/The-Little-Book-of-ML-Metrics

The book every data scientist needs on their desk.

NannyML
โญ 1,014 Jupyter Notebook ๐Ÿ‘ค NannyML Organization ๐Ÿ• Updated 2026-10-17 ๐Ÿ“… Created 2024-07-23
6
tensorflow/gan

Tooling for GANs in TensorFlow

tensorflow
โญ 966 Jupyter Notebook ๐Ÿ‘ค tensorflow Organization ๐Ÿ• Updated 2025-01-16 ๐Ÿ“… Created 2019-04-29
7
stanford-futuredata/ARES

Automated Evaluation of RAG Systems

stanford-futuredata
โญ 711 Python ๐Ÿ‘ค stanford-futuredata Organization ๐Ÿ• Updated 2025-03-28 ๐Ÿ“… Created 2023-09-27
8
syncora-ai/syncora-benchmarks

A lightweight, plugโ€‘andโ€‘play benchmark kit for synthetic data. Compare Syncora against other generators (e.g., Gretel, MostlyAI) by dropping in CSVs, then autoโ€‘compute fidelity and similarity metrics. Works with any dataset via simple file naming no heavy setup needed.

syncora-ai
โญ 678 Jupyter Notebook ๐Ÿ‘ค syncora-ai User ๐Ÿ• Updated 2025-08-11 ๐Ÿ“… Created 2025-07-31
9
HazyResearch/legalbench

An open science effort to benchmark legal reasoning in foundation models

HazyResearch
โญ 663 Python ๐Ÿ‘ค HazyResearch Organization ๐Ÿ• Updated 2026-03-30 ๐Ÿ“… Created 2022-08-19
10
CSHaitao/Awesome-LLMs-as-Judges

The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.

CSHaitao
โญ 600 ๐Ÿ‘ค CSHaitao User ๐Ÿ• Updated 2025-07-29 ๐Ÿ“… Created 2024-11-10

Frequently Asked Questions

1

What is the most popular #machine-learning-evaluation repository on GitHub?

The top ranked open source #machine-learning-evaluation project on GitHub is stanford-crfm/helm with 2,975 stars. Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

2

Which programming languages are most used in #machine-learning-evaluation repositories?

Among the top ranked #machine-learning-evaluation projects on GitHub, the most common programming languages are Python, Jupyter Notebook.

3

How is the #machine-learning-evaluation repository ranking calculated?

We track 10 active open source repositories tagged with #machine-learning-evaluation (500+ stars), totaling 11,993 stars with an average of 1,199 stars per repository. Rankings update daily from the GitHub API.