Git Stars Git Stars

#model-evaluation Repositories

Discover 37 active open source GitHub repositories tagged with #model-evaluation, accumulating 139,890 total stars (averaging 3,780 stars per project). Leading this topic is Hannibal046/Awesome-LLM with 27,212 stars.

37
Total Repositories
139,890
Total Stars
3,780
Avg Stars/Repo
1
Hannibal046/Awesome-LLM

Awesome-LLM: a curated list of Large Language Model

Hannibal046
โญ 27,212 ๐Ÿ‘ค Hannibal046 User ๐Ÿ• Updated 2025-07-31 ๐Ÿ“… Created 2023-02-17
2
karpathy/llm-council

LLM Council works together to answer your hardest questions

karpathy
โญ 26,814 Python ๐Ÿ‘ค karpathy User ๐Ÿ• Updated 2025-11-22 ๐Ÿ“… Created 2025-11-22
3
Stability-AI/StableLM

StableLM: Stability AI Language Models

Stability-AI
โญ 15,784 Jupyter Notebook ๐Ÿ‘ค Stability-AI Organization ๐Ÿ• Updated 2024-04-08 ๐Ÿ“… Created 2023-04-19
4
huggingface/skills

Give your agents the power of the Hugging Face ecosystem

huggingface
โญ 11,374 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-11-24
5
sjwhitworth/golearn

Machine Learning for Go

sjwhitworth
โญ 9,455 Go ๐Ÿ‘ค sjwhitworth User ๐Ÿ• Updated 2024-01-15 ๐Ÿ“… Created 2013-12-26
6
lm-sys/RouteLLM

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality

lm-sys
โญ 4,494 Python ๐Ÿ‘ค lm-sys Organization ๐Ÿ• Updated 2024-08-10 ๐Ÿ“… Created 2024-06-03
7
TommyZihao/Train_Custom_Dataset

Annotate your own datasets, train, evaluate, test, and deploy your own artificial intelligence algorithms

TommyZihao
โญ 4,132 Jupyter Notebook ๐Ÿ‘ค TommyZihao User ๐Ÿ• Updated 2026-01-07 ๐Ÿ“… Created 2022-07-23
8
NovaSky-AI/SkyThought

Sky-T1: Train your own O1 preview model within $450

NovaSky-AI
โญ 3,394 Python ๐Ÿ‘ค NovaSky-AI Organization ๐Ÿ• Updated 2025-07-12 ๐Ÿ“… Created 2025-01-09
9
Folkbench/folkbench

AI API Relay Recommendations and Reviews: Relay Rankings, Relay Testing, Claude / GPT / Gemini Relay Comparison ยท AI API Relay Rankings ยท Folkbench Switch for Claude Code, Codex & Gemini CLI

Folkbench
โญ 3,248 TypeScript ๐Ÿ‘ค Folkbench Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-10-02
10
google/BIG-bench

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

google
โญ 3,182 Python ๐Ÿ‘ค google Organization ๐Ÿ• Updated 2024-07-19 ๐Ÿ“… Created 2021-01-15
11
XiaomiMiMo/MiMo

MiMo: Unlocking the Reasoning Potential of Language Model โ€“ From Pretraining to Posttraining

XiaomiMiMo
โญ 2,411 Python ๐Ÿ‘ค XiaomiMiMo Organization ๐Ÿ• Updated 2026-10-29 ๐Ÿ“… Created 2025-04-26
12
future-agi/future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing ยท Evals ยท Simulations ยท Datasets ยท Gateway ยท Guardrails. Self-hostable. Apache 2.0.

future-agi
โญ 2,284 Python ๐Ÿ‘ค future-agi Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-23
13
bubbliiiing/yolo3-pytorch

This is a yolo3-pytorch source code, which can be used to train your own model.

bubbliiiing
โญ 2,104 Python ๐Ÿ‘ค bubbliiiing User ๐Ÿ• Updated 2024-01-26 ๐Ÿ“… Created 2020-04-13
14
OpenCoder-llm/OpenCoder-llm

The Open Cookbook for Top-Tier Code Large Language Model

OpenCoder-llm
โญ 1,969 Python ๐Ÿ‘ค OpenCoder-llm User ๐Ÿ• Updated 2024-12-08 ๐Ÿ“… Created 2024-10-26
15
linkedin/greykite

A flexible, intuitive and fast forecasting library

linkedin
โญ 1,855 Python ๐Ÿ‘ค linkedin Organization ๐Ÿ• Updated 2025-02-20 ๐Ÿ“… Created 2021-04-27
16
vllm-project/guidellm

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

vllm-project
โญ 1,800 Python ๐Ÿ‘ค vllm-project Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-05-29
17
NVIDIA/RULER

This repo contains the source code for RULER: Whatโ€™s the Real Context Size of Your Long-Context Language Models?

NVIDIA
โญ 1,641 Python ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2024-04-09
18
justmarkham/DAT8

General Assembly's 2015 Data Science course in Washington, DC

justmarkham
โญ 1,622 Jupyter Notebook ๐Ÿ‘ค justmarkham User ๐Ÿ• Updated 2024-06-05 ๐Ÿ“… Created 2015-08-07
19
facebookresearch/DomainBed

DomainBed is a suite to test domain generalization algorithms

facebookresearch
โญ 1,596 Python ๐Ÿ‘ค facebookresearch Organization ๐Ÿ• Updated 2025-12-16 ๐Ÿ“… Created 2020-06-29
20
GAIR-NLP/LIMO

[COLM 2025] LIMO: Less is More for Reasoning

GAIR-NLP
โญ 1,081 Python ๐Ÿ‘ค GAIR-NLP Organization ๐Ÿ• Updated 2025-07-30 ๐Ÿ“… Created 2025-02-04
21
NVIDIA-NeMo/Skills

A project to improve skills of large language models

NVIDIA-NeMo
โญ 1,065 Python ๐Ÿ‘ค NVIDIA-NeMo Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2024-02-11
23
MadryLab/robustness

A library for experimenting with, training and evaluating neural networks, with a focus on adversarial robustness.

MadryLab
โญ 946 Jupyter Notebook ๐Ÿ‘ค MadryLab Organization ๐Ÿ• Updated 2024-01-11 ๐Ÿ“… Created 2019-08-21
24
jpmml/jpmml-evaluator

Java Evaluator API for PMML

jpmml
โญ 905 Java ๐Ÿ‘ค jpmml Organization ๐Ÿ• Updated 2026-10-11 ๐Ÿ“… Created 2014-02-25
25
valeman/Transformers_And_LLM_Are_What_You_Dont_Need

The best repository showing why transformers might not be the answer for time series forecasting and showcasing the best SOTA non transformer models.

valeman
โญ 869 ๐Ÿ‘ค valeman User ๐Ÿ• Updated 2026-02-12 ๐Ÿ“… Created 2023-06-20
26
RUCAIBox/LLMBox

A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.

RUCAIBox
โญ 849 Python ๐Ÿ‘ค RUCAIBox Organization ๐Ÿ• Updated 2025-06-16 ๐Ÿ“… Created 2023-10-25
27
tidymodels/tidymodels

Easily install and load the tidymodels packages

tidymodels
โญ 824 R ๐Ÿ‘ค tidymodels Organization ๐Ÿ• Updated 2026-09-17 ๐Ÿ“… Created 2018-07-05
28
OrionStarAI/Orion

Orion-14B is a family of models includes a 14B foundation LLM, and a series of models: a chat model, a long context model, a quantized model, a RAG fine-tuned model, and an Agent fine-tuned model. The Orion-14B model series includes a 14 billion parameter multilingual foundation LLM and a series of related derivative models, including a chat model, a long context model, a quantized model, a RAG fine-tuned model, and an Agent fine-tuned model, etc.

OrionStarAI
โญ 801 Python ๐Ÿ‘ค OrionStarAI Organization ๐Ÿ• Updated 2024-06-03 ๐Ÿ“… Created 2024-01-17
29
commaai/speedchallenge

The comma.ai Speed Prediction Challenge!

commaai
โญ 784 ๐Ÿ‘ค commaai Organization ๐Ÿ• Updated 2025-08-29 ๐Ÿ“… Created 2018-07-12
30
google-research/weatherbench2

A benchmark for the next generation of data-driven global weather models.

google-research
โญ 650 Python ๐Ÿ‘ค google-research Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2023-02-24
31
getomni-ai
โญ 639 TypeScript ๐Ÿ‘ค getomni-ai Organization ๐Ÿ• Updated 2025-10-21 ๐Ÿ“… Created 2024-12-16
32
AbdelStark/awesome-typesafe-jev

Awesome Jev: a source-backed field guide to TypeSafe's System One model, with SDKs, live demos, agent tools, and independent evaluations.

AbdelStark
โญ 620 HTML ๐Ÿ‘ค AbdelStark User ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2026-09-17
33
routerhubSI/glm-5.3-abliterated

GLM 5.3 abliterated or uncensored API access with RouterHub. Browse 35 jailbreak prompt links, compare GLM models, and find SDK examples, coding-tool setup, pricing, and evaluation guides.

routerhubSI
โญ 557 Python ๐Ÿ‘ค routerhubSI Organization ๐Ÿ• Updated 2026-10-24 ๐Ÿ“… Created 2026-10-24
35
modelscope/ms-cookbook

ModelScope Purple Book | ModelScope Cookbook: A hands-on guide to open-source model applications for developers, covering model selection, inference, fine-tuning, evaluation, RAG, agents, and AIGCโ€”from running your first model to building real-world applications.

modelscope
โญ 529 HTML ๐Ÿ‘ค modelscope Organization ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2026-09-11
36
moxin-org/Moxin-LLM

Moxin is a family of fully open-source and reproducible LLMs

moxin-org
โญ 526 Python ๐Ÿ‘ค moxin-org Organization ๐Ÿ• Updated 2025-07-02 ๐Ÿ“… Created 2024-12-03
37
SmartFlowAI/Llama3-Tutorial

Llama3-Tutorial (XTuner, LMDeploy, OpenCompass)

SmartFlowAI
โญ 511 Python ๐Ÿ‘ค SmartFlowAI Organization ๐Ÿ• Updated 2024-05-10 ๐Ÿ“… Created 2024-04-19

Frequently Asked Questions

1

What is the most popular #model-evaluation repository on GitHub?

The top ranked open source #model-evaluation project on GitHub is Hannibal046/Awesome-LLM with 27,212 stars. Awesome-LLM: a curated list of Large Language Model

2

Which programming languages are most used in #model-evaluation repositories?

Among the top ranked #model-evaluation projects on GitHub, the most common programming languages are Python, Jupyter Notebook, TypeScript, HTML.

3

How is the #model-evaluation repository ranking calculated?

We track 37 active open source repositories tagged with #model-evaluation (500+ stars), totaling 139,890 stars with an average of 3,780 stars per repository. Rankings update daily from the GitHub API.