#model-evaluation Repositories
Discover 37 active open source GitHub repositories tagged with #model-evaluation, accumulating 139,890 total stars (averaging 3,780 stars per project). Leading this topic is Hannibal046/Awesome-LLM with 27,212 stars.
37 repositories total
A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
Annotate your own datasets, train, evaluate, test, and deploy your own artificial intelligence algorithms
AI API Relay Recommendations and Reviews: Relay Rankings, Relay Testing, Claude / GPT / Gemini Relay Comparison ยท AI API Relay Rankings ยท Folkbench Switch for Claude Code, Codex & Gemini CLI
Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models
MiMo: Unlocking the Reasoning Potential of Language Model โ From Pretraining to Posttraining
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing ยท Evals ยท Simulations ยท Datasets ยท Gateway ยท Guardrails. Self-hostable. Apache 2.0.
This is a yolo3-pytorch source code, which can be used to train your own model.
This repo contains the source code for RULER: Whatโs the Real Context Size of Your Long-Context Language Models?
A library for experimenting with, training and evaluating neural networks, with a focus on adversarial robustness.
The best repository showing why transformers might not be the answer for time series forecasting and showcasing the best SOTA non transformer models.
A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.
Orion-14B is a family of models includes a 14B foundation LLM, and a series of models: a chat model, a long context model, a quantized model, a RAG fine-tuned model, and an Agent fine-tuned model. The Orion-14B model series includes a 14 billion parameter multilingual foundation LLM and a series of related derivative models, including a chat model, a long context model, a quantized model, a RAG fine-tuned model, and an Agent fine-tuned model, etc.
A benchmark for the next generation of data-driven global weather models.
Awesome Jev: a source-backed field guide to TypeSafe's System One model, with SDKs, live demos, agent tools, and independent evaluations.
GLM 5.3 abliterated or uncensored API access with RouterHub. Browse 35 jailbreak prompt links, compare GLM models, and find SDK examples, coding-tool setup, pricing, and evaluation guides.
ModelScope Purple Book | ModelScope Cookbook: A hands-on guide to open-source model applications for developers, covering model selection, inference, fine-tuning, evaluation, RAG, agents, and AIGCโfrom running your first model to building real-world applications.
Frequently Asked Questions
What is the most popular #model-evaluation repository on GitHub?
The top ranked open source #model-evaluation project on GitHub is Hannibal046/Awesome-LLM with 27,212 stars. Awesome-LLM: a curated list of Large Language Model
Which programming languages are most used in #model-evaluation repositories?
Among the top ranked #model-evaluation projects on GitHub, the most common programming languages are Python, Jupyter Notebook, TypeScript, HTML.
How is the #model-evaluation repository ranking calculated?
We track 37 active open source repositories tagged with #model-evaluation (500+ stars), totaling 139,890 stars with an average of 3,780 stars per repository. Rankings update daily from the GitHub API.