#llm-as-a-judge Repositories
Discover 10 active open source GitHub repositories tagged with #llm-as-a-judge, accumulating 16,286 total stars (averaging 1,628 stars per project). Leading this topic is oumi-ai/oumi with 9,441 stars.
10 repositories total
Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.
GAOKAO-Bench is an evaluation framework that utilizes GAOKAO questions as a dataset to evaluate large language models.
LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR team.
Frequently Asked Questions
What is the most popular #llm-as-a-judge repository on GitHub?
The top ranked open source #llm-as-a-judge project on GitHub is oumi-ai/oumi with 9,441 stars. Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
Which programming languages are most used in #llm-as-a-judge repositories?
Among the top ranked #llm-as-a-judge projects on GitHub, the most common programming languages are Python, HTML, JavaScript.
How is the #llm-as-a-judge repository ranking calculated?
We track 10 active open source repositories tagged with #llm-as-a-judge (500+ stars), totaling 16,286 stars with an average of 1,628 stars per repository. Rankings update daily from the GitHub API.