#llm-as-judge Repositories
Discover 5 active open source GitHub repositories tagged with #llm-as-judge, accumulating 5,114 total stars (averaging 1,022 stars per project). Leading this topic is chunxiaoxx/nautilus-compass with 1,260 stars.
5 repositories total
Open memory and reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) โ by Nautilus Platform
Trace-native CI/CD for AI agents โ production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.
Hands-on, framework-free Colab notebooks for the AI Engineer / Forward Deployed Engineer (FDE) skill set โ model APIs, structured output, tool calling, RAG, evals-as-the-spine, agents (loop from scratch, tool design, guardrails, MCP, Skills), fine-tuning vs LoRA, prompt-injection/security, LLMOps, and customer craft. Runs on the free Groq API.
Frequently Asked Questions
What is the most popular #llm-as-judge repository on GitHub?
The top ranked open source #llm-as-judge project on GitHub is chunxiaoxx/nautilus-compass with 1,260 stars. Open memory and reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) โ by Nautilus Platform
Which programming languages are most used in #llm-as-judge repositories?
Among the top ranked #llm-as-judge projects on GitHub, the most common programming languages are Python, Jupyter Notebook.
How is the #llm-as-judge repository ranking calculated?
We track 5 active open source repositories tagged with #llm-as-judge (500+ stars), totaling 5,114 stars with an average of 1,022 stars per repository. Rankings update daily from the GitHub API.