#llm-eval Repositories
Discover 7 active open source GitHub repositories tagged with #llm-eval, accumulating 60,582 total stars (averaging 8,654 stars per project). Leading this topic is promptfoo/promptfoo with 27,516 stars.
7 repositories total
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc., across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
A desktop MCP client designed as a tool unitary utility integration, accelerating AI adoption through the Model Context Protocol (MCP) and enabling cross-vendor LLM API orchestration.
Frequently Asked Questions
What is the most popular #llm-eval repository on GitHub?
The top ranked open source #llm-eval project on GitHub is promptfoo/promptfoo with 27,516 stars. Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
Which programming languages are most used in #llm-eval repositories?
Among the top ranked #llm-eval projects on GitHub, the most common programming languages are Python, TypeScript.
How is the #llm-eval repository ranking calculated?
We track 7 active open source repositories tagged with #llm-eval (500+ stars), totaling 60,582 stars with an average of 8,654 stars per repository. Rankings update daily from the GitHub API.