Git Stars Git Stars

#llm-evaluation-framework Repositories

Discover 4 active open source GitHub repositories tagged with #llm-evaluation-framework, accumulating 49,807 total stars (averaging 12,451 stars per project). Leading this topic is promptfoo/promptfoo with 27,516 stars.

4
Total Repositories
49,807
Total Stars
12,451
Avg Stars/Repo
Programming Languages: Python TypeScript

4 repositories total

1
promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

promptfoo
⭐ 27,516 TypeScript 👤 promptfoo Organization 🕐 Updated 2026-11-21 📅 Created 2023-04-28
2
confident-ai/deepeval

The LLM Evaluation Framework

confident-ai
⭐ 19,585 Python 👤 confident-ai Organization 🕐 Updated 2026-11-19 📅 Created 2023-08-10
3
msoedov/agentic_security

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

msoedov
⭐ 2,048 Python 👤 msoedov User 🕐 Updated 2026-11-19 📅 Created 2024-04-11
4
facebookresearch/swe-rl

[NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"

facebookresearch
⭐ 696 Python 👤 facebookresearch Organization 🕐 Updated 2025-03-16 📅 Created 2025-02-23

Frequently Asked Questions

1

What is the most popular #llm-evaluation-framework repository on GitHub?

The top ranked open source #llm-evaluation-framework project on GitHub is promptfoo/promptfoo with 27,516 stars. Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

2

Which programming languages are most used in #llm-evaluation-framework repositories?

Among the top ranked #llm-evaluation-framework projects on GitHub, the most common programming languages are Python, TypeScript.

3

How is the #llm-evaluation-framework repository ranking calculated?

We track 4 active open source repositories tagged with #llm-evaluation-framework (500+ stars), totaling 49,807 stars with an average of 12,451 stars per repository. Rankings update daily from the GitHub API.