Git Stars Git Stars

#llm-security Repositories

Discover 65 active open source GitHub repositories tagged with #llm-security, accumulating 311,462 total stars (averaging 4,791 stars per project). Leading this topic is usestrix/strix with 76,872 stars.

65
Total Repositories
311,462
Total Stars
4,791
Avg Stars/Repo
1
usestrix/strix

Open-source AI penetration testing tool to find and fix your appโ€™s vulnerabilities.

usestrix
โญ 76,872 Python ๐Ÿ‘ค usestrix Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2025-08-05
2
Lordog/dive-into-llms

"Dive into LLMs: Building Large Language Models" Programming Practice Tutorial Series

Lordog
โญ 55,949 Jupyter Notebook ๐Ÿ‘ค Lordog User ๐Ÿ• Updated 2025-10-10 ๐Ÿ“… Created 2024-04-08
3
ifixai-ai/iFixAi

Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

ifixai-ai
โญ 46,592 Python ๐Ÿ‘ค ifixai-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-04-27
4
NVIDIA/garak

the LLM vulnerability scanner

NVIDIA
โญ 10,122 Python ๐Ÿ‘ค NVIDIA Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-05-10
5
Tencent/AI-Infra-Guard

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP Scan, AI Infra Scan, and LLM jailbreak evaluation.

Tencent
โญ 7,604 Python ๐Ÿ‘ค Tencent Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-12-25
6
NVIDIA-NeMo/Guardrails

NeMo Guardrails is an open-source library for applying programmable safety and security controls to LLM and agentic applications.

NVIDIA-NeMo
โญ 7,539 Python ๐Ÿ‘ค NVIDIA-NeMo Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2023-04-18
7
qybaihe/bla

๐Ÿ›ก๏ธ BLA (bla-agents / Blind LLM Agents) โ€” Open-source Blue Defense MCP server & CLI protecting JS/TS, Electron ASAR, WASM, Python, native binaries, SQLite, GGUF/Safetensors, and Android DEX from AI reverse-engineering agents (REA).

qybaihe
โญ 6,366 TypeScript ๐Ÿ‘ค qybaihe User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-10-25
8
awarexone/Agentic-Bug-Hunter

AI-powered bug bounty hunting toolkit that works with or without subscription.

awarexone
โญ 6,015 Python ๐Ÿ‘ค awarexone Organization ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2026-03-08
9
Giskard-AI/giskard-oss

๐Ÿข Open-Source Evaluation & Testing library for LLM Agents

Giskard-AI
โญ 5,965 Python ๐Ÿ‘ค Giskard-AI Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2022-03-06
10
0xeb/TheBigPromptLibrary

A collection of prompts, system prompts and LLM instructions

0xeb
โญ 5,545 HTML ๐Ÿ‘ค 0xeb User ๐Ÿ• Updated 2026-11-10 ๐Ÿ“… Created 2023-11-24
11
nolabs-ai/nono

Agent runtime security โ€” zero-trust, zero-setup, zero-latency agent sandboxing

nolabs-ai
โญ 5,060 Rust ๐Ÿ‘ค nolabs-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-01-31
12
meta-llama/PurpleLlama

Set of tools to assess and improve LLM security.

meta-llama
โญ 4,487 Python ๐Ÿ‘ค meta-llama Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-12-06
13
riramar/Web-Attack-Cheat-Sheet

Web Attack Cheat Sheet

riramar
โญ 4,438 ๐Ÿ‘ค riramar User ๐Ÿ• Updated 2026-09-04 ๐Ÿ“… Created 2020-01-11
14
llm-attacks/llm-attacks

Universal and Transferable Attacks on Aligned Language Models

llm-attacks
โญ 4,422 Python ๐Ÿ‘ค llm-attacks Organization ๐Ÿ• Updated 2024-08-02 ๐Ÿ“… Created 2023-07-27
15
hemansnation/AI-Engineer-Headquarters

A collection of scientific methods, processes, algorithms, and systems to build stories & models.

hemansnation
โญ 3,782 Jupyter Notebook ๐Ÿ‘ค hemansnation User ๐Ÿ• Updated 2026-10-28 ๐Ÿ“… Created 2022-03-29
16
CyberStrikeus/CyberStrike

Open-source AI-powered offensive security harness for automated penetration testing.

CyberStrikeus
โญ 3,672 TypeScript ๐Ÿ‘ค CyberStrikeus Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-02-14
17
verazuo/jailbreak_llms

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

verazuo
โญ 3,494 Jupyter Notebook ๐Ÿ‘ค verazuo User ๐Ÿ• Updated 2024-12-24 ๐Ÿ“… Created 2023-08-01
18
protectai/llm-guard

The Security Toolkit for LLM Interactions

protectai
โญ 3,156 Python ๐Ÿ‘ค protectai Organization ๐Ÿ• Updated 2025-12-15 ๐Ÿ“… Created 2023-07-27
19
Acmesec/PromptJailbreakManual

Prompt Jailbreak Manual

Acmesec
โญ 3,049 ๐Ÿ‘ค Acmesec Organization ๐Ÿ• Updated 2024-12-17 ๐Ÿ“… Created 2024-11-25
20
beelzebub-labs/beelzebub

A secure low code deception runtime framework, leveraging AI for System Virtualization.

beelzebub-labs
โญ 2,254 Go ๐Ÿ‘ค beelzebub-labs Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2022-05-08
21
uber/ADR

ADR secures enterprise AI agents through observability, security benchmarking, and threat detection. Deployed at Uber.

uber
โญ 2,143 Python ๐Ÿ‘ค uber Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-04-19
22
greshake/llm-security

New ways of breaking app-integrated LLMs

greshake
โญ 2,116 Jupyter Notebook ๐Ÿ‘ค greshake User ๐Ÿ• Updated 2025-07-17 ๐Ÿ“… Created 2023-02-19
23
wuyoscar/AISafetyHot

AI Safety HOT: daily AI safety news, papers, and incidents in one place โ€” jailbreaks, prompt injection, alignment, evaluations, and governance. Website, daily digest, RSS, and MCP.

wuyoscar
โญ 2,079 TeX ๐Ÿ‘ค wuyoscar User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-10-01
24
msoedov/agentic_security

Agentic LLM Vulnerability Scanner / AI red teaming kit ๐Ÿงช

msoedov
โญ 2,048 Python ๐Ÿ‘ค msoedov User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2024-04-11
25
llmgenai/LLMInterviewQuestions

This repository contains LLM (Large language model) interview question asked in top companies like Google, Nvidia , Meta , Microsoft & fortune 500 companies.

llmgenai
โญ 1,781 ๐Ÿ‘ค llmgenai User ๐Ÿ• Updated 2025-02-12 ๐Ÿ“… Created 2024-12-26
26
cyberark/FuzzyAI

A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.

cyberark
โญ 1,611 Jupyter Notebook ๐Ÿ‘ค cyberark Organization ๐Ÿ• Updated 2026-02-06 ๐Ÿ“… Created 2024-12-03
27
mark3labs/mcphost

A CLI host application that enables Large Language Models (LLMs) to interact with external tools through the Model Context Protocol (MCP).

mark3labs
โญ 1,598 Go ๐Ÿ‘ค mark3labs Organization ๐Ÿ• Updated 2026-02-26 ๐Ÿ“… Created 2024-12-08
28
OWASP/www-project-top-10-for-large-language-model-applications

OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)

OWASP
โญ 1,504 Python ๐Ÿ‘ค OWASP Organization ๐Ÿ• Updated 2026-08-05 ๐Ÿ“… Created 2023-05-16
29
xalgorix/xalgorix

Open-source AI penetration testing agent that exploit-verifies every finding. Autonomous 22-phase pentests of web apps & APIs with CVSS-scored PDF reports. Self-hosted, bring your own LLM, or run fully local with Ollama.

xalgorix
โญ 1,380 Go ๐Ÿ‘ค xalgorix Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-03-13
โญ 1,376 Python ๐Ÿ‘ค harishsg993010 User ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2025-04-16
โญ 1,357 Java ๐Ÿ‘ค JoySafety Organization ๐Ÿ• Updated 2026-05-11 ๐Ÿ“… Created 2025-09-24
32
ZeroDayEvil/ai-security-tool

๐Ÿ›ก๏ธ Free, open-source, AI-powered security terminal and vulnerability scanner (CVE, SBOM). Supports SSH, SFTP, RDP, VNC, serial connections, and 12+ autonomous AI agents (DeepSeek, OpenAI) for automated security workflows, CTF, and DevSecOps. Cross-platform with a web UI.

ZeroDayEvil
โญ 1,325 HTML ๐Ÿ‘ค ZeroDayEvil User ๐Ÿ• Updated 2026-11-04 ๐Ÿ“… Created 2026-09-10
33
ASCIT31/Dark-Moon

Open-source autonomous AI penetration testing. 50 specialist agents across web, API, cloud, Active Directory, Kubernetes, CI/CD and AI/LLM (OWASP LLM Top 10), with an evidence-checked attack-path graph. Runs on a local LLM behind a Privacy Gateway. Integrates with GitHub, GitLab, Jenkins, VS Code, JetBrains, n8n, Grafana & Splunk.

ASCIT31
โญ 1,279 Python ๐Ÿ‘ค ASCIT31 Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-11-26
34
splx-ai/agentic-radar

A security scanner for your LLM agentic workflows

splx-ai
โญ 1,072 Python ๐Ÿ‘ค splx-ai Organization ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2025-02-12
35
Zyrexnn/Cybermes

Autonomous Offensive Security, Bug Bounty & Red Teaming Agent Framework powered by Hermes Agent, specialized reasoning skills, and multi-model LLM orchestration.

Zyrexnn
โญ 1,054 Python ๐Ÿ‘ค Zyrexnn User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-08-19
36
Pantheon-Security/medusa

AI-first security scanner. NEW in v2026.7: Claude Code compromise detection โ€” vet .claude/ hooks, permissions & skills before you clone โ€” plus an always-on AI attack-signature scanner and native Rust & PHP rules. Also: medusa scan --git to vet any repo, medusa secrets scan for leaked API keys. 40,000+ patterns, zero setup.

Pantheon-Security
โญ 1,023 Python ๐Ÿ‘ค Pantheon-Security Organization ๐Ÿ• Updated 2026-08-10 ๐Ÿ“… Created 2025-11-15
37
pipelab-org/pipelock

Open-source AI agent firewall for MCP security and agent egress. Scans mediated HTTP, MCP, A2A, and WebSocket traffic for exfiltration, SSRF, and prompt injection, and emits mediator-signed action receipts: verifiable audit evidence from outside the agent.

pipelab-org
โญ 1,013 Go ๐Ÿ‘ค pipelab-org Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-02-08
38
wang-rui/phishguard-scaffold

Joint Semantic Detection and Dissemination Control of Phishing Attacks on Social Media via LLama- Based Modeling

wang-rui
โญ 1,012 Python ๐Ÿ‘ค wang-rui User ๐Ÿ• Updated 2026-02-15 ๐Ÿ“… Created 2025-09-08
39
sherwinvishesh/SurrogateShield

A privacy-first guardrail for LLMs and RAG pipelines. SurrogateShield detects, redacts, and reconstructs sensitive PII data on the fly while defending against adversarial attacks.

sherwinvishesh
โญ 996 Python ๐Ÿ‘ค sherwinvishesh User ๐Ÿ• Updated 2026-10-16 ๐Ÿ“… Created 2026-05-13
40
openpcc/openpcc

An open-source framework for verifiably private AI inference

openpcc
โญ 958 Go ๐Ÿ‘ค openpcc Organization ๐Ÿ• Updated 2026-01-08 ๐Ÿ“… Created 2025-11-05
41
EasyJailbreak/EasyJailbreak

An easy-to-use Python framework to generate adversarial jailbreak prompts.

EasyJailbreak
โญ 948 Python ๐Ÿ‘ค EasyJailbreak Organization ๐Ÿ• Updated 2026-09-01 ๐Ÿ“… Created 2024-01-31
42
toby-bridges/api-relay-audit

Local security audit for AI API relays and LLM proxies: detects prompt injection, model substitution, tool-call rewriting, SSE anomalies, error leakage, and Web3 wallet risks. Website: https://apirelayaudit.com

toby-bridges
โญ 925 Python ๐Ÿ‘ค toby-bridges User ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2026-03-30
43
asamassekou10/ship-safe

The independent security agent for AI-written software. Finds issues, investigates whether they are real, and shows you the evidence. Deterministic core, no API key needed, JSON and SARIF output.

asamassekou10
โญ 873 JavaScript ๐Ÿ‘ค asamassekou10 User ๐Ÿ• Updated 2026-10-17 ๐Ÿ“… Created 2026-02-02
44
OWASP/www-project-ai-testing-guide

OWASP Foundation web repository

OWASP
โญ 859 Python ๐Ÿ‘ค OWASP Organization ๐Ÿ• Updated 2026-06-01 ๐Ÿ“… Created 2025-06-10
45
ThinkWatchProject/ThinkWatch

Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call guards, rate limits, budgets, cost accounting and audit logs.

ThinkWatchProject
โญ 817 Rust ๐Ÿ‘ค ThinkWatchProject Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-04-02
46
coipond/coi

Give the agent a machine. Just not yours. Each AI coding agent gets its own isolated machine with root, Docker, and systemd - active defense detects and stops threats automatically.

coipond
โญ 790 Go ๐Ÿ‘ค coipond Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-01-07
47
Cygnux-Labs/Tracekit

Tamper-evident tracing, policy gates and cross-checks for AI agents: see what the agent did, and why.

Cygnux-Labs
โญ 759 Python ๐Ÿ‘ค Cygnux-Labs Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-09-26
48
l0gicx/ai-model-bypass

Exploit prompts and roleplay techniques for bypassing AI model restrictions.

l0gicx
โญ 722 ๐Ÿ‘ค l0gicx User ๐Ÿ• Updated 2025-10-04 ๐Ÿ“… Created 2025-05-21
49
AgentSafeLabs/safelabs-eval

Red-teaming and evaluation framework for AI agents, built around an OWASP-inspired ASI01โ€“ASI10 taxonomy

AgentSafeLabs
โญ 713 Python ๐Ÿ‘ค AgentSafeLabs Organization ๐Ÿ• Updated 2026-11-06 ๐Ÿ“… Created 2026-05-25
50
arcjet/arcjet-js

Runtime security for AI apps and agents: prompt injection detection, tool-call authorization, sensitive-data redaction, bot protection, and rate limiting. Drop it into your JS/TS code.

arcjet
โญ 700 TypeScript ๐Ÿ‘ค arcjet Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2023-11-30

Frequently Asked Questions

1

What is the most popular #llm-security repository on GitHub?

The top ranked open source #llm-security project on GitHub is usestrix/strix with 76,872 stars. Open-source AI penetration testing tool to find and fix your appโ€™s vulnerabilities.

2

Which programming languages are most used in #llm-security repositories?

Among the top ranked #llm-security projects on GitHub, the most common programming languages are Python, Go, Jupyter Notebook, TypeScript.

3

How is the #llm-security repository ranking calculated?

We track 65 active open source repositories tagged with #llm-security (500+ stars), totaling 311,462 stars with an average of 4,791 stars per repository. Rankings update daily from the GitHub API.