#llm-security Repositories
Discover 65 active open source GitHub repositories tagged with #llm-security, accumulating 311,462 total stars (averaging 4,791 stars per project). Leading this topic is usestrix/strix with 76,872 stars.
65 repositories total
Open-source AI penetration testing tool to find and fix your appโs vulnerabilities.
"Dive into LLMs: Building Large Language Models" Programming Practice Tutorial Series
Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.
A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP Scan, AI Infra Scan, and LLM jailbreak evaluation.
NeMo Guardrails is an open-source library for applying programmable safety and security controls to LLM and agentic applications.
๐ก๏ธ BLA (bla-agents / Blind LLM Agents) โ Open-source Blue Defense MCP server & CLI protecting JS/TS, Electron ASAR, WASM, Python, native binaries, SQLite, GGUF/Safetensors, and Android DEX from AI reverse-engineering agents (REA).
AI-powered bug bounty hunting toolkit that works with or without subscription.
A collection of scientific methods, processes, algorithms, and systems to build stories & models.
Open-source AI-powered offensive security harness for automated penetration testing.
[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).
A secure low code deception runtime framework, leveraging AI for System Virtualization.
ADR secures enterprise AI agents through observability, security benchmarking, and threat detection. Deployed at Uber.
AI Safety HOT: daily AI safety news, papers, and incidents in one place โ jailbreaks, prompt injection, alignment, evaluations, and governance. Website, daily digest, RSS, and MCP.
This repository contains LLM (Large language model) interview question asked in top companies like Google, Nvidia , Meta , Microsoft & fortune 500 companies.
A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.
A CLI host application that enables Large Language Models (LLMs) to interact with external tools through the Model Context Protocol (MCP).
OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)
Open-source AI penetration testing agent that exploit-verifies every finding. Autonomous 22-phase pentests of web apps & APIs with CVSS-scored PDF reports. Self-hosted, bring your own LLM, or run fully local with Ollama.
๐ก๏ธ Free, open-source, AI-powered security terminal and vulnerability scanner (CVE, SBOM). Supports SSH, SFTP, RDP, VNC, serial connections, and 12+ autonomous AI agents (DeepSeek, OpenAI) for automated security workflows, CTF, and DevSecOps. Cross-platform with a web UI.
Open-source autonomous AI penetration testing. 50 specialist agents across web, API, cloud, Active Directory, Kubernetes, CI/CD and AI/LLM (OWASP LLM Top 10), with an evidence-checked attack-path graph. Runs on a local LLM behind a Privacy Gateway. Integrates with GitHub, GitLab, Jenkins, VS Code, JetBrains, n8n, Grafana & Splunk.
Autonomous Offensive Security, Bug Bounty & Red Teaming Agent Framework powered by Hermes Agent, specialized reasoning skills, and multi-model LLM orchestration.
AI-first security scanner. NEW in v2026.7: Claude Code compromise detection โ vet .claude/ hooks, permissions & skills before you clone โ plus an always-on AI attack-signature scanner and native Rust & PHP rules. Also: medusa scan --git to vet any repo, medusa secrets scan for leaked API keys. 40,000+ patterns, zero setup.
Open-source AI agent firewall for MCP security and agent egress. Scans mediated HTTP, MCP, A2A, and WebSocket traffic for exfiltration, SSRF, and prompt injection, and emits mediator-signed action receipts: verifiable audit evidence from outside the agent.
Joint Semantic Detection and Dissemination Control of Phishing Attacks on Social Media via LLama- Based Modeling
A privacy-first guardrail for LLMs and RAG pipelines. SurrogateShield detects, redacts, and reconstructs sensitive PII data on the fly while defending against adversarial attacks.
An easy-to-use Python framework to generate adversarial jailbreak prompts.
Local security audit for AI API relays and LLM proxies: detects prompt injection, model substitution, tool-call rewriting, SSE anomalies, error leakage, and Web3 wallet risks. Website: https://apirelayaudit.com
The independent security agent for AI-written software. Finds issues, investigates whether they are real, and shows you the evidence. Deterministic core, no API key needed, JSON and SARIF output.
Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call guards, rate limits, budgets, cost accounting and audit logs.
Give the agent a machine. Just not yours. Each AI coding agent gets its own isolated machine with root, Docker, and systemd - active defense detects and stops threats automatically.
Tamper-evident tracing, policy gates and cross-checks for AI agents: see what the agent did, and why.
Exploit prompts and roleplay techniques for bypassing AI model restrictions.
Red-teaming and evaluation framework for AI agents, built around an OWASP-inspired ASI01โASI10 taxonomy
Runtime security for AI apps and agents: prompt injection detection, tool-call authorization, sensitive-data redaction, bot protection, and rate limiting. Drop it into your JS/TS code.
Frequently Asked Questions
What is the most popular #llm-security repository on GitHub?
The top ranked open source #llm-security project on GitHub is usestrix/strix with 76,872 stars. Open-source AI penetration testing tool to find and fix your appโs vulnerabilities.
Which programming languages are most used in #llm-security repositories?
Among the top ranked #llm-security projects on GitHub, the most common programming languages are Python, Go, Jupyter Notebook, TypeScript.
How is the #llm-security repository ranking calculated?
We track 65 active open source repositories tagged with #llm-security (500+ stars), totaling 311,462 stars with an average of 4,791 stars per repository. Rankings update daily from the GitHub API.