#prompt-injection Repositories
Discover 45 active open source GitHub repositories tagged with #prompt-injection, accumulating 148,037 total stars (averaging 3,289 stars per project). Leading this topic is ifixai-ai/iFixAi with 46,592 stars.
44 repositories total
Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.
Security scanner for AI agent skills. Detect vulnerabilities, malicious patterns, security risks, prompt injection, data exfiltration, and supply-chain risks in Claude Code, Codex, and MCP skills before you install them.
dsh-purge Community ยท Community-maintained version of DeepSeek Harness: host compatibility, status diagnostics, prompt management, updates, and local backup and rollback. Based on dsh-purge by Xiaoyang / YuJunZhiXue.
A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP Scan, AI Infra Scan, and LLM jailbreak evaluation.
Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app and prove compliance to your customers.
ChatGPT Jailbreaks, GPT Assistants Prompt Leaks, GPTs Prompt Injection, LLM Prompt Security, Super Prompts, Prompt Hack, Prompt Security, Ai Prompt Engineering, Adversarial Machine Learning.
ADR secures enterprise AI agents through observability, security benchmarking, and threat detection. Deployed at Uber.
AI Red Teaming playground labs to run AI Red Teaming trainings including infrastructure.
AI Safety HOT: daily AI safety news, papers, and incidents in one place โ jailbreaks, prompt injection, alignment, evaluations, and governance. Website, daily digest, RSS, and MCP.
Open-source antivirus and firewall for AI agents: block risky tools, secret access, prompt injection, malicious packages, MCP servers, plugins, and skills at runtime.
Open-source AI agent firewall for MCP security and agent egress. Scans mediated HTTP, MCP, A2A, and WebSocket traffic for exfiltration, SSRF, and prompt injection, and emits mediator-signed action receipts: verifiable audit evidence from outside the agent.
Armor-breaking experiment project targeting GPT 6.0 and WorkBuddy V4.1 Flash
๐ LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). ๐ Extracts signals from prompts & responses, ensuring safety & security. ๐ก๏ธ Features include text quality, relevance metrics, & sentiment analysis. ๐ A comprehensive tool for LLM observability. ๐
Open source local-first PR scanner that finds dead code, security bugs, secrets, quality regressions, and AI-code mistakes before merge. For first timers refer to https://duriantaco.github.io/skylos/repo-map/
This is a repository that aims to provide updates on the status of jailbreaking the OpenAI GPT language model.
Local security audit for AI API relays and LLM proxies: detects prompt injection, model substitution, tool-call rewriting, SSE anomalies, error leakage, and Web3 wallet risks. Website: https://apirelayaudit.com
HacxGPT CLI โ Open-source command-line interface for unrestricted AI model access with multi-provider support, prompt injection research capabilities, configurable API endpoints, Termux/Linux/Windows compatibility, and Rich terminal UI for security research and red-team evaluation
The independent security agent for AI-written software. Finds issues, investigates whether they are real, and shows you the evidence. Deterministic core, no API key needed, JSON and SARIF output.
KawaiiGPT โ Open-source LLM gateway accessing DeepSeek, Gemini, and Kimi-K2 through reverse-engineered Pollinations API with no API keys required, built-in prompt injection capabilities for security research, Termux/Linux native support, and Rich console interface
A comprehensive security checklist for MCP-based AI tools. Built by SlowMist to safeguard LLM plugin ecosystems.
Official dsh-purge DeepSeek Harness jailbreak: the default prompt is tailored for Chinese models, based on the original Xiao Ma Jiang; a fully open version with no paywall, including the complete skill and knowledge bases, freely available. Jailbreak for every model โ swap prompts per model. Please star and favorite โญ
Red-teaming and evaluation framework for AI agents, built around an OWASP-inspired ASI01โASI10 taxonomy
A hub/research area for jailbreaking LLMs and breaking through their safety filters.
A curated list of awesome security tools, experimental case or other interesting things with LLM or GPT.
Deterministic Operating System, Safety Kernel, and Causal Nervous System for AI Agents.
mu (ฮผ): most of what a coding agent decides isnโt code. mu hands 40 kinds of yes/no decisions to a small model: fewer wasted tokens, fewer approvals on autopilot, fewer runs that stop halfway. Built on pi.
Open-source runtime AI agent security tool - monitors and controls AI agents, catching malicious tool use, prompt injection, and policy drift in real time, before the agent acts.
Open-source adversary emulation for AI agents and MCP servers.
Self-hosted runtime control plane for AI agents. Observe, approve with HITL, or block rogue tool calls before they executeโpreventing secret leaks, prompt injection, supply-chain attacks, and moreโfrom a local dashboard. Agent-agnostic (Claude, Codex, LangChain, etc.).
๐ก๏ธ Security audit CLI for Model Context Protocol (MCP) servers โ scan AI agent configs for tool poisoning, rug pulls, hardcoded secrets, command injection & supply-chain risks. Pure Python, SARIF + CI ready.
This repository provides a benchmark for prompt injection attacks and defenses in LLMs
Frequently Asked Questions
What is the most popular #prompt-injection repository on GitHub?
The top ranked open source #prompt-injection project on GitHub is ifixai-ai/iFixAi with 46,592 stars. Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.
Which programming languages are most used in #prompt-injection repositories?
Among the top ranked #prompt-injection projects on GitHub, the most common programming languages are Python, TypeScript, HTML, JavaScript.
How is the #prompt-injection repository ranking calculated?
We track 45 active open source repositories tagged with #prompt-injection (500+ stars), totaling 148,037 stars with an average of 3,289 stars per repository. Rankings update daily from the GitHub API.