#llm-security Repositories
65 repositories total
A curated list of awesome security tools, experimental case or other interesting things with LLM or GPT.
Deterministic Operating System, Safety Kernel, and Causal Nervous System for AI Agents.
JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]
Open-source runtime AI agent security tool - monitors and controls AI agents, catching malicious tool use, prompt injection, and policy drift in real time, before the agent acts.
Open-source adversary emulation for AI agents and MCP servers.
Self-hosted runtime control plane for AI agents. Observe, approve with HITL, or block rogue tool calls before they executeโpreventing secret leaks, prompt injection, supply-chain attacks, and moreโfrom a local dashboard. Agent-agnostic (Claude, Codex, LangChain, etc.).
๐ก๏ธ Security audit CLI for Model Context Protocol (MCP) servers โ scan AI agent configs for tool poisoning, rug pulls, hardcoded secrets, command injection & supply-chain risks. Pure Python, SARIF + CI ready.
This repository provides a benchmark for prompt injection attacks and defenses in LLMs
This document curates open-source projects, academic papers, capability benchmarks, and commercial solutions (international and China) in AI penetration testing, LLM red teaming, autonomous offensive agents, and vulnerability discoveryโaimed at helping researchers, security engineers, and enterprise decision-makers quickly form a holistic view.