Git Stars Git Stars

#llm-safety Repositories

Discover 17 active open source GitHub repositories tagged with #llm-safety, accumulating 27,235 total stars (averaging 1,602 stars per project). Leading this topic is NVIDIA-NeMo/Guardrails with 7,539 stars.

17
Total Repositories
27,235
Total Stars
1,602
Avg Stars/Repo
1
NVIDIA-NeMo/Guardrails

NeMo Guardrails is an open-source library for applying programmable safety and security controls to LLM and agentic applications.

NVIDIA-NeMo
โญ 7,539 Python ๐Ÿ‘ค NVIDIA-NeMo Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2023-04-18
2
confident-ai/deepteam

DeepTeam is a framework to red team LLMs and AI agents.

confident-ai
โญ 3,114 Python ๐Ÿ‘ค confident-ai Organization ๐Ÿ• Updated 2026-10-23 ๐Ÿ“… Created 2025-03-05
3
wuyoscar/Internal-Safety-Collapse

[NeurIPS 2026] Safety failures in coding agents and frontier LLMs. Reproducible workspaces for studying when AI agents generate unsafe data during task completion.

wuyoscar
โญ 2,623 Python ๐Ÿ‘ค wuyoscar User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2026-03-01
4
ydyjya/Awesome-LLM-Safety

A curated list of safety-related papers, articles, and resources focused on Large Language Models (LLMs). This repository aims to provide researchers, practitioners, and enthusiasts with insights into the safety implications, challenges, and advancements surrounding these powerful models.

ydyjya
โญ 1,921 HTML ๐Ÿ‘ค ydyjya User ๐Ÿ• Updated 2026-07-12 ๐Ÿ“… Created 2023-10-29
โญ 1,703 Python ๐Ÿ‘ค leochlon User ๐Ÿ• Updated 2026-06-17 ๐Ÿ“… Created 2025-09-01
6
safety-research/bloom

bloom - evaluate any behavior immediately ๐ŸŒธ๐ŸŒฑ

safety-research
โญ 1,429 Python ๐Ÿ‘ค safety-research Organization ๐Ÿ• Updated 2026-05-07 ๐Ÿ“… Created 2025-06-24
7
meridianlabs-ai/inspect_petri

An alignment auditing agent capable of quickly exploring alignment hypothesis

meridianlabs-ai
โญ 1,421 Python ๐Ÿ‘ค meridianlabs-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-08-19
8
cvs-health/uqlm

[JMLR 2026] UQLM: A Python package for LLM hallucination detection using uncertainty quantification

cvs-health
โญ 1,215 Python ๐Ÿ‘ค cvs-health Organization ๐Ÿ• Updated 2026-11-08 ๐Ÿ“… Created 2025-04-17
9
sylinrl/TruthfulQA

TruthfulQA: Measuring How Models Imitate Human Falsehoods

sylinrl
โญ 922 Jupyter Notebook ๐Ÿ‘ค sylinrl User ๐Ÿ• Updated 2025-01-16 ๐Ÿ“… Created 2021-08-24
10
centerforaisafety/HarmBench

HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal

centerforaisafety
โญ 819 Jupyter Notebook ๐Ÿ‘ค centerforaisafety Organization ๐Ÿ• Updated 2024-08-16 ๐Ÿ“… Created 2024-02-02
โญ 789 TypeScript ๐Ÿ‘ค 0xfreysa Organization ๐Ÿ• Updated 2025-05-05 ๐Ÿ“… Created 2024-11-22
12
liuxiaomingskm/datashield-lightweight-labs

a lightweight tool to protect privacy/user data in Internet

liuxiaomingskm
โญ 649 MDX ๐Ÿ‘ค liuxiaomingskm User ๐Ÿ• Updated 2025-12-28 ๐Ÿ“… Created 2025-12-28
13
chrisliu298/awesome-llm-unlearning

A resource repository for machine unlearning in large language models

chrisliu298
โญ 640 ๐Ÿ‘ค chrisliu298 User ๐Ÿ• Updated 2026-10-06 ๐Ÿ“… Created 2024-03-27
14
HowieHwong/TrustLLM

[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

HowieHwong
โญ 635 Python ๐Ÿ‘ค HowieHwong User ๐Ÿ• Updated 2026-10-04 ๐Ÿ“… Created 2023-12-23
โญ 628 Python ๐Ÿ‘ค anthropic-experimental Organization ๐Ÿ• Updated 2025-06-19 ๐Ÿ“… Created 2025-06-18
โญ 608 TypeScript ๐Ÿ‘ค T3-Content Organization ๐Ÿ• Updated 2026-02-20 ๐Ÿ“… Created 2025-05-29
โญ 583 ๐Ÿ‘ค llm-as-a-judge Organization ๐Ÿ• Updated 2026-05-21 ๐Ÿ“… Created 2024-11-24

Frequently Asked Questions

1

What is the most popular #llm-safety repository on GitHub?

The top ranked open source #llm-safety project on GitHub is NVIDIA-NeMo/Guardrails with 7,539 stars. NeMo Guardrails is an open-source library for applying programmable safety and security controls to LLM and agentic applications.

2

Which programming languages are most used in #llm-safety repositories?

Among the top ranked #llm-safety projects on GitHub, the most common programming languages are Python, Jupyter Notebook, TypeScript, HTML.

3

How is the #llm-safety repository ranking calculated?

We track 17 active open source repositories tagged with #llm-safety (500+ stars), totaling 27,235 stars with an average of 1,602 stars per repository. Rankings update daily from the GitHub API.