Git Stars Git Stars

#ai-alignment Repositories

Discover 10 active open source GitHub repositories tagged with #ai-alignment, accumulating 57,142 total stars (averaging 5,714 stars per project). Leading this topic is ifixai-ai/iFixAi with 46,592 stars.

10
Total Repositories
57,142
Total Stars
5,714
Avg Stars/Repo
Programming Languages: Python TeX
1
ifixai-ai/iFixAi

Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

ifixai-ai
โญ 46,592 Python ๐Ÿ‘ค ifixai-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-04-27
3
wuyoscar/AISafetyHot

AI Safety HOT: daily AI safety news, papers, and incidents in one place โ€” jailbreaks, prompt injection, alignment, evaluations, and governance. Website, daily digest, RSS, and MCP.

wuyoscar
โญ 2,079 TeX ๐Ÿ‘ค wuyoscar User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2026-10-01
4
jacobhilton/deep_learning_curriculum

Language model alignment-focused deep learning curriculum

jacobhilton
โญ 1,508 ๐Ÿ‘ค jacobhilton User ๐Ÿ• Updated 2024-08-19 ๐Ÿ“… Created 2022-07-12
5
instructlab/instructlab

InstructLab Core package. Use this to chat with a model and execute the InstructLab workflow to train a model using custom taxonomy data.

instructlab
โญ 1,415 Python ๐Ÿ‘ค instructlab Organization ๐Ÿ• Updated 2026-03-30 ๐Ÿ“… Created 2024-02-21
6
allenai/mmc4

MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.

allenai
โญ 953 Python ๐Ÿ‘ค allenai Organization ๐Ÿ• Updated 2025-03-19 ๐Ÿ“… Created 2023-04-13
โญ 628 Python ๐Ÿ‘ค anthropic-experimental Organization ๐Ÿ• Updated 2025-06-19 ๐Ÿ“… Created 2025-06-18
โญ 583 ๐Ÿ‘ค llm-as-a-judge Organization ๐Ÿ• Updated 2026-05-21 ๐Ÿ“… Created 2024-11-24
9
teacherpeterpan/self-correction-llm-papers

This is a collection of research papers for Self-Correcting Large Language Models with Automated Feedback.

teacherpeterpan
โญ 562 ๐Ÿ‘ค teacherpeterpan User ๐Ÿ• Updated 2024-10-28 ๐Ÿ“… Created 2023-08-04
10
agencyenterprise/PromptInject

PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. ๐Ÿ† Best Paper Awards @ NeurIPS ML Safety Workshop 2022

agencyenterprise
โญ 529 Python ๐Ÿ‘ค agencyenterprise Organization ๐Ÿ• Updated 2026-04-27 ๐Ÿ“… Created 2022-10-25

Frequently Asked Questions

1

What is the most popular #ai-alignment repository on GitHub?

The top ranked open source #ai-alignment project on GitHub is ifixai-ai/iFixAi with 46,592 stars. Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

2

Which programming languages are most used in #ai-alignment repositories?

Among the top ranked #ai-alignment projects on GitHub, the most common programming languages are Python, TeX.

3

How is the #ai-alignment repository ranking calculated?

We track 10 active open source repositories tagged with #ai-alignment (500+ stars), totaling 57,142 stars with an average of 5,714 stars per repository. Rankings update daily from the GitHub API.