#ai-alignment Repositories
Discover 10 active open source GitHub repositories tagged with #ai-alignment, accumulating 57,142 total stars (averaging 5,714 stars per project). Leading this topic is ifixai-ai/iFixAi with 46,592 stars.
10 repositories total
Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.
AI Safety HOT: daily AI safety news, papers, and incidents in one place โ jailbreaks, prompt injection, alignment, evaluations, and governance. Website, daily digest, RSS, and MCP.
InstructLab Core package. Use this to chat with a model and execute the InstructLab workflow to train a model using custom taxonomy data.
MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.
This is a collection of research papers for Self-Correcting Large Language Models with Automated Feedback.
PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. ๐ Best Paper Awards @ NeurIPS ML Safety Workshop 2022
Frequently Asked Questions
What is the most popular #ai-alignment repository on GitHub?
The top ranked open source #ai-alignment project on GitHub is ifixai-ai/iFixAi with 46,592 stars. Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.
Which programming languages are most used in #ai-alignment repositories?
Among the top ranked #ai-alignment projects on GitHub, the most common programming languages are Python, TeX.
How is the #ai-alignment repository ranking calculated?
We track 10 active open source repositories tagged with #ai-alignment (500+ stars), totaling 57,142 stars with an average of 5,714 stars per repository. Rankings update daily from the GitHub API.