Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Ai Safety Open Source Projects

Open source projects categorized as Ai Safety
Categories > Ai Safety
Awesome Machine Learning Interpretability ⭐ 3,241
A curated list of awesome responsible machine learning resources.
most recent commit 5 months ago
Giskard ⭐ 2,509
🐢 The testing framework for ML models, from tabular to LLMs
total releases 76most recent commit 5 months ago
Safe Rlhf ⭐ 1,040
Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
most recent commit 5 months ago
Tiger ⭐ 337
Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
most recent commit 7 months ago
Guardrail ⭐ 278
Build LLM apps safely and securely🛡️
most recent commit 8 months ago
Thought Cloning ⭐ 217
[NeurIPS '23 Spotlight] Thought Cloning: Learning to Think while Acting by Imitating Human Thinking
most recent commit 6 months ago
Llm_rules ⭐ 172
RuLES: a benchmark for evaluating rule-following in language models
most recent commit 5 months ago
Make Safe Ai ⭐ 143
How to Make Safe AI? Let's Discuss! 💡|💬|🙌|📚
most recent commit a year ago
Pretraining With Human Feedback ⭐ 97
Code accompanying the paper Pretraining Language Models with Human Preferences
most recent commit a year ago
Ethics ⭐ 94
Aligning AI With Shared Human Values (ICLR 2021)
most recent commit a year ago
Diffattack ⭐ 92
An unrestricted attack based on diffusion models that can achieve both good transferability and imperceptibility.
most recent commit 5 months ago
Toolemu ⭐ 73
A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
most recent commit 5 months ago
Awesome Ai Safety ⭐ 64
A curated list of papers & technical articles on AI Quality & Safety 📚
most recent commit a year ago
Safenlp ⭐ 57
Safety Score for Pre-Trained Language Models
most recent commit 8 months ago
Ais ⭐ 55
Toolkit for research purposes in AIS. See the website for the paper.
most recent commit 4 years ago
Entropic Out Of Distribution Detection ⭐ 47
Add scalable state-of-the-art out-of-distribution detection (open set recognition) support by changing two lines of code! Perform efficient inferences (i.e., do not increase inference time) and detection without classification accuracy drop, hyperparameter tuning, or collecting additional data.
most recent commit 2 years ago
Flat ⭐ 46
[ICCV2021 Oral] Fooling LiDAR by Attacking GPS Trajectory
most recent commit 2 years ago
Rain ⭐ 40
[ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
most recent commit 5 months ago
Awesome Ai Alignment ⭐ 37
A curated list of awesome resources for getting-started-with and staying-in-touch-with Artificial Intelligence Alignment research.
most recent commit a year ago
Distinction Maximization Loss ⭐ 34
Improve out-of-distribution detection (open set recognition) and uncertainty estimation by changing a few lines of code in your project! Perform efficient inferences (i.e., do not increase inference time) without repetitive model training, hyperparameter tuning, or collecting additional data.
most recent commit 2 years ago
Cat ⭐ 30
[CoRL'23] Adversarial Training for Safe End-to-End Driving
most recent commit 7 months ago
Sparse Probing Paper ⭐ 29
Sparse probing paper full code.
most recent commit 6 months ago
Stampy Ui ⭐ 28
AI Safety Q&A web frontend
most recent commit 7 months ago
The 2 Latest Releases In Ai Safety Open Source Projects
Giskard ⭐ 2,509
🐢 The testing framework for ML models, from tabular to LLMs
total releases 76latest release December 04, 2023most recent commit 5 months ago
Daisybell ⭐ 8
Scan your AI/ML models for problems before you put them into production.
total releases 7latest release June 28, 2022most recent commit 5 months ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.