Awesome Open Source
Awesome Open Source
Combined Topics
interpretability x
Advertising 📦 10
All Projects
Application Programming Interfaces 📦 124
Applications 📦 192
Artificial Intelligence 📦 78
Blockchain 📦 73
Build Tools 📦 113
Cloud Computing 📦 80
Code Quality 📦 28
Collaboration 📦 32
Command Line Interface 📦 49
Community 📦 83
Companies 📦 60
Compilers 📦 63
Computer Science 📦 80
Configuration Management 📦 42
Content Management 📦 175
Control Flow 📦 213
Data Formats 📦 78
Data Processing 📦 276
Data Storage 📦 135
Economics 📦 64
Frameworks 📦 215
Games 📦 129
Graphics 📦 110
Hardware 📦 152
Integrated Development Environments 📦 49
Learning Resources 📦 166
Legal 📦 29
Libraries 📦 129
Lists Of Projects 📦 22
Machine Learning 📦 347
Mapping 📦 64
Marketing 📦 15
Mathematics 📦 55
Media 📦 239
Messaging 📦 98
Networking 📦 315
Operating Systems 📦 89
Operations 📦 121
Package Managers 📦 55
Programming Languages 📦 245
Runtime Environments 📦 100
Science 📦 42
Security 📦 396
Social Media 📦 27
Software Architecture 📦 72
Software Development 📦 72
Software Performance 📦 58
Software Quality 📦 133
Text Editors 📦 49
Text Processing 📦 136
User Interface 📦 330
User Interface Components 📦 514
Version Control 📦 30
Virtualization 📦 71
Web Browsers 📦 42
Web Servers 📦 26
Web User Interface 📦 210

The Top 53 Interpretability Open Source Projects

Categories > Machine Learning > Interpretability
Shap ⭐ 13,336
A game theoretic approach to explain the output of any machine learning model.
Awesome Production Machine Learning ⭐ 9,544
A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
Lucid ⭐ 4,256
A collection of infrastructure and tools for research in neural network interpretability.
Interpret ⭐ 3,956
Fit interpretable models. Explain blackbox machine learning.
Pytorch Grad Cam ⭐ 2,928
Many Class Activation Map methods implemented in Pytorch for CNNs and Vision Transformers. Including Grad-CAM, Grad-CAM++, Score-CAM, Ablation-CAM and XGrad-CAM
Captum ⭐ 2,501
Model interpretability and understanding for PyTorch
Awesome Machine Learning Interpretability ⭐ 2,210
A curated list of awesome machine learning interpretability resources.
Stellargraph ⭐ 2,015
StellarGraph - Machine Learning on Graphs
Shapash ⭐ 1,146
🔅 Shapash makes Machine Learning models transparent and understandable by everyone
Alibi ⭐ 1,065
Algorithms for explaining machine learning models
Grad Cam ⭐ 962
[ICCV 2017] Torch code for Grad-CAM
Awesome Federated Learning ⭐ 887
Federated Learning Library: https://fedml.ai
Dalex ⭐ 864
moDel Agnostic Language for Exploration and eXplanation
Tf Explain ⭐ 844
Interpretability Methods for tf.keras models with Tensorflow 2.x
Ad_examples ⭐ 688
A collection of anomaly detection methods (iid/point-based, graph and time series) including active learning for anomaly detection/discovery, bayesian rule-mining, description for diversity/explanation/interpretability. Analysis of incorporating label feedback with ensemble and tree-based detectors. Includes adversarial attacks with Graph Convolutional Network.
Xai ⭐ 669
XAI - An eXplainability toolbox for machine learning
Flashtorch ⭐ 606
Visualization toolkit for neural networks in PyTorch! Demo -->
Xai_resources ⭐ 601
Interesting resources related to XAI (Explainable Artificial Intelligence)
Interpretable_machine_learning_with_python ⭐ 562
Examples of techniques for training interpretable ML models, explaining ML models, and debugging ML models for accuracy, discrimination, and security.
Deeplift ⭐ 547
Public facing deeplift repo
Tcav ⭐ 471
Code for the TCAV ML interpretability project
Awesome_deep_learning_interpretability ⭐ 465
深度学习近年来关于神经网络模型解释性的相关高引用/顶会论文(附带代码)
Neural Backed Decision Trees ⭐ 462
Making decision trees competitive with neural networks on CIFAR10, CIFAR100, TinyImagenet200, Imagenet
Mli Resources ⭐ 438
H2O.ai Machine Learning Interpretability Resources
Transformers Interpret ⭐ 414
Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.
Torch Cam ⭐ 400
Class activation maps for your PyTorch models (CAM, Grad-CAM, Grad-CAM++, Smooth Grad-CAM++, Score-CAM, SS-CAM, IS-CAM, XGrad-CAM, Layer-CAM)
Awesome Explainable Ai ⭐ 320
A collection of research materials on explainable AI/ML
Facet ⭐ 312
Human-explainable AI.
Decision Forests ⭐ 299
A collection of state-of-the-art algorithms for the training, serving and interpretation of Decision Forest models in Keras.
Aspect Based Sentiment Analysis ⭐ 271
💭 Aspect-Based-Sentiment-Analysis: Transformer & Explainable ML (TensorFlow)
Imodels ⭐ 237
Interpretable ML package 🔍 for concise, transparent, and accurate predictive modeling (sklearn-compatible).
Explainx ⭐ 214
Explainable AI framework for data scientists. Explain & debug any blackbox machine learning model with a single line of code.
Pyss3 ⭐ 210
A Python package implementing a new interpretable machine learning model for text classification (with visualization tools for Explainable AI )
Modelstudio ⭐ 199
📍 Interactive Studio for Explanatory Model Analysis
Lrp_for_lstm ⭐ 167
Layer-wise Relevance Propagation (LRP) for LSTMs
Awesome Fairness In Ai ⭐ 167
A curated list of awesome Fairness in AI resources
Visual Attribution ⭐ 130
Pytorch Implementation of recent visual attribution methods for model interpretability
Awesome Computer Vision ⭐ 106
Awesome Resources for Advanced Computer Vision Topics
Pycebox ⭐ 102
⬛ Python Individual Conditional Expectation Plot Toolbox
Interpretability By Parts ⭐ 97
Code repository for "Interpretable and Accurate Fine-grained Recognition via Region Grouping", CVPR 2020 (Oral)
Transformer Mm Explainability ⭐ 96
Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.
Breakdown ⭐ 93
Model Agnostics breakDown plots
Cxplain ⭐ 90
Causal Explanation (CXPlain) is a method for explaining the predictions of any machine-learning model.
Reverse Engineering Neural Networks ⭐ 86
A collection of tools for reverse engineering neural networks.
Adversarial Explainable Ai ⭐ 81
💡 A curated list of adversarial attacks on model explanations
Yggdrasil Decision Forests ⭐ 80
A collection of state-of-the-art algorithms for the training, serving and interpretation of Decision Forest models.
Cnn Interpretability ⭐ 78
🏥 Visualizing Convolutional Networks for MRI-based Diagnosis of Alzheimer’s Disease
Athena ⭐ 58
Automatic equation building and curve fitting. Runs on Tensorflow. Built for academia and research.
Text_nn ⭐ 56
Text classification models. Used a submodule for other projects.
Trelawney ⭐ 55
General Interpretability Package
Secml ⭐ 38
A Python library for Secure and Explainable Machine Learning
Contrastiveexplanation ⭐ 37
Contrastive Explanation (Foil Trees), developed at TNO/Utrecht University
Symbolic Metamodeling ⭐ 33
Codebase for "Demystifying Black-box Models with Symbolic Metamodels", NeurIPS 2019.
1-53 of 53 projects
Advertising 📦 10
All Projects
Application Programming Interfaces 📦 124
Applications 📦 192
Artificial Intelligence 📦 78
Blockchain 📦 73
Build Tools 📦 113
Cloud Computing 📦 80
Code Quality 📦 28
Collaboration 📦 32
Command Line Interface 📦 49
Community 📦 83
Companies 📦 60
Compilers 📦 63
Computer Science 📦 80
Configuration Management 📦 42
Content Management 📦 175
Control Flow 📦 213
Data Formats 📦 78
Data Processing 📦 276
Data Storage 📦 135
Economics 📦 64
Frameworks 📦 215
Games 📦 129
Graphics 📦 110
Hardware 📦 152
Integrated Development Environments 📦 49
Learning Resources 📦 166
Legal 📦 29
Libraries 📦 129
Lists Of Projects 📦 22
Machine Learning 📦 347
Mapping 📦 64
Marketing 📦 15
Mathematics 📦 55
Media 📦 239
Messaging 📦 98
Networking 📦 315
Operating Systems 📦 89
Operations 📦 121
Package Managers 📦 55
Programming Languages 📦 245
Runtime Environments 📦 100
Science 📦 42
Security 📦 396
Social Media 📦 27
Software Architecture 📦 72
Software Development 📦 72
Software Performance 📦 58
Software Quality 📦 133
Text Editors 📦 49
Text Processing 📦 136
User Interface 📦 330
User Interface Components 📦 514
Version Control 📦 30
Virtualization 📦 71
Web Browsers 📦 42
Web Servers 📦 26
Web User Interface 📦 210