The Top 112 Attention Open Source Projects

Awesome Open Source

Awesome Open Source

Combined Topics

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210

The Top 112 Attention Open Source Projects

Categories > Machine Learning > Attention

Numpy Ml ⭐ 10,159

Machine learning, in numpy

Nlp Tutorial ⭐ 9,082

Natural Language Processing Tutorial for Deep Learning Researchers

Attention Is All You Need Pytorch ⭐ 5,569

A PyTorch implementation of the Transformer model in "Attention is All You Need".

Pytorch Seq2seq ⭐ 3,068

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

Leader Line ⭐ 1,651

Draw a leader line in your web page.

Nlp Models Tensorflow ⭐ 1,548

Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0

Lambda Networks ⭐ 1,473

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

Nlp Journey ⭐ 1,336

Documents, papers and codes related to Natural Language Processing, including Topic Model, Word Embedding, Named Entity Recognition, Text Classificatin, Text Generation, Text Similarity, Machine Translation)，etc. All codes are implemented intensorflow 2.0.

Nlp_paper_study ⭐ 1,294

研读顶会论文，复现论文相关代码

Yolov4 Pytorch ⭐ 1,294

This is a pytorch repository of YOLOv4, attentive YOLOv4 and mobilenet YOLOv4 with PASCAL VOC and COCO

Absa Pytorch ⭐ 1,293

Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析，使用PyTorch实现。

Attention Transfer ⭐ 1,262

Improving Convolutional Networks via Attention Transfer (ICLR 2017)

Pytorch Gat ⭐ 1,184

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

External Attention Pytorch ⭐ 972

🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐

Spatial Transformer Network ⭐ 831

A Tensorflow implementation of Spatial Transformer Networks.

Tf Rnn Attention ⭐ 739

Tensorflow implementation of attention mechanism for text classification tasks.

Simplecvreproduction ⭐ 723

👊 Reproduce simple cv project including attention module, classification, object detection, segmentation, keypoint detection, tracking 😄 etc.

Gansformer ⭐ 711

Generative Adversarial Transformers

Awesome Fast Attention ⭐ 706

list of efficient attention modules

Text Classification ⭐ 702

Implementation of papers for text classification task on DBpedia

Performer Pytorch ⭐ 667

An implementation of Performer, a linear attention-based transformer, in Pytorch

Voice activity detection (VAD) toolkit including DNN, bDNN, LSTM and ACAM based VAD. We also provide our directly recorded dataset.

Speech Transformer ⭐ 607

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

Residual Attention Network ⭐ 534

Residual Attention Network for Image Classification

Punctuator2 ⭐ 519

A bidirectional recurrent neural network model with attention mechanism for restoring missing punctuation in unsegmented text

Nlp Tutorials ⭐ 513

Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com

Chinesenre ⭐ 498

中文实体关系抽取，pytorch，bilstm+attention

Self Attention Cv ⭐ 486

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

Structured Self Attention ⭐ 472

A Structured Self-attentive Sentence Embedding

Rnn Nlu ⭐ 467

A TensorFlow implementation of Recurrent Neural Networks for Sequence Classification and Sequence Labeling

Ban Vqa ⭐ 466

Bilinear attention networks for visual question answering

Pytorch Original Transformer ⭐ 459

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Mac Network ⭐ 453

Implementation for the paper "Compositional Attention Networks for Machine Reasoning" (Hudson and Manning, ICLR 2018)

Neural_sp ⭐ 452

End-to-end ASR/LM implementation with PyTorch

Recurrent Visual Attention ⭐ 424

A PyTorch Implementation of "Recurrent Models of Visual Attention"

Deep_learning_nlp ⭐ 417

Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP

Text Classification Models Pytorch ⭐ 404

Implementation of State-of-the-art Text Classification Models in Pytorch

Coordattention ⭐ 397

Code for our CVPR2021 paper coordinate attention

Ner Bert ⭐ 347

BERT-NER (nert-bert) with google bert https://github.com/google-research.

Deep Xi: A deep learning approach to a priori SNR estimation implemented in TensorFlow 2/Keras. For speech enhancement and robust ASR.

Transformer Tensorflow ⭐ 329

TensorFlow implementation of 'Attention Is All You Need (2017. 6)'

Crnn_attention_ocr_chinese ⭐ 320

CRNN with attention to do OCR,add Chinese recognition

Seq2seq Summarizer ⭐ 320

Pointer-generator reinforced seq2seq summarization in PyTorch

Long Range Arena ⭐ 309

Long Range Arena for Benchmarking Efficient Transformers

Medical Transformer ⭐ 301

Official Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation" - MICCAI 2021

Keras Transformer ⭐ 295

Transformer implemented in Keras

Mcan Vqa ⭐ 293

Deep Modular Co-Attention Networks for Visual Question Answering

Graphtransformer ⭐ 281

Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.

Abd Net ⭐ 279

[ICCV 2019] "ABD-Net: Attentive but Diverse Person Re-Identification" https://arxiv.org/abs/1908.01114

Attentionwalk ⭐ 277

A PyTorch Implementation of "Watch Your Step: Learning Node Embeddings via Graph Attention" (NeurIPS 2018).

Encoder_decoder ⭐ 272

Four styles of encoder decoder model by Python, Theano, Keras and Seq2Seq

Implementation of ABCNN(Attention-Based Convolutional Neural Network) on Tensorflow

⚠️[Deprecated] no longer maintained, please use the code in https://github.com/guoshnBJTU/ASTGCN-r-pytorch

A PyTorch implementation of "Predict then Propagate: Graph Neural Networks meet Personalized PageRank" (ICLR 2019).

Cgnl Network.pytorch ⭐ 254

Compact Generalized Non-local Network (NIPS 2018)

all kinds of baseline models for long text classificaiton( text categorization)

A PyTorch implementation of "Graph Classification Using Structural Attention" (KDD 2018).

Jddc_solution_4th ⭐ 237

2018-JDDC大赛第4名的解决方案

Pen Net For Inpainting ⭐ 235

[CVPR'2019] PEN-Net: Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting

Deep Time Series Prediction ⭐ 225

Seq2Seq, Bert, Transformer, WaveNet for time series prediction.

Neat Vision ⭐ 219

Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)

Guided Attention Inference Network ⭐ 213

Contains implementation of Guided Attention Inference Network (GAIN) presented in Tell Me Where to Look(CVPR 2018). This repository aims to apply GAIN on fcn8 architecture used for segmentation.

Doc Han Att ⭐ 208

Hierarchical Attention Networks for Chinese Sentiment Classification

Transformers.jl ⭐ 205

Julia Implementation of Transformer models

Graph_attention_pool ⭐ 200

Attention over nodes in Graph Neural Networks using PyTorch (NeurIPS 2019)

Multimodal Sentiment Analysis ⭐ 196

Attention-based multimodal fusion for sentiment analysis

Train and visualize Hierarchical Attention Networks

Pyramid Attention Networks Pytorch ⭐ 193

Implementation of Pyramid Attention Networks for Semantic Segmentation.

Datastories Semeval2017 Task4 ⭐ 190

Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".

Self Attentive Tensorflow ⭐ 190

Tensorflow implementation of "A Structured Self-Attentive Sentence Embedding"

Attentionn ⭐ 185

All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.

Rnn For Joint Nlu ⭐ 180

Pytorch implementation of "Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling" (https://arxiv.org/abs/1609.01454)

Transformer ⭐ 176

Implementation of "Attention Is All You Need" using pytorch

Prediction Flow ⭐ 168

Deep-Learning based CTR models implemented by PyTorch

Hey Jetson ⭐ 166

Deep Learning based Automatic Speech Recognition with attention for the Nvidia Jetson.

Fastpunct ⭐ 165

Punctuation restoration and spell correction experiments.

Chinese Chatbot ⭐ 155

中文聊天机器人，基于10万组对白训练而成，采用注意力机制，对一般问题都会生成一个有意义的答复。已上传模型，可直接运行，跑不起来直播吃键盘。

Multihead Siamese Nets ⭐ 154

Implementation of Siamese Neural Networks built upon multihead attention mechanism for text semantic similarity task.

Ccnet Pure Pytorch ⭐ 142

Criss-Cross Attention (2d&3d) for Semantic Segmentation in pure Pytorch with a faster and more precise implementation.

Image Caption Generator ⭐ 140

A neural network to generate captions for an image using CNN and RNN with BEAM Search.

Vqa_regat ⭐ 140

Research Code for ICCV 2019 paper "Relation-aware Graph Attention Network for Visual Question Answering"

Absa_keras ⭐ 131

Keras Implementation of Aspect based Sentiment Analysis

Asr_syllable ⭐ 131

基于卷积神经网络的语音识别声学模型的研究

Enjoy Hamburger ⭐ 126

[ICLR 2021 top 3%] Is Attention Better Than Matrix Decomposition?

Multiturndialogzoo ⭐ 119

Multi-turn dialogue baselines written in PyTorch

Sightseq ⭐ 115

Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection

Bertqa Attention On Steroids ⭐ 114

BertQA - Attention on Steroids

Cnn_lstm_for_text_classify ⭐ 102

CNN, LSTM, NBOW, fasttext 中文文本分类

Captcharecognition ⭐ 100

End-to-end variable length Captcha recognition using CNN+RNN+Attention/CTC (pytorch implementation). 端到端的不定长验证码识别

Njunmt Tf ⭐ 96

An open-source neural machine translation system developed by Natural Language Processing Group, Nanjing University.

Self Attention Classification ⭐ 90

document classification using LSTM + self attention

Machine Learning ⭐ 85

My Attempt(s) In The World Of ML/DL....

Eval On Nn Of Rc ⭐ 84

Empirical Evaluation on Current Neural Networks on Cloze-style Reading Comprehension

Attend_infer_repeat ⭐ 82

A Tensorfflow implementation of Attend, Infer, Repeat

Hierarchical Attention Transfer Network for Cross-domain Sentiment Classification (AAAI'18)

Global Self Attention Network ⭐ 71

A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks

Deeplearning Nlp Models ⭐ 66

A small, interpretable codebase containing the re-implementation of a few "deep" NLP models in PyTorch. Colab notebooks to run with GPUs. Models: word2vec, CNNs, transformer, gpt.

Attention Over Attention Tf Qa ⭐ 58

论文“Attention-over-Attention Neural Networks for Reading Comprehension”中AoA模型实现

A deep learning library based on Pytorch focussed on low resource language research and robustness

Time Attention ⭐ 56

Implementation of RNN for Time Series prediction from the paper https://arxiv.org/abs/1704.02971

1-100 of 112 projects

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210