The Top 110 Attention Open Source Projects

Awesome Open Source

Awesome Open Source

Combined Topics

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210

The Top 110 Attention Open Source Projects

Categories > Machine Learning > Attention

Numpy Ml ⭐ 9,677

Machine learning, in numpy

Nlp Tutorial ⭐ 8,670

Natural Language Processing Tutorial for Deep Learning Researchers

Attention Is All You Need Pytorch ⭐ 5,203

A PyTorch implementation of the Transformer model in "Attention is All You Need".

Pytorch Seq2seq ⭐ 2,787

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

Leader Line ⭐ 1,501

Draw a leader line in your web page.

Nlp Models Tensorflow ⭐ 1,499

Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0

Lambda Networks ⭐ 1,437

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

Nlp Journey ⭐ 1,296

Documents, papers and codes related to Natural Language Processing, including Topic Model, Word Embedding, Named Entity Recognition, Text Classificatin, Text Generation, Text Similarity, Machine Translation)，etc. All codes are implemented intensorflow 2.0.

Attention Transfer ⭐ 1,235

Improving Convolutional Networks via Attention Transfer (ICLR 2017)

Absa Pytorch ⭐ 1,217

Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析，使用PyTorch实现。

Yolov4 Pytorch ⭐ 1,140

This is a pytorch repository of YOLOv4, attentive YOLOv4 and mobilenet YOLOv4 with PASCAL VOC and COCO

Pytorch Gat ⭐ 1,010

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

Nlp_paper_study ⭐ 887

研读顶会论文，复现论文相关代码

Spatial Transformer Network ⭐ 808

A Tensorflow implementation of Spatial Transformer Networks.

Tf Rnn Attention ⭐ 738

Tensorflow implementation of attention mechanism for text classification tasks.

Text Classification ⭐ 686

Implementation of papers for text classification task on DBpedia

Awesome Fast Attention ⭐ 652

list of efficient attention modules

Simplecvreproduction ⭐ 631

Reproduce simple cv project including attention module, classification, object detection, segmentation, keypoint detection, tracking 😄 etc.

Voice activity detection (VAD) toolkit including DNN, bDNN, LSTM and ACAM based VAD. We also provide our directly recorded dataset.

Performer Pytorch ⭐ 578

An implementation of Performer, a linear attention-based transformer, in Pytorch

Speech Transformer ⭐ 574

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

Residual Attention Network ⭐ 527

Residual Attention Network for Image Classification

Gansformer ⭐ 491

Generative Adversarial Transformers

Punctuator2 ⭐ 488

A bidirectional recurrent neural network model with attention mechanism for restoring missing punctuation in unsegmented text

Chinesenre ⭐ 472

中文实体关系抽取，pytorch，bilstm+attention

Rnn Nlu ⭐ 463

A TensorFlow implementation of Recurrent Neural Networks for Sequence Classification and Sequence Labeling

Structured Self Attention ⭐ 461

A Structured Self-attentive Sentence Embedding

Ban Vqa ⭐ 452

Bilinear attention networks for visual question answering

Mac Network ⭐ 444

Implementation for the paper "Compositional Attention Networks for Machine Reasoning" (Hudson and Manning, ICLR 2018)

Pytorch Original Transformer ⭐ 424

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Nlp Tutorials ⭐ 422

Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com

Recurrent Visual Attention ⭐ 421

A PyTorch Implementation of "Recurrent Models of Visual Attention"

Neural_sp ⭐ 419

End-to-end ASR/LM implementation with PyTorch

Deep_learning_nlp ⭐ 410

Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP

Text Classification Models Pytorch ⭐ 394

Implementation of State-of-the-art Text Classification Models in Pytorch

Ner Bert ⭐ 342

BERT-NER (nert-bert) with google bert https://github.com/google-research.

Self Attention Cv ⭐ 330

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

Transformer Tensorflow ⭐ 324

TensorFlow implementation of 'Attention Is All You Need (2017. 6)'

Crnn_attention_ocr_chinese ⭐ 316

CRNN with attention to do OCR,add Chinese recognition

Deep Xi: A deep learning approach to a priori SNR estimation implemented in TensorFlow 2/Keras. For speech enhancement and robust ASR.

Seq2seq Summarizer ⭐ 310

Pointer-generator reinforced seq2seq summarization in PyTorch

Keras Transformer ⭐ 280

Transformer implemented in Keras

Mcan Vqa ⭐ 277

Deep Modular Co-Attention Networks for Visual Question Answering

Abd Net ⭐ 273

[ICCV 2019] "ABD-Net: Attentive but Diverse Person Re-Identification" https://arxiv.org/abs/1908.01114

Encoder_decoder ⭐ 271

Four styles of encoder decoder model by Python, Theano, Keras and Seq2Seq

Attentionwalk ⭐ 267

A PyTorch Implementation of "Watch Your Step: Learning Node Embeddings via Graph Attention" (NeurIPS 2018).

Implementation of ABCNN(Attention-Based Convolutional Neural Network) on Tensorflow

⚠️[Deprecated] no longer maintained, please use the code in https://github.com/guoshnBJTU/ASTGCN-r-pytorch

Cgnl Network.pytorch ⭐ 253

Compact Generalized Non-local Network (NIPS 2018)

Long Range Arena ⭐ 250

Long Range Arena for Benchmarking Efficient Transformers

all kinds of baseline models for long text classificaiton( text categorization)

A PyTorch implementation of "Predict then Propagate: Graph Neural Networks meet Personalized PageRank" (ICLR 2019).

Jddc_solution_4th ⭐ 235

2018-JDDC大赛第4名的解决方案

A PyTorch implementation of "Graph Classification Using Structural Attention" (KDD 2018).

Graphtransformer ⭐ 219

Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.

Neat Vision ⭐ 215

Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)

Pen Net For Inpainting ⭐ 215

[CVPR'2019]PEN-Net: Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting

Doc Han Att ⭐ 207

Hierarchical Attention Networks for Chinese Sentiment Classification

Guided Attention Inference Network ⭐ 206

Contains implementation of Guided Attention Inference Network (GAIN) presented in Tell Me Where to Look(CVPR 2018). This repository aims to apply GAIN on fcn8 architecture used for segmentation.

Deep Time Series Prediction ⭐ 198

Seq2Seq, Bert, Transformer, WaveNet for time series prediction.

Medical Transformer ⭐ 193

Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation"

Train and visualize Hierarchical Attention Networks

Graph_attention_pool ⭐ 190

Attention over nodes in Graph Neural Networks using PyTorch (NeurIPS 2019)

Self Attentive Tensorflow ⭐ 189

Tensorflow implementation of "A Structured Self-Attentive Sentence Embedding"

Datastories Semeval2017 Task4 ⭐ 187

Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".

Pyramid Attention Networks Pytorch ⭐ 187

Implementation of Pyramid Attention Networks for Semantic Segmentation.

Transformers.jl ⭐ 186

Julia Implementation of Transformer models

Multimodal Sentiment Analysis ⭐ 182

Attention-based multimodal fusion for sentiment analysis

Rnn For Joint Nlu ⭐ 177

Pytorch implementation of "Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling" (https://arxiv.org/abs/1609.01454)

Attentionn ⭐ 176

All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.

Hey Jetson ⭐ 164

Deep Learning based Automatic Speech Recognition with attention for the Nvidia Jetson.

Prediction Flow ⭐ 150

Deep-Learning based CTR models implemented by PyTorch

Multihead Siamese Nets ⭐ 146

Implementation of Siamese Neural Networks built upon multihead attention mechanism for text semantic similarity task.

Image Caption Generator ⭐ 133

A neural network to generate captions for an image using CNN and RNN with BEAM Search.

Chinese Chatbot ⭐ 133

中文聊天机器人，基于10万组对白训练而成，采用注意力机制，对一般问题都会生成一个有意义的答复。已上传模型，可直接运行，跑不起来直播吃键盘。

Fastpunct ⭐ 133

Punctuation restoration and spell correction experiments.

Vqa_regat ⭐ 131

Research Code for ICCV 2019 paper "Relation-aware Graph Attention Network for Visual Question Answering"

Asr_syllable ⭐ 129

基于卷积神经网络的语音识别声学模型的研究

Transformer ⭐ 129

Implementation of "Attention Is All You Need" using pytorch

Ccnet Pure Pytorch ⭐ 128

Criss-Cross Attention (2d&3d) for Semantic Segmentation in pure Pytorch with a faster and more precise implementation.

Absa_keras ⭐ 126

Keras Implementation of Aspect based Sentiment Analysis

Sightseq ⭐ 116

Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection

Bertqa Attention On Steroids ⭐ 112

BertQA - Attention on Steroids

Multiturndialogzoo ⭐ 108

Multi-turn dialogue baselines written in PyTorch

Captcharecognition ⭐ 99

End-to-end variable length Captcha recognition using CNN+RNN+Attention/CTC (pytorch implementation). 端到端的不定长验证码识别

Njunmt Tf ⭐ 97

An open-source neural machine translation system developed by Natural Language Processing Group, Nanjing University.

Cnn_lstm_for_text_classify ⭐ 92

CNN, LSTM, NBOW, fasttext 中文文本分类

Enjoy Hamburger ⭐ 90

[ICLR 2021] Is Attention Better Than Matrix Decomposition?

Self Attention Classification ⭐ 85

document classification using LSTM + self attention

Eval On Nn Of Rc ⭐ 84

Empirical Evaluation on Current Neural Networks on Cloze-style Reading Comprehension

Machine Learning ⭐ 82

My Attempt(s) In The World Of ML/DL....

Attend_infer_repeat ⭐ 82

A Tensorfflow implementation of Attend, Infer, Repeat

Hierarchical Attention Transfer Network for Cross-domain Sentiment Classification (AAAI'18)

Deeplearning Nlp Models ⭐ 64

A small, interpretable codebase containing the re-implementation of a few "deep" NLP models in PyTorch. Colab notebooks to run with GPUs. Models: word2vec, CNNs, transformer, gpt.

Global Self Attention Network ⭐ 64

A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks

Attention Over Attention Tf Qa ⭐ 58

论文“Attention-over-Attention Neural Networks for Reading Comprehension”中AoA模型实现

Time Attention ⭐ 54

Implementation of RNN for Time Series prediction from the paper https://arxiv.org/abs/1704.02971

A deep learning library based on Pytorch focussed on low resource language research and robustness

Pointer Networks Experiments ⭐ 53

Sorting numbers with pointer networks

Text Classification Keras ⭐ 53

📚 Text classification library with Keras

1-100 of 110 projects

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210