Awesome Open Source
Awesome Open Source
Combined Topics
attention x
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194

The Top 485 Attention Open Source Projects on Github

Categories > Machine Learning > Attention
Numpy Ml ⭐ 10,559
Machine learning, in numpy
Nlp Tutorial ⭐ 9,097
Natural Language Processing Tutorial for Deep Learning Researchers
Attention Is All You Need Pytorch ⭐ 5,976
A PyTorch implementation of the Transformer model in "Attention is All You Need".
Pytorch Seq2seq ⭐ 2,634
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
External Attention Pytorch ⭐ 2,568
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
Leader Line ⭐ 1,827
Draw a leader line in your web page.
Nlp_paper_study ⭐ 1,818
研读顶会论文，复现论文相关代码
Nlp Models Tensorflow ⭐ 1,329
Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0
Nlp Journey ⭐ 1,328
Documents, papers and codes related to Natural Language Processing, including Topic Model, Word Embedding, Named Entity Recognition, Text Classificatin, Text Generation, Text Similarity, Machine Translation)，etc. All codes are implemented intensorflow 2.0.
Absa Pytorch ⭐ 1,307
Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析，使用PyTorch实现。
Yolov4 Pytorch ⭐ 1,240
This is a pytorch repository of YOLOv4, attentive YOLOv4 and mobilenet YOLOv4 with PASCAL VOC and COCO
Attention Transfer ⭐ 1,120
Improving Convolutional Networks via Attention Transfer (ICLR 2017)
Lambda Networks ⭐ 1,110
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
Gansformer ⭐ 963
Generative Adversarial Transformers
Simplecvreproduction ⭐ 793
👊 Reproduce simple cv project including attention module, classification, object detection, segmentation, keypoint detection, tracking 😄 etc.
Performer Pytorch ⭐ 733
An implementation of Performer, a linear attention-based transformer, in Pytorch
Pytorch Gat ⭐ 719
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
Awesome Fast Attention ⭐ 717
list of efficient attention modules
Tf Rnn Attention ⭐ 703
Tensorflow implementation of attention mechanism for text classification tasks.
Spatial Transformer Network ⭐ 661
A Tensorflow implementation of Spatial Transformer Networks.
Vad ⭐ 632
Voice activity detection (VAD) toolkit including DNN, bDNN, LSTM and ACAM based VAD. We also provide our directly recorded dataset.
Text Classification ⭐ 622
Implementation of papers for text classification task on DBpedia
Self Attention Cv ⭐ 550
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
Residual Attention Network ⭐ 534
Residual Attention Network for Image Classification
Punctuator2 ⭐ 532
A bidirectional recurrent neural network model with attention mechanism for restoring missing punctuation in unsegmented text
Chinesenre ⭐ 523
中文实体关系抽取，pytorch，bilstm+attention
Nlp Tutorials ⭐ 504
Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com
Ban Vqa ⭐ 469
Bilinear attention networks for visual question answering
Neural_sp ⭐ 466
End-to-end ASR/LM implementation with PyTorch
Rnn Nlu ⭐ 454
A TensorFlow implementation of Recurrent Neural Networks for Sequence Classification and Sequence Labeling
Mac Network ⭐ 445
Implementation for the paper "Compositional Attention Networks for Machine Reasoning" (Hudson and Manning, ICLR 2018)
Scenic ⭐ 436
Scenic: A Jax Library for Computer Vision Research and Beyond
Structured Self Attention ⭐ 412
A Structured Self-attentive Sentence Embedding
Speech Transformer ⭐ 406
A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.
Medical Transformer ⭐ 397
Official Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation" - MICCAI 2021
Pytorch Original Transformer ⭐ 376
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
Recurrent Visual Attention ⭐ 367
A PyTorch Implementation of "Recurrent Models of Visual Attention"
Deep_learning_nlp ⭐ 359
Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP
Coordattention ⭐ 356
Code for our CVPR2021 paper coordinate attention
Deepxi ⭐ 346
Deep Xi: A deep learning approach to a priori SNR estimation implemented in TensorFlow 2/Keras. For speech enhancement and robust ASR.
Ner Bert ⭐ 345
BERT-NER (nert-bert) with google bert https://github.com/google-research.
Long Range Arena ⭐ 335
Long Range Arena for Benchmarking Efficient Transformers
Text Classification Models Pytorch ⭐ 309
Implementation of State-of-the-art Text Classification Models in Pytorch
Keras Transformer ⭐ 305
Transformer implemented in Keras
Transformer Tensorflow ⭐ 304
TensorFlow implementation of 'Attention Is All You Need (2017. 6)'
Crnn_attention_ocr_chinese ⭐ 292
CRNN with attention to do OCR,add Chinese recognition
Graphtransformer ⭐ 285
Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.
Attentionwalk ⭐ 279
A PyTorch Implementation of "Watch Your Step: Learning Node Embeddings via Graph Attention" (NeurIPS 2018).
Abd Net ⭐ 277
[ICCV 2019] "ABD-Net: Attentive but Diverse Person Re-Identification" https://arxiv.org/abs/1908.01114
Appnp ⭐ 265
A PyTorch implementation of "Predict then Propagate: Graph Neural Networks meet Personalized PageRank" (ICLR 2019).
Seq2seq Summarizer ⭐ 259
Pointer-generator reinforced seq2seq summarization in PyTorch
Encoder_decoder ⭐ 256
Four styles of encoder decoder model by Python, Theano, Keras and Seq2Seq
Cgnl Network.pytorch ⭐ 253
Compact Generalized Non-local Network (NIPS 2018)
Abcnn ⭐ 252
Implementation of ABCNN(Attention-Based Convolutional Neural Network) on Tensorflow
Transformers.jl ⭐ 248
Julia Implementation of Transformer models
Gam ⭐ 245
A PyTorch implementation of "Graph Classification Using Structural Attention" (KDD 2018).
Pen Net For Inpainting ⭐ 235
[CVPR'2019] PEN-Net: Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting
Ai_law ⭐ 229
all kinds of baseline models for long text classificaiton( text categorization)
Jddc_solution_4th ⭐ 225
2018-JDDC大赛第4名的解决方案
Multimodal Sentiment Analysis ⭐ 205
Attention-based multimodal fusion for sentiment analysis
Doc Han Att ⭐ 193
Hierarchical Attention Networks for Chinese Sentiment Classification
Self Attentive Tensorflow ⭐ 190
Tensorflow implementation of "A Structured Self-Attentive Sentence Embedding"
Guided Attention Inference Network ⭐ 187
Contains implementation of Guided Attention Inference Network (GAIN) presented in Tell Me Where to Look(CVPR 2018). This repository aims to apply GAIN on fcn8 architecture used for segmentation.
Astgcn ⭐ 183
Attention Based Spatial-Temporal Graph Convolutional Networks for Traffic Flow Forecasting (ASTGCN) AAAI 2019
Hnatt ⭐ 182
Train and visualize Hierarchical Attention Networks
Mcan Vqa ⭐ 181
Deep Modular Co-Attention Networks for Visual Question Answering
Neat Vision ⭐ 175
Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)
Datastories Semeval2017 Task4 ⭐ 171
Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".
Hey Jetson ⭐ 169
Deep Learning based Automatic Speech Recognition with attention for the Nvidia Jetson.
Enjoy Hamburger ⭐ 167
[ICLR 2021 top 3%] Is Attention Better Than Matrix Decomposition?
Deep Time Series Prediction ⭐ 165
Seq2Seq, Bert, Transformer, WaveNet for time series prediction.
Rnn For Joint Nlu ⭐ 165
Pytorch implementation of "Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling" (https://arxiv.org/abs/1609.01454)
Graph_attention_pool ⭐ 161
Attention over nodes in Graph Neural Networks using PyTorch (NeurIPS 2019)
Pyramid Attention Networks Pytorch ⭐ 153
Implementation of Pyramid Attention Networks for Semantic Segmentation.
Fastpunct ⭐ 152
Punctuation restoration and spell correction experiments.
Attentionn ⭐ 147
All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
Transformer ⭐ 146
Implementation of "Attention Is All You Need" using pytorch
Tldr Transformers ⭐ 144
The "tl;dr" on a few notable transformer papers.
Prediction Flow ⭐ 136
Deep-Learning based CTR models implemented by PyTorch
Vqa_regat ⭐ 130
Research Code for ICCV 2019 paper "Relation-aware Graph Attention Network for Visual Question Answering"
Ccnet Pure Pytorch ⭐ 127
Criss-Cross Attention for Semantic Segmentation in pure Pytorch with a faster and more precise implementation.
Traffic_prediction ⭐ 123
Traffic prediction is the task of predicting future traffic measurements (e.g. volume, speed, etc.) in a road network (graph), using historical data (timeseries).
Multihead Siamese Nets ⭐ 115
Implementation of Siamese Neural Networks built upon multihead attention mechanism for text semantic similarity task.
Asr_syllable ⭐ 112
基于卷积神经网络的语音识别声学模型的研究
Sightseq ⭐ 109
🔭 Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection
Bertqa Attention On Steroids ⭐ 105
BertQA - Attention on Steroids
Absa_keras ⭐ 103
Keras Implementation of Aspect based Sentiment Analysis
H Transformer 1d ⭐ 100
Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
Amc_att ⭐ 95
AMC: Attention guided Multi-modal Correlation Learning for Image Search
Pytorch Agnn ⭐ 94
Pytorch implementation of the Attention-based Graph Neural Network(AGNN)
Captcharecognition ⭐ 91
End-to-end variable length Captcha recognition using CNN+RNN+Attention/CTC (pytorch implementation). 端到端的不定长验证码识别
Self Attentive Emb Tf ⭐ 91
Simple Tensorflow Implementation of "A Structured Self-attentive Sentence Embedding" (ICLR 2017)
Njunmt Tf ⭐ 90
An open-source neural machine translation system developed by Natural Language Processing Group, Nanjing University.
Nmt ⭐ 89
Attention-based NMT with Coverage, Context Gate, and Reconstruction
Residual_attention_network ⭐ 88
Keras implementation of Residual Attention Network
Machine Learning ⭐ 85
My Attempt(s) In The World Of ML/DL....
Eval On Nn Of Rc ⭐ 84
Empirical Evaluation on Current Neural Networks on Cloze-style Reading Comprehension
Attentions ⭐ 83
PyTorch implementation of some attentions for Deep Learning Researchers.
Various Attention Mechanisms ⭐ 81
This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention etc in Pytorch, Tensorflow, Keras
Mgcam ⭐ 79
Mask data and code for 'Mask-guided Contrastive Attention Model for Person Re-Identification' (CVPR-2018)
1-100 of 485 projects

Related Projects

Python Attention Projects (340)
Pytorch Attention Projects (141)
Deep Learning Attention Projects (117)
Python Pytorch Attention Projects (115)
Tensorflow Attention Projects (96)
Transformer Attention Projects (90)
Jupyter Notebook Attention Projects (89)
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194
Privacy policy
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.

All non readme contents or Github based topics or project metadata copyright Awesome Open Source 2018-2021