Awesome Open Source
Awesome Open Source
Combined Topics
attention x
python x
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194

The Top 345 Python Attention Open Source Projects on Github

Categories > Machine Learning > Attention
Numpy Ml ⭐ 11,141
Machine learning, in numpy
Attention Is All You Need Pytorch ⭐ 5,976
A PyTorch implementation of the Transformer model in "Attention is All You Need".
External Attention Pytorch ⭐ 2,884
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
Absa Pytorch ⭐ 1,446
Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析，使用PyTorch实现。
Yolov4 Pytorch ⭐ 1,440
This is a pytorch repository of YOLOv4, attentive YOLOv4 and mobilenet YOLOv4 with PASCAL VOC and COCO
Nlp Journey ⭐ 1,328
Documents, papers and codes related to Natural Language Processing, including Topic Model, Word Embedding, Named Entity Recognition, Text Classificatin, Text Generation, Text Similarity, Machine Translation)，etc. All codes are implemented intensorflow 2.0.
Lambda Networks ⭐ 1,110
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
Gansformer ⭐ 1,040
Generative Adversarial Transformers
Simplecvreproduction ⭐ 838
👊 Reproduce simple cv project including attention module, classification, object detection, segmentation, keypoint detection, tracking 😄 etc.
Performer Pytorch ⭐ 733
An implementation of Performer, a linear attention-based transformer, in Pytorch
Pytorch Gat ⭐ 719
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
Awesome Fast Attention ⭐ 717
list of efficient attention modules
Tf Rnn Attention ⭐ 703
Tensorflow implementation of attention mechanism for text classification tasks.
Scenic ⭐ 695
Scenic: A Jax Library for Computer Vision Research and Beyond
Spatial Transformer Network ⭐ 661
A Tensorflow implementation of Spatial Transformer Networks.
Text Classification ⭐ 622
Implementation of papers for text classification task on DBpedia
Nlp Tutorials ⭐ 598
Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com
Self Attention Cv ⭐ 550
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
Punctuator2 ⭐ 532
A bidirectional recurrent neural network model with attention mechanism for restoring missing punctuation in unsegmented text
Chinesenre ⭐ 523
中文实体关系抽取，pytorch，bilstm+attention
Ban Vqa ⭐ 478
Bilinear attention networks for visual question answering
Neural_sp ⭐ 466
End-to-end ASR/LM implementation with PyTorch
Rnn Nlu ⭐ 454
A TensorFlow implementation of Recurrent Neural Networks for Sequence Classification and Sequence Labeling
Mac Network ⭐ 445
Implementation for the paper "Compositional Attention Networks for Machine Reasoning" (Hudson and Manning, ICLR 2018)
Structured Self Attention ⭐ 412
A Structured Self-attentive Sentence Embedding
Speech Transformer ⭐ 406
A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.
Medical Transformer ⭐ 397
Official Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation" - MICCAI 2021
Pytorch Original Transformer ⭐ 376
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
Recurrent Visual Attention ⭐ 367
A PyTorch Implementation of "Recurrent Models of Visual Attention"
Coordattention ⭐ 356
Code for our CVPR2021 paper coordinate attention
Ner Bert ⭐ 345
BERT-NER (nert-bert) with google bert https://github.com/google-research.
Long Range Arena ⭐ 335
Long Range Arena for Benchmarking Efficient Transformers
Keras Transformer ⭐ 312
Transformer implemented in Keras
Text Classification Models Pytorch ⭐ 309
Implementation of State-of-the-art Text Classification Models in Pytorch
Transformer Tensorflow ⭐ 304
TensorFlow implementation of 'Attention Is All You Need (2017. 6)'
Crnn_attention_ocr_chinese ⭐ 292
CRNN with attention to do OCR,add Chinese recognition
Deep Time Series Prediction ⭐ 287
Seq2Seq, Bert, Transformer, WaveNet for time series prediction.
Attentionwalk ⭐ 286
A PyTorch Implementation of "Watch Your Step: Learning Node Embeddings via Graph Attention" (NeurIPS 2018).
Graphtransformer ⭐ 285
Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.
Appnp ⭐ 274
A PyTorch implementation of "Predict then Propagate: Graph Neural Networks meet Personalized PageRank" (ICLR 2019).
Seq2seq Summarizer ⭐ 259
Pointer-generator reinforced seq2seq summarization in PyTorch
Transformer ⭐ 258
Implementation of "Attention Is All You Need" using pytorch
Encoder_decoder ⭐ 256
Four styles of encoder decoder model by Python, Theano, Keras and Seq2Seq
Cgnl Network.pytorch ⭐ 253
Compact Generalized Non-local Network (NIPS 2018)
Abcnn ⭐ 252
Implementation of ABCNN(Attention-Based Convolutional Neural Network) on Tensorflow
Gam ⭐ 245
A PyTorch implementation of "Graph Classification Using Structural Attention" (KDD 2018).
Pen Net For Inpainting ⭐ 235
[CVPR'2019] PEN-Net: Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting
Ai_law ⭐ 229
all kinds of baseline models for long text classificaiton( text categorization)
Multimodal Sentiment Analysis ⭐ 205
Attention-based multimodal fusion for sentiment analysis
Self Attentive Tensorflow ⭐ 190
Tensorflow implementation of "A Structured Self-Attentive Sentence Embedding"
Guided Attention Inference Network ⭐ 187
Contains implementation of Guided Attention Inference Network (GAIN) presented in Tell Me Where to Look(CVPR 2018). This repository aims to apply GAIN on fcn8 architecture used for segmentation.
Astgcn ⭐ 183
Attention Based Spatial-Temporal Graph Convolutional Networks for Traffic Flow Forecasting (ASTGCN) AAAI 2019
Hnatt ⭐ 182
Train and visualize Hierarchical Attention Networks
Mcan Vqa ⭐ 181
Deep Modular Co-Attention Networks for Visual Question Answering
Datastories Semeval2017 Task4 ⭐ 171
Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".
Hey Jetson ⭐ 169
Deep Learning based Automatic Speech Recognition with attention for the Nvidia Jetson.
Enjoy Hamburger ⭐ 167
[ICLR 2021 top 3%] Is Attention Better Than Matrix Decomposition?
Pyramid Attention Networks Pytorch ⭐ 153
Implementation of Pyramid Attention Networks for Semantic Segmentation.
Visualization ⭐ 142
a collection of visualization function
Prediction Flow ⭐ 136
Deep-Learning based CTR models implemented by PyTorch
Vqa_regat ⭐ 130
Research Code for ICCV 2019 paper "Relation-aware Graph Attention Network for Visual Question Answering"
Ccnet Pure Pytorch ⭐ 127
Criss-Cross Attention for Semantic Segmentation in pure Pytorch with a faster and more precise implementation.
Asr_syllable ⭐ 112
基于卷积神经网络的语音识别声学模型的研究
Sightseq ⭐ 109
🔭 Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection
Bertqa Attention On Steroids ⭐ 105
BertQA - Attention on Steroids
Absa_keras ⭐ 103
Keras Implementation of Aspect based Sentiment Analysis
H Transformer 1d ⭐ 100
Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
Gnn Lspe ⭐ 99
Source code for GNN-LSPE (Graph Neural Networks with Learnable Structural and Positional Representations)
Amc_att ⭐ 95
AMC: Attention guided Multi-modal Correlation Learning for Image Search
Pytorch Agnn ⭐ 94
Pytorch implementation of the Attention-based Graph Neural Network(AGNN)
Self Attentive Emb Tf ⭐ 91
Simple Tensorflow Implementation of "A Structured Self-attentive Sentence Embedding" (ICLR 2017)
Captcharecognition ⭐ 91
End-to-end variable length Captcha recognition using CNN+RNN+Attention/CTC (pytorch implementation). 端到端的不定长验证码识别
Njunmt Tf ⭐ 90
An open-source neural machine translation system developed by Natural Language Processing Group, Nanjing University.
Machine Learning ⭐ 88
My Attempt(s) In The World Of ML/DL....
Attentions ⭐ 83
PyTorch implementation of some attentions for Deep Learning Researchers.
Various Attention Mechanisms ⭐ 81
This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention etc in Pytorch, Tensorflow, Keras
How_attentive_are_gats ⭐ 81
Code for the paper "How Attentive are Graph Attention Networks?"
Attention Target Detection ⭐ 78
[CVPR2020] "Detecting Attended Visual Targets in Video"
Deeplearningreading ⭐ 78
Deep Learning and Machine Learning mini-projects. Current Project: Deepmind Attentive Reader (rc-data)
Attend_infer_repeat ⭐ 77
A Tensorfflow implementation of Attend, Infer, Repeat
Slqa ⭐ 75
An Unofficial Pytorch Implementation of Multi-Granularity Hierarchical Attention Fusion Networks for Reading Comprehension and Question Answering
Diverse Structure Inpainting ⭐ 72
CVPR 2021: "Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAE"
Cnn_lstm_for_text_classify ⭐ 70
CNN, LSTM, NBOW, fasttext 中文文本分类
Prime ⭐ 70
A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.
Image Caption Generator ⭐ 70
A neural network to generate captions for an image using CNN and RNN with BEAM Search.
Hatn ⭐ 67
Hierarchical Attention Transfer Network for Cross-domain Sentiment Classification (AAAI'18)
Self Attention Classification ⭐ 64
document classification using LSTM + self attention
My_seq2seq ⭐ 62
My seq2seq based on tensorflow
Ntua Slp Semeval2018 ⭐ 58
Deep-learning models of NTUA-SLP team submitted in SemEval 2018 tasks 1, 2 and 3.
Arelu ⭐ 58
AReLU: Attention-based-Rectified-Linear-Unit
Fluence ⭐ 58
A deep learning library based on Pytorch focussed on low resource language research and robustness
Pop Music Highlighter ⭐ 57
"Pop Music Highlighter: Marking the Emotion Keypoints", TISMIR vol. 1, no. 1
Pointer Networks Experiments ⭐ 55
Sorting numbers with pointer networks
Attention Over Attention Tf Qa ⭐ 55
论文“Attention-over-Attention Neural Networks for Reading Comprehension”中AoA模型实现
Recurrent Independent Mechanisms ⭐ 53
Implementation of the paper Recurrent Independent Mechanisms (https://arxiv.org/pdf/1909.10893.pdf)
Xiaox ⭐ 51
flask+seq2seq【TensorFlow1.0, Pytorch】 🎨 🎨 在线聊天机器人 https://mp.weixin.qq.com/s/VpiAmVSTin3ALA8MnzhCJA 或 https://ask.hellobi.com/blog/python_shequ/14486
Text Classification Keras ⭐ 50
📚 Text Classification Library with Keras
Perceiver ⭐ 50
Implementation of Perceiver, General Perception with Iterative Attention in TensorFlow
Mtad Gat Pytorch ⭐ 49
PyTorch implementation of MTAD-GAT (Multivariate Time-Series Anomaly Detection via Graph Attention Networks) by Zhao et. al (2020, https://arxiv.org/abs/2009.02040).
Global Self Attention Network ⭐ 49
A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks
1-100 of 345 projects

Related Projects

Python Python3 Projects (28,842)
Python Machine Learning Projects (15,935)
Python Deep Learning Projects (13,270)
Python Jupyter Notebook Projects (11,030)
Python Pytorch Projects (8,523)
Python Tensorflow Projects (8,444)
Python Flask Projects (8,333)
Python Html Projects (5,235)
Python Nlp Projects (4,425)
Python Computer Vision Projects (4,368)
Python Neural Network Projects (4,360)
Python Keras Projects (3,711)
Python Jupyter Notebook Machine Learning Projects (3,020)
Python Deep Learning Pytorch Projects (2,974)
Python Deep Learning Tensorflow Projects (2,673)
Python Artificial Intelligence Projects (2,625)
Python Reinforcement Learning Projects (2,529)
Python Natural Language Processing Projects (2,522)
Python Css Projects (2,510)
Python Convolutional Neural Networks Projects (2,123)
Python Ai Projects (1,912)
Python Machine Learning Tensorflow Projects (1,902)
Python Cnn Projects (1,886)
Python Deep Learning Neural Network Projects (1,832)
Python Deep Learning Computer Vision Projects (1,784)
Python Machine Learning Neural Network Projects (1,720)
Python Tensorflow Keras Projects (1,669)
Python Object Detection Projects (1,600)
Python Deep Neural Networks Projects (1,573)
Python Classification Projects (1,550)
Python Visualization Projects (1,546)
Python Dataset Projects (1,478)
Python Rest Api Projects (1,463)
Python Data Visualization Projects (1,461)
Python Deep Learning Keras Projects (1,444)
Python Html Css Projects (1,402)
Python Jupyter Notebook Deep Learning Projects (1,371)
Python Twitter Projects (1,349)
Python Tutorial Projects (1,329)
Python Machine Learning Pytorch Projects (1,302)
Python Machine Learning Artificial Intelligence Projects (1,180)
Python Lstm Projects (1,147)
Python Html Flask Projects (1,127)
Python Machine Learning Algorithms Projects (1,121)
Python Deep Learning Convolutional Neural Networks Projects (1,093)
Python Jupyter Projects (1,075)
Python Sentiment Analysis Projects (1,056)
Python Transformer Projects (964)
Python Graph Projects (931)
Python Generative Adversarial Network Projects (917)
Python Sklearn Projects (906)
Python Segmentation Projects (866)
Python Face Detection Projects (835)
Python Deep Learning Artificial Intelligence Projects (823)
Python Nlp Natural Language Processing Projects (807)
Python Jupyter Notebook Tensorflow Projects (801)
Python Bert Projects (738)
Python Time Series Projects (738)
Python Pytorch Computer Vision Projects (728)
Python Text Classification Projects (709)
Python Rnn Projects (701)
Python Deep Learning Tensorflow Keras Projects (698)
Python Deep Learning Nlp Projects (697)
Python Deep Reinforcement Learning Projects (686)
Python Pytorch Neural Network Projects (644)
Python Ocr Projects (643)
Python Speech Recognition Projects (636)
Python Semantic Segmentation Projects (634)
Python Python3 Deep Learning Projects (623)
Python Nlp Machine Learning Projects (616)
Python Tensorflow Convolutional Neural Networks Projects (610)
Python Kaggle Projects (588)
Python Deep Learning Natural Language Processing Projects (578)
Python Tensorflow Cnn Projects (562)
Python Regression Projects (547)
Python Jupyter Notebook Neural Network Projects (540)
Python Recurrent Neural Networks Projects (533)
Python Pytorch Nlp Projects (514)
Python Tensorflow Pytorch Projects (514)
Python Transfer Learning Projects (491)
Python Machine Learning Sklearn Projects (491)
Python Jupyter Notebook Pytorch Projects (481)
Python Research Projects (463)
Python Machine Learning Deep Neural Networks Projects (461)
Python Word2vec Projects (460)
Python Svm Projects (450)
Python Paper Projects (435)
Python Attention Mechanism Projects (430)
Python Pytorch Reinforcement Learning Projects (427)
Python Translation Projects (420)
Python Seq2seq Projects (402)
Python Code Projects (400)
Python Deep Learning Lstm Projects (397)
Python Machine Learning Deep Projects (14)
Python Machine Learning Deep Tensorflow Projects (5)
Python Machine Learning Deep Pytorch Projects (3)
Python Machine Learning Reinforcement Projects (2)
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194
Privacy policy
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.

All non readme contents or Github based topics or project metadata copyright Awesome Open Source 2018-2022