Awesome Open Source
Awesome Open Source
Combined Topics
attention x
python x

The Top 1,815 Python Attention Open Source Projects

Categories > Machine Learning > Attention
Vit Pytorch ⭐ 12,318
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
dependent packages 3total releases 143most recent commit 2 months agopypi vit-pytorch} Downloads
Mingpt ⭐ 12,121
A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
most recent commit 17 days ago
Numpy Ml ⭐ 11,631
Machine learning, in numpy
total releases 3most recent commit 24 days ago
External Attention Pytorch ⭐ 7,766
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
most recent commit 19 days ago
Text_classification ⭐ 7,411
all kinds of text classification models and more with deep learning
most recent commit 4 months ago
Attention Is All You Need Pytorch ⭐ 7,000
A PyTorch implementation of the Transformer model in "Attention is All You Need".
most recent commit 2 months ago
Nmt ⭐ 6,085
TensorFlow Neural Machine Translation Tutorial
most recent commit 4 months ago
Espnet ⭐ 6,018
End-to-End Speech Processing Toolkit
dependent packages 3total releases 27most recent commit a day agopypi espnet} Downloads
Dalle Pytorch ⭐ 4,599
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
total releases 172most recent commit 7 months ago
Bertviz ⭐ 4,476
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
dependent packages 1total releases 5most recent commit 3 months agopypi bertviz} Downloads
Gpt Neox ⭐ 3,425
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
most recent commit a day ago
Keras Attention Mechanism ⭐ 2,580
Attention mechanism Implementation for Keras.
most recent commit 9 months ago
X Transformers ⭐ 2,356
A simple but complete full-attention transformer with a set of promising experimental features from various papers
dependent packages 6total releases 175most recent commit 13 days agopypi x-transformers} Downloads
Informer2020 ⭐ 2,274
The GitHub repository for the paper "Informer" accepted by AAAI 2021.
most recent commit 10 months ago
Spektral ⭐ 2,221
Graph Neural Networks with Keras and Tensorflow 2.
dependent packages 3total releases 33most recent commit 3 days agopypi spektral} Downloads
A Pytorch Tutorial To Image Captioning ⭐ 2,084
Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning
most recent commit 6 months ago
Gat ⭐ 2,078
Graph Attention Networks (https://arxiv.org/abs/1710.10903)
most recent commit 2 years ago
Self Attention Gan ⭐ 1,822
Pytorch implementation of Self-Attention Generative Adversarial Networks (SAGAN)
most recent commit 2 years ago
Pytorch Gat ⭐ 1,815
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
most recent commit 3 months ago
Reformer Pytorch ⭐ 1,755
Reformer, the efficient Transformer, in Pytorch
total releases 139most recent commit 7 months ago
Scenic ⭐ 1,702
Scenic: A Jax Library for Computer Vision Research and Beyond
most recent commit a day ago
Pygat ⭐ 1,684
Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
most recent commit a year ago
Attention Module ⭐ 1,628
Official PyTorch code for "BAM: Bottleneck Attention Module (BMVC2018)" and "CBAM: Convolutional Block Attention Module (ECCV2018)"
most recent commit 5 months ago
Chinese Text Classification Pytorch ⭐ 1,609
中文文本分类，TextCNN，TextRNN，FastText，TextRCNN，BiLSTM_At
most recent commit 2 years ago
Yolov4 Pytorch ⭐ 1,572
This is a pytorch repository of YOLOv4, attentive YOLOv4 and mobilenet YOLOv4 with PASCAL VOC and COCO
most recent commit 10 months ago
Danet ⭐ 1,556
Dual Attention Network for Scene Segmentation (CVPR2019)
most recent commit 2 years ago
Deepvoice3_pytorch ⭐ 1,449
PyTorch implementation of convolutional neural networks-based text-to-speech synthesis models
most recent commit 2 years ago
Absa Pytorch ⭐ 1,446
Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析，使用PyTorch实现。
most recent commit a year ago
Yoloair ⭐ 1,415
🔥🔥🔥YOLOv5, YOLOv6, YOLOv7, YOLOv8, PPYOLOE, YOLOX, YOLOR, YOLOv4, YOLOv3, Transformer, Attention, TOOD and Improved-YOLOv5-YOLOv7... Support to improve backbone, neck, head, loss, IoU, NMS and other modules🚀
most recent commit 2 days ago
Bi Att Flow ⭐ 1,367
Bi-directional Attention Flow (BiDAF) network is a multi-stage hierarchical process that represents context at different levels of granularity and uses a bi-directional attention flow mechanism to achieve a query-aware context representation without early summarization.
most recent commit 4 years ago
Nlp Journey ⭐ 1,328
Documents, papers and codes related to Natural Language Processing, including Topic Model, Word Embedding, Named Entity Recognition, Text Classificatin, Text Generation, Text Similarity, Machine Translation)，etc. All codes are implemented intensorflow 2.0.
total releases 3most recent commit 2 years ago
Hopfield Layers ⭐ 1,258
Hopfield Networks is All You Need
most recent commit a year ago
Unet Segmentation Pytorch Nest Of Unets ⭐ 1,236
Implementation of different kinds of Unet Models for Image Segmentation - Unet , RCNN-Unet, Attention Unet, RCNN-Attention Unet, Nested Unet
most recent commit 2 months ago
Deberta ⭐ 1,196
The implementation of DeBERTa
total releases 13most recent commit 2 months ago
Deep_architecture_genealogy ⭐ 1,196
Deep Learning Architecture Genealogy Project
most recent commit 2 years ago
Gansformer ⭐ 1,188
Generative Adversarial Transformers
most recent commit 8 months ago
Rcan ⭐ 1,180
PyTorch code for our ECCV 2018 paper "Image Super-Resolution Using Very Deep Residual Channel Attention Networks"
most recent commit 2 months ago
Lambda Networks ⭐ 1,110
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
total releases 11most recent commit 2 years ago
Attention Gated Networks ⭐ 1,099
Use of Attention Gates in a Convolutional Neural Network / Medical Image Classification and Segmentation
most recent commit 2 years ago
Ccnet ⭐ 1,061
CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).
most recent commit 2 years ago
Textclassifier ⭐ 1,003
Text classifier for Hierarchical Attention Networks for Document Classification
most recent commit a year ago
Sparse_attention ⭐ 1,002
Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
most recent commit 2 years ago
Attention Ocr ⭐ 973
Visual Attention based OCR
most recent commit 4 years ago
Fast Transformers ⭐ 930
Pytorch library for fast transformer implementations
dependent packages 2total releases 8most recent commit 2 years agopypi pytorch-fast-transformers} Downloads
Image_segmentation ⭐ 880
Pytorch implementation of U-Net, R2U-Net, Attention U-Net, and Attention R2U-Net.
most recent commit 3 years ago
Attention Ocr ⭐ 874
A Tensorflow model for text recognition (CNN + seq2seq with visual attention) available as a Python package and compatible with Google Cloud ML Engine.
total releases 21most recent commit a year ago
Ride ⭐ 867
Test data editor for Robot Framework
dependent packages 6total releases 52most recent commit 3 days agopypi robotframework-ride} Downloads
Arctic Captions ⭐ 831
most recent commit 7 years ago
Nlp Paper ⭐ 820
自然语言处理领域下的相关论文（附阅读笔记），复现模型以及数据处理等（代码含TensorFlow和Py
total releases 2most recent commit 2 months ago
Performer Pytorch ⭐ 777
An implementation of Performer, a linear attention-based transformer, in Pytorch
dependent packages 4total releases 77most recent commit a year agopypi performer-pytorch} Downloads
Django Bootstrap ⭐ 735
Django Form Implementation of the Twitter-Bootstrap UI
most recent commit 10 years ago
Self Attention Gan ⭐ 722
most recent commit 3 years ago
Awesome Fast Attention ⭐ 717
list of efficient attention modules
most recent commit a year ago
Tf Rnn Attention ⭐ 703
Tensorflow implementation of attention mechanism for text classification tasks.
most recent commit 3 years ago
Spatial Transformer Network ⭐ 661
A Tensorflow implementation of Spatial Transformer Networks.
total releases 3most recent commit 5 years ago
Ecanet ⭐ 658
Code for ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks
most recent commit 2 years ago
Keras Attention ⭐ 656
Visualizing RNNs using the attention mechanism
most recent commit 4 years ago
Seq2seq Pytorch ⭐ 653
Sequence to Sequence Models with PyTorch
most recent commit 6 years ago
Textclassification Keras ⭐ 649
Text classification models implemented in Keras, including: FastText, TextCNN, TextRNN, TextBiRNN, TextAttBiRNN, HAN, RCNN, RCNNVariant, etc.
most recent commit 2 years ago
Transformer ⭐ 644
PyTorch Implementation of "Attention Is All You Need"
most recent commit 21 days ago
Image_captioning ⭐ 634
Tensorflow implementation of "Show, Attend and Tell: Neural Image Caption Generation with Visual Attention"
most recent commit 5 years ago
Cbam.pytorch ⭐ 630
Non-official implement of Paper：CBAM: Convolutional Block Attention Module
most recent commit 2 years ago
Text Classification ⭐ 622
Implementation of papers for text classification task on DBpedia
most recent commit 4 years ago
Tensorflow Ocr ⭐ 616
🖺 OCR using tensorflow with attention
most recent commit 3 years ago
Rlseq2seq ⭐ 610
Deep Reinforcement Learning For Sequence to Sequence Models
most recent commit 3 years ago
Nlp Tutorials ⭐ 609
Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com
most recent commit a year ago
Bottom Up Attention Vqa ⭐ 606
An efficient PyTorch implementation of the winning entry of the 2017 VQA Challenge.
most recent commit 3 years ago
Joeynmt ⭐ 595
Minimalist NMT for educational purposes
dependent packages 1total releases 11most recent commit 2 days agopypi joeynmt} Downloads
Moran_v2 ⭐ 593
MORAN: A Multi-Object Rectified Attention Network for Scene Text Recognition
most recent commit 2 months ago
Keras Self Attention ⭐ 570
Attention mechanism for processing sequential data that considers the context for each timestamp.
dependent packages 4total releases 43most recent commit a year agopypi keras-self-attention} Downloads
R Net ⭐ 569
Tensorflow Implementation of R-Net
most recent commit 4 years ago
Eeg Dl ⭐ 563
A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.
total releases 10most recent commit 16 days ago
Adaptive Span ⭐ 557
Transformer training code for sequential tasks
most recent commit a year ago
Self Attention Cv ⭐ 550
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
total releases 5most recent commit a year ago
Attention Cnn ⭐ 550
Source code for "On the Relationship between Self-Attention and Convolutional Layers"
most recent commit 3 years ago
Text Classification Pytorch ⭐ 538
Text classification using deep learning models in Pytorch
most recent commit 4 years ago
Punctuator2 ⭐ 532
A bidirectional recurrent neural network model with attention mechanism for restoring missing punctuation in unsegmented text
most recent commit a year ago
Chinesenre ⭐ 523
中文实体关系抽取，pytorch，bilstm+attention
most recent commit a year ago
Exbert ⭐ 516
A Visual Analysis Tool to Explore Learned Representations in Transformers Models
most recent commit 2 months ago
Attentiondeepmil ⭐ 507
Implementation of Attention-based Deep Multiple Instance Learning in PyTorch
most recent commit a year ago
Emanet ⭐ 507
The code for Expectation-Maximization Attention Networks for Semantic Segmentation (ICCV'2019 Oral)
most recent commit 3 years ago
Seq2seq ⭐ 502
Minimal Seq2Seq model with Attention for Neural Machine Translation in PyTorch
most recent commit 3 years ago
Draw ⭐ 501
TensorFlow Implementation of "DRAW: A Recurrent Neural Network For Image Generation"
most recent commit 4 years ago
Attentionocr ⭐ 488
Scene text recognition
most recent commit 3 years ago
Textclassificationbenchmark ⭐ 484
A Benchmark of Text Classification in PyTorch
most recent commit 3 years ago
Medical Transformer ⭐ 484
Official Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation" - MICCAI 2021
most recent commit 10 months ago
Ban Vqa ⭐ 478
Bilinear attention networks for visual question answering
most recent commit a year ago
Attn2d ⭐ 475
Pervasive Attention: 2D Convolutional Networks for Sequence-to-Sequence Prediction
most recent commit 2 years ago
Self Attention Gan Tensorflow ⭐ 468
Simple Tensorflow implementation of "Self-Attention Generative Adversarial Networks" (SAGAN)
most recent commit 4 years ago
Neural_sp ⭐ 466
End-to-end ASR/LM implementation with PyTorch
most recent commit a year ago
Long Range Arena ⭐ 456
Long Range Arena for Benchmarking Efficient Transformers
most recent commit 5 months ago
Rnn Nlu ⭐ 454
A TensorFlow implementation of Recurrent Neural Networks for Sequence Classification and Sequence Labeling
most recent commit 5 years ago
Mac Network ⭐ 445
Implementation for the paper "Compositional Attention Networks for Machine Reasoning" (Hudson and Manning, ICLR 2018)
most recent commit 2 years ago
Knowledge_graph_attention_network ⭐ 434
KGAT: Knowledge Graph Attention Network for Recommendation, KDD2019
most recent commit 2 years ago
Bigbird ⭐ 433
Transformers for Longer Sequences
most recent commit 5 months ago
Source Code Notebook ⭐ 428
关于一些经典论文源码的逐行中文笔记
most recent commit 4 months ago
Residualattentionnetwork Pytorch ⭐ 423
a pytorch code about Residual Attention Network. This code is based on two projects from
most recent commit 4 years ago
Attention_keras ⭐ 421
Keras Layer implementation of Attention for Sequential models
most recent commit 2 months ago
Multimodal Transformer ⭐ 418
[ACL'19] [PyTorch] Multimodal Transformer
most recent commit a year ago
Keras Text ⭐ 417
Text Classification Library in Keras
most recent commit 5 years ago
1-100 of 1,815 projects
Related Awesome Lists
Python Pytorch Projects (15,280)
Python Dataset Projects (14,792)
Python Docker Projects (14,113)
Python Machine Learning Projects (14,099)
Python Tensorflow Projects (14,083)
Python Deep Learning Projects (13,092)
Python Jupyter Notebook Projects (12,976)
Python Learning Projects (11,855)
Python Network Projects (11,547)
Python Text Projects (7,530)
Python Neural Projects (7,444)
Python Neural Network Projects (7,417)
Python Natural Language Processing Projects (7,323)
Python Artificial Intelligence Projects (6,875)
Python Paper Projects (6,544)
Python Graph Projects (6,224)
Python Classification Projects (5,958)
Python Convolutional Neural Networks Projects (5,079)
Python Token Projects (4,798)
Python Recognition Projects (4,789)
Python Language Projects (4,480)
Python Segmentation Projects (4,252)
Python Map Projects (3,884)
Python Computer Vision Projects (3,769)
Python Camera Projects (3,760)
Python Robot Projects (3,654)
Python Tutorials Projects (3,517)
Python Visualization Projects (3,298)
Python Lambda Functions Projects (3,134)
Python Lstm Projects (3,120)
Python Label Projects (2,993)
Python Keras Projects (2,956)
Python Gpu Projects (2,801)
Python Reinforcement Learning Projects (2,742)
Python Version Projects (2,610)
Python Sentiment Projects (2,529)
Python Blog Projects (2,433)
Python Processing Projects (2,429)
Python Translation Projects (2,324)
Python Adversarial Projects (2,315)
Python Resnet Projects (2,221)
Python Embeddings Projects (2,141)
Python Numpy Projects (2,087)
Python Recurrent Neural Networks Projects (1,975)
Python Chinese Projects (1,898)
Python Date Projects (1,869)
Python Accuracy Projects (1,698)
Python Validation Projects (1,649)
Python Object Detection Projects (1,460)
Categories
Advertising 📦 8
All Projects
Application Programming Interfaces 📦 107
Applications 📦 174
Artificial Intelligence 📦 69
Blockchain 📦 66
Build Tools 📦 105
Cloud Computing 📦 68
Code Quality 📦 24
Collaboration 📦 27
Command Line Interface 📦 38
Community 📦 79
Companies 📦 60
Compilers 📦 59
Computer Science 📦 73
Configuration Management 📦 37
Content Management 📦 153
Control Flow 📦 187
Data Formats 📦 72
Data Processing 📦 249
Data Storage 📦 116
Economics 📦 56
Frameworks 📦 178
Games 📦 110
Graphics 📦 92
Hardware 📦 137
Integrated Development Environments 📦 43
Learning Resources 📦 139
Legal 📦 24
Libraries 📦 117
Lists Of Projects 📦 19
Machine Learning 📦 313
Mapping 📦 57
Marketing 📦 15
Mathematics 📦 54
Media 📦 214
Messaging 📦 96
Networking 📦 292
Operating Systems 📦 71
Operations 📦 114
Package Managers 📦 50
Programming Languages 📦 173
Runtime Environments 📦 90
Science 📦 42
Security 📦 343
Social Media 📦 23
Software Architecture 📦 65
Software Development 📦 60
Software Performance 📦 53
Software Quality 📦 115
Text Editors 📦 40
Text Processing 📦 118
User Interface 📦 291
User Interface Components 📦 440
Version Control 📦 26
Virtualization 📦 63
Web Browsers 📦 35
Web Servers 📦 23
Web User Interface 📦 167
Top Programming Languages
Javascript  (1,160,380)
Python  (892,779)
Java  (412,846)
Typescript  (308,006)
Php  (298,499)
C Plus Plus  (258,620)
Ruby  (225,284)
C  (194,227)
Shell  (182,843)
C Sharp  (178,874)
Golang  (172,446)
Swift  (69,157)
Rust  (69,056)
R  (62,320)
Dart  (62,218)
Objective C  (57,071)
Kotlin  (53,587)
Lua  (38,545)
Matlab  (32,921)
Perl  (30,846)
Language  (29,928)
Scala  (29,400)
Haskell  (20,951)
Powershell  (20,452)
Clojure  (19,577)
Bash  (19,226)
Elixir  (17,484)
Coffeescript  (17,141)
Assembly  (15,714)
Julia  (14,059)
Processing  (13,331)
Emacs Lisp  (10,866)
Basic  (10,671)
Flow  (10,511)
Solidity  (10,100)
Erlang  (9,121)
Groovy  (8,622)
Scheme  (8,439)
Ocaml  (6,957)
Pascal  (6,816)
Hack  (6,609)
Lisp  (6,359)
Fortran  (5,812)
Elm  (5,564)
Common Lisp  (5,473)
Shell Script  (4,854)
Dlang  (4,802)
Python Library  (4,520)
Crystal  (4,449)
Fsharp  (4,270)
Privacy | About | Terms | Follow Us On Twitter | Top Projects

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2023 Awesome Open Source.  All rights reserved.