Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for pytorch attention mechanism
attention-mechanism
x
pytorch
x
153 search results found
Vit Pytorch
⭐
16,298
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
Rwkv Lm
⭐
10,705
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
A Pytorch Tutorial To Image Captioning
⭐
2,084
Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning
Reformer Pytorch
⭐
1,917
Reformer, the efficient Transformer, in Pytorch
Pytorch Gat
⭐
1,815
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
Pygat
⭐
1,684
Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
Whisper Timestamped
⭐
1,217
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
Sockeye
⭐
1,190
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
Alphafold2
⭐
1,086
To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
Pointer_summarizer
⭐
859
pytorch implementation of "Get To The Point: Summarization with Pointer-Generator Networks"
Performer Pytorch
⭐
777
An implementation of Performer, a linear attention-based transformer, in Pytorch
Yolo_research
⭐
715
based on yolo-high-level project (detect\pose\classify\segment\):include yolov5\yolov7\yolov8\ core ,improvement research ,SwintransformV2 and Attention Series. training skills, business customization, engineering deployment C
Seq2seq Pytorch
⭐
653
Sequence to Sequence Models with PyTorch
Tab Transformer Pytorch
⭐
609
Implementation of TabTransformer, attention network for tabular data, in Pytorch
Transformer Tts
⭐
599
A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"
Simgnn
⭐
540
A PyTorch implementation of "SimGNN: A Neural Network Approach to Fast Graph Similarity Computation" (WSDM 2019).
Wama_modules
⭐
501
A PyTorch Computer Vision (CV) module library for building n-D networks flexibly ~
Neural_sp
⭐
466
End-to-end ASR/LM implementation with PyTorch
Openstl
⭐
450
OpenSTL: A Comprehensive Benchmark of Spatio-Temporal Predictive Learning
Mirnet
⭐
436
[ECCV 2020] Learning Enriched Features for Real Image Restoration and Enhancement. SOTA results for image denoising, super-resolution, and image enhancement.
Geotransformer
⭐
422
[CVPR2022] Geometric Transformer for Fast and Robust Point Cloud Registration
Structured Self Attention
⭐
412
A Structured Self-attentive Sentence Embedding
Point Transformer Pytorch
⭐
402
Implementation of the Point Transformer layer, in Pytorch
Time Series Autoencoder
⭐
386
📈 PyTorch Dual-Attention LSTM-Autoencoder For Multivariate Time Series 📈
Paperrobot
⭐
384
Code for PaperRobot: Incremental Draft Generation of Scientific Ideas
Pytorch Original Transformer
⭐
376
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
Changeformer
⭐
335
[IGARSS'22]: A Transformer-Based Siamese Network for Change Detection
Linformer Pytorch
⭐
323
My take on a practical implementation of Linformer for Pytorch.
Multimodalmamba
⭐
321
A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.
Stanet
⭐
296
official implementation of the spatial-temporal attention neural network (STANet) for remote sensing image change detection
Linear Attention Transformer
⭐
278
Transformer based on a variant of attention that is linear complexity in respect to sequence length
Seq2seq Summarizer
⭐
259
Pointer-generator reinforced seq2seq summarization in PyTorch
Lightnetplusplus
⭐
238
LightNet++: Boosted Light-weighted Networks for Real-time Semantic Segmentation
Se3 Transformer Pytorch
⭐
205
Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.
Routing Transformer
⭐
202
Fully featured implementation of Routing Transformer
Saits
⭐
201
The official PyTorch implementation of the paper "SAITS: Self-Attention-based Imputation for Time Series". A fast and state-of-the-art (SOTA) model with efficiency for time series imputation (imputing multivariate incomplete time series containing missing data/values). https://arxiv.org/abs/2202.08516
Linformer
⭐
194
Implementation of Linformer for Pytorch
Sinkhorn Transformer
⭐
178
Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention
Tracer
⭐
169
TRACER: Extreme Attention Guided Salient Object Tracing Network (AAAI 2022) implementation in PyTorch
Multi Scale Attention
⭐
166
Code for our paper "Multi-scale Guided Attention for Medical Image Segmentation"
Graph_attention_pool
⭐
161
Attention over nodes in Graph Neural Networks using PyTorch (NeurIPS 2019)
Chinese Text Classification Pytorch
⭐
156
中文文本分类任务,基于PyTorch实现(TextCNN,TextRNN,FastText,Text DPCNN, Transformer,Bert,ERNIE),开箱即用!
A Pytorch Tutorial To Text Classification
⭐
154
Hierarchical Attention Networks | a PyTorch Tutorial to Text Classification
Galerkin Transformer
⭐
152
[NeurIPS 2021] Galerkin Transformer: a linear attention without softmax
Picanet Implementation
⭐
147
Pytorch Implementation of PiCANet: Learning Pixel-wise Contextual Attention for Saliency Detection
Axial Attention
⭐
140
Implementation of Axial attention - attending to multi-dimensional data efficiently
Matnet
⭐
137
Motion-Attentive Transition for Zero-Shot Video Object Segmentation (AAAI2020)
Prediction Flow
⭐
136
Deep-Learning based CTR models implemented by PyTorch
Stf
⭐
132
Pytorch implementation of the paper "The Devil Is in the Details: Window-based Attention for Image Compression".
Fusilli
⭐
120
A Python package housing a collection of deep-learning multi-modal data fusion method pipelines! From data loading, to training, to evaluation - fusilli's got you covered 🌸
Linear Attention Recurrent Neural Network
⭐
107
A recurrent attention module consisting of an LSTM cell which can query its own past cell states by the means of windowed multi-head attention. The formulas are derived from the BN-LSTM and the Transformer Network. The LARNN cell with attention can be easily used inside a loop on the cell state, just like any other RNN. (LARNN)
Deep Learning Image Classification Models Based Cnn Or Attention
⭐
104
This project organizes classic images classification neural networks based on convolution or attention, and writes training and inference python scripts
Pytorch Question Answering
⭐
102
Important paper implementations for Question Answering using PyTorch
Adnet
⭐
99
Attention-guided CNN for image denoising(Neural Networks,2020)
Aiatrack
⭐
90
[ECCV'22] The official PyTorch implementation of our ECCV 2022 paper: "AiATrack: Attention in Attention for Transformer Visual Tracking".
Compressive Transformer Pytorch
⭐
86
Pytorch implementation of Compressive Transformers, from Deepmind
Ceit Pytorch
⭐
84
Implementation of Convolutional enhanced image Transformer
100 Days Of Nlp
⭐
83
Various Attention Mechanisms
⭐
81
This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention etc in Pytorch, Tensorflow, Keras
Writing Editing Network
⭐
72
Code for Paper Abstract Writing through Editing Mechanism
Image Captioning
⭐
69
Group Level Emotion Recognition
⭐
67
Model submitted for the ICMI 2018 EmotiW Group-Level Emotion Recognition Challenge
Crabnet
⭐
65
Predict materials properties using only the composition information!
Pytorch_sentiment_rnn
⭐
64
Example Recurrent Neural Networks for Sentiment Analysis (Aspect-Based) on SemEval 2014
Grm
⭐
59
[CVPR'23] The official PyTorch implementation of our CVPR 2023 paper: "Generalized Relation Modeling for Transformer Tracking".
Arelu
⭐
58
AReLU: Attention-based-Rectified-Linear-Unit
Pytorch Attention Guided Cyclegan
⭐
57
Pytorch implementation of Unsupervised Attention-guided Image-to-Image Translation.
Xiaox
⭐
56
flask+seq2seq【TensorFlow1.0, Pytorch】 🎨 🎨 在线聊天机器人 https://mp.weixin.qq.com/s/VpiAmVSTin3ALA8MnzhCJA 或 https://ask.hellobi.com/blog/python_shequ/14486
Global And Local Attention Based Free Form Image Inpainting
⭐
52
Official implementation of "Global and local attention-based free-form image inpainting"
Setvae
⭐
50
[CVPR'21] SetVAE: Learning Hierarchical Composition for Generative Modeling of Set-Structured Data, in PyTorch
Tacotron
⭐
50
A PyTorch implementation of Location-Relative Attention Mechanisms For Robust Long-Form Speech Synthesis
Simple Diffusion
⭐
50
A minimal implementation of a denoising diffusion model in PyTorch.
Global Self Attention Network
⭐
49
A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks
Lie Transformer Pytorch
⭐
49
Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch
The Clean Transformer
⭐
46
pytorch-lightning과 wandb로 깔끔하게 구현해보는 트랜스포머
Isab Pytorch
⭐
44
An implementation of (Induced) Set Attention Block, from the Set Transformers paper
Protein Localization
⭐
43
Using Transformer protein embeddings with a linear attention mechanism to make SOTA de-novo predictions for the subcellular location of proteins 🔬
Describing_a_knowledge_base
⭐
42
Code for Describing a Knowledge Base
Flash Attention Softmax N
⭐
41
CUDA and Triton implementations of Flash Attention with SoftmaxN.
Attention_is_all_you_need
⭐
41
Mocha Pytorch
⭐
40
PyTorch Implementation of "Monotonic Chunkwise Attention" (ICLR 2018)
Attend And Rectify
⭐
39
Pytorch code for the IEEE TM/ECCV paper "Attend and rectify"
Speakerrecognitionfromscratch
⭐
38
Final project for the Speaker Recognition course on Udemy, 机器之心, 深蓝学院 and 语音之家
Efficient Attention
⭐
37
[EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
Multilingual_nmt
⭐
36
Experiments on Multilingual NMT
Ssm Dta
⭐
34
SSM-DTA: Breaking the Barriers of Data Scarcity in Drug-Target Affinity Prediction (Briefings in Bioinformatics 2023)
Attentional Pointnet
⭐
34
Attentional-PointNet is Deep-Neural-Network architecture for 3D object detection in point clouds
Fragmentvc
⭐
34
Any-to-any voice conversion by end-to-end extracting and fusing fine-grained voice fragments with attention
Mambatransformer
⭐
31
Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
Minimal Nmt
⭐
31
A minimal nmt example to serve as an seq2seq+attention reference.
Memformer
⭐
30
Implementation of Memformer, a Memory-augmented Transformer, in Pytorch
Cosformer Pytorch
⭐
28
Unofficial PyTorch implementation of the paper "cosFormer: Rethinking Softmax In Attention".
Languagemodel Using Attention
⭐
25
Pytorch implementation of a basic language model using Attention in LSTM network
Fed Att
⭐
25
Attentive Federated Learning for Private NLM
Image Caption
⭐
24
Using LSTM or Transformer to solve Image Captioning in Pytorch
Pytorch_neural_machine_translation_attention
⭐
24
Neural Machine Translation with Attention (PyTorch)
Linear Attention Mechanism
⭐
24
⭐ Welcome to my HomePage ⭐
Layer_augmentation
⭐
23
Implementation of the NLI model in our ACL 2019 paper: Augmenting Neural Networks with First-order Logic.
Sentimentanalysis
⭐
22
Sentiment Analysis: Deep Bi-LSTM+attention model
Protein Localization Transformer
⭐
22
Code for CELL-E: Biological Zero-Shot Text-to-Image Synthesis for Protein Localization Prediction
Related Searches
Python Pytorch (15,943)
Deep Learning Pytorch (7,533)
Jupyter Notebook Pytorch (4,892)
Machine Learning Pytorch (2,934)
Dataset Pytorch (1,848)
Pytorch Convolutional Neural Networks (1,777)
Pytorch Neural Network (1,631)
Pytorch Natural Language Processing (1,408)
Pytorch Computer Vision (1,230)
Pytorch Neural (1,217)
1-100 of 153 search results
Next >
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.