Awesome Open Source

Programming Languages

Search results for pytorch self attention

self-attention x

51 search results found

Informer2020 ⭐ 4,553

The GitHub repository for the paper "Informer" accepted by AAAI 2021.

Pytorch Gat ⭐ 1,815

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

Pygat ⭐ 1,684

Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)

Ccnet ⭐ 1,061

CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).

Speech Transformer ⭐ 714

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

How Do Vits Work ⭐ 571

(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"

Text Classification Pytorch ⭐ 538

Text classification using deep learning models in Pytorch

Structured Self Attention ⭐ 412

A Structured Self-attentive Sentence Embedding

Graph Transformer ⭐ 408

Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)

Deep_learning_nlp ⭐ 359

Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP

Relational Rnn Pytorch ⭐ 228

An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.

Dsmil Wsi ⭐ 224

DSMIL: Dual-stream multiple instance learning networks for tumor detection in Whole Slide Image

Tokengt ⭐ 209

[NeurIPS'22] Tokenized Graph Transformer (TokenGT), in PyTorch

The official PyTorch implementation of the paper "SAITS: Self-Attention-based Imputation for Time Series". A fast and state-of-the-art (SOTA) model with efficiency for time series imputation (imputing multivariate incomplete time series containing missing data/values). https://arxiv.org/abs/2202.08516

Stand Alone Self Attention ⭐ 171

Implementing Stand-Alone Self-Attention in Vision Models using Pytorch

Attnsleep ⭐ 113

[TNSRE 2021] "An Attention-based Deep Learning Approach for Sleep Stage Classification with Single-Channel EEG"

Perceiver Io ⭐ 110

Unofficial implementation of Perceiver IO

Pytorch Question Answering ⭐ 102

Important paper implementations for Question Answering using PyTorch

Pytorch Psetae ⭐ 98

PyTorch implementation of the model presented in "Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention"

Robustness Vit ⭐ 97

Contains code for the paper "Vision Transformers are Robust Learners" (AAAI 2022).

Parallel Tacotron2 ⭐ 80

PyTorch Implementation of Google's Parallel Tacotron 2: A Non-Autoregressive Neural TTS Model with Differentiable Duration Modeling

Query Selector ⭐ 73

LONG-TERM SERIES FORECASTING WITH QUERYSELECTOR – EFFICIENT MODEL OF SPARSEATTENTION

Transformer-based Memory Networks for Knowledge Graph Embeddings (ACL 2020) (Pytorch and Tensorflow)

Predict materials properties using only the composition information!

Egt_pytorch ⭐ 58

Edge-Augmented Graph Transformer

The official Pytorch implementation of "Frame-wise streaming end-to-end speaker diarization with non-autoregressive self-attention-based attractors". [ICASSP 2024]

Lambdanetworks ⭐ 50

Global Self Attention Network ⭐ 49

A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks

Seq2seq Pytorch ⭐ 42

Sequence to Sequence Models in PyTorch

Describing_a_knowledge_base ⭐ 42

Code for Describing a Knowledge Base

Generative_mlzsl ⭐ 40

[TPAMI 2023] Generative Multi-Label Zero-Shot Learning

Transformer Physx ⭐ 40

Transformers for modeling physical systems

[NeurIPS'21] Higher-order Transformers for sets, graphs, and hypergraphs, in PyTorch

Iperceive ⭐ 36

Applying Common-Sense Reasoning to Multi-Modal Dense Video Captioning and Video Question Answering | Python3 | PyTorch | CNNs | Causality | Reasoning | LSTMs | Transformers | Multi-Head Self Attention | Published in IEEE Winter Conference on Applications of Computer Vision (WACV) 2021

Ubisoft Laforge Daft Exprt ⭐ 34

PyTorch Implementation of Daft-Exprt: Robust Prosody Transfer Across Speakers for Expressive Speech Synthesis

Multiturndialogzoo ⭐ 32

Multi-turn dialogue baselines written in PyTorch

[ISPRS 2023]Official PyTorch Implementation of "GATraj: A Graph- and Attention-based Multi-Agent Trajectory Prediction Model"

Vaenar Tts ⭐ 25

PyTorch Implementation of VAENAR-TTS: Variational Auto-Encoder based Non-AutoRegressive Text-to-Speech Synthesis.

Walk Transformer ⭐ 24

From Random Walks to Transformer for Learning Node Embeddings (ECML-PKDD 2020) (In Pytorch and Tensorflow)

Structured Self Attentive Sentence Embedding ⭐ 23

Re-Implementation of "A Structured Self-Attentive Sentence Embedding" by Lin et al., 2017

Lightweight Temporal Attention Pytorch ⭐ 23

A PyTorch implementation of the Light Temporal Attention Encoder (L-TAE) for satellite image time series. classification

Object And Semantic Part Detection Pytorch ⭐ 18

Joint detection of Object and its Semantic parts using Attention-based Feature Fusion on PASCAL Parts 2010 dataset

PSA-GAN implementation in pytorch

Text Classification Pytorch ⭐ 14

Text Classification in PyTorch

Cvdd Pytorch ⭐ 14

A PyTorch implementation of Context Vector Data Description (CVDD), a method for Anomaly Detection on text.

Pytorch Attentive Lm ⭐ 9

Pytorch Implementation of an A-RNN-LM

Textclassification ⭐ 9

Repository of state of the art text/documentation classification algorithms in Pytorch.

Self Attention ⭐ 9

Transformer的完整实现。详细构建Encoder、Decoder、Self-attentio

SEM can automatically decide to select and integrate attention operators to compute attention maps.

Self Supervised Monocular Trained Depth Estimation Using Self Attention And Discrete Disparity Volum ⭐ 7

Reproduction of the CVPR 2020 paper - Self-supervised monocular trained depth estimation using self-attention and discrete disparity volume

Drophead Pytorch ⭐ 7

An implementation of drophead regularization for pytorch transformers

Related Searches

Python Pytorch (17,873)

Deep Learning Pytorch (5,369)

Jupyter Notebook Pytorch (4,892)

Machine Learning Pytorch (2,934)

Dataset Pytorch (1,847)

Pytorch Convolutional Neural Networks (1,517)

Pytorch Natural Language Processing (1,409)

Pytorch Neural Network (1,405)

Tensorflow Pytorch (1,315)

Network Pytorch (1,299)

1-51 of 51 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.