Awesome Open Source

Programming Languages

Search results for python attention mechanism

attention-mechanism x

444 search results found

Mega Pytorch ⭐ 195

Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena

Linformer ⭐ 194

Implementation of Linformer for Pytorch

En Transformer ⭐ 192

Implementation of E(n)-Transformer, which incorporates attention mechanisms into Welling's E(n)-Equivariant Graph Neural Network

Sparse Structured Attention ⭐ 190

Sparse and structured neural attention mechanisms

Deformable Attention ⭐ 190

Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deformable Attention"

Guided Attention Inference Network ⭐ 187

Contains implementation of Guided Attention Inference Network (GAIN) presented in Tell Me Where to Look(CVPR 2018). This repository aims to apply GAIN on fcn8 architecture used for segmentation.

Pycontinual ⭐ 185

PyContinual (An Easy and Extendible Framework for Continual Learning)

Train and visualize Hierarchical Attention Networks

Sinkhorn Transformer ⭐ 178

Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention

Multihead Siamese Nets ⭐ 173

Implementation of Siamese Neural Networks built upon multihead attention mechanism for text semantic similarity task.

Simple Hierarchical Transformer ⭐ 172

Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT

Datastories Semeval2017 Task4 ⭐ 171

Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".

The source code of AMFMN and the dataset RSITMD

Recurrent Interface Network Pytorch ⭐ 170

Implementation of Recurrent Interface Network (RIN), for highly efficient generation of images and video without cascading networks, in Pytorch

TRACER: Extreme Attention Guided Salient Object Tracing Network (AAAI 2022) implementation in PyTorch

Document Classifier Lstm ⭐ 167

A bidirectional LSTM with attention for multiclass/multilabel text classification.

Multi Scale Attention ⭐ 166

Code for our paper "Multi-scale Guided Attention for Medical Image Segmentation"

Block Recurrent Transformer Pytorch ⭐ 164

Implementation of Block Recurrent Transformer - Pytorch

Slot_filling_intent_joint_model ⭐ 161

attention based joint model for intent detection and slot filling

At4chinesener ⭐ 160

Adversarial Transfer Learning for Chinese Named Entity Recognition with Self-Attention Mechanism

Chinese Text Classification Pytorch ⭐ 156

中文文本分类任务，基于PyTorch实现（TextCNN，TextRNN，FastText，Text DPCNN, Transformer，Bert，ERNIE），开箱即用！

Style Transformer ⭐ 154

Official implementation for "Style Transformer for Image Inversion and Editing" (CVPR 2022)

A Pytorch Tutorial To Text Classification ⭐ 154

Hierarchical Attention Networks | a PyTorch Tutorial to Text Classification

Sa Tensorflow ⭐ 153

Soft attention mechanism for video caption generation

Galerkin Transformer ⭐ 152

[NeurIPS 2021] Galerkin Transformer: a linear attention without softmax

Csa Inpainting ⭐ 149

Coherent Semantic Attention for image inpainting(ICCV 2019)

Code for paper "Attention on Attention for Image Captioning". ICCV 2019

Speech2text ⭐ 148

A Deep-Learning-Based Persian Speech Recognition System

Picanet Implementation ⭐ 147

Pytorch Implementation of PiCANet: Learning Pixel-wise Contextual Attention for Saliency Detection

Bs Roformer ⭐ 144

Implementation of Band Split Roformer, SOTA Attention network for music source separation out of ByteDance AI Labs

Hierarchical Attentive Recurrent Tracking

Implementation of "PaLM-E: An Embodied Multimodal Language Model"

Visualization ⭐ 142

a collection of visualization function

Text_recognition_toolbox ⭐ 141

text_recognition_toolbox: The reimplementation of a series of classical scene text recognition papers with Pytorch in a uniform way.

Axial Attention ⭐ 140

Implementation of Axial attention - attending to multi-dimensional data efficiently

Motion-Attentive Transition for Zero-Shot Video Object Segmentation (AAAI2020)

Prediction Flow ⭐ 136

Deep-Learning based CTR models implemented by PyTorch

Pytorch implementation of the paper "The Devil Is in the Details: Window-based Attention for Image Compression".

Lstm_attention ⭐ 131

attention-based LSTM/Dense implemented by Keras

Dl4mt Multi ⭐ 129

Deep Summarization ⭐ 126

Uses Recurrent Neural Network (LSTM/GRU/basic_RNN units) for summarization of amazon reviews

Triton Transformer ⭐ 125

Implementation of a Transformer, but completely in Triton

Attribute Aware Attention ⭐ 124

[ACM MM 2018] Attribute-Aware Attention Model for Fine-grained Representation Learning

Flash Attention Jax ⭐ 123

Implementation of Flash Attention in Jax

Fusilli ⭐ 120

A Python package housing a collection of deep-learning multi-modal data fusion method pipelines! From data loading, to training, to evaluation - fusilli's got you covered 🌸

Transformer In Generating Dialogue ⭐ 117

An Implementation of 'Attention is all you need' with Chinese Corpus

[CVPR 2020] Official Implementation: "Your Local GAN: Designing Two Dimensional Local Attention Mechanisms for Generative Models".

Segformer Pytorch ⭐ 111

Implementation of Segformer, Attention + MLP neural network for segmentation, in Pytorch

Nystrom Attention ⭐ 111

Implementation of Nyström Self-attention, from the paper Nyströmformer

Macarico ⭐ 104

learning to search in pytorch

Deep Learning Image Classification Models Based Cnn Or Attention ⭐ 104

This project organizes classic images classification neural networks based on convolution or attention, and writes training and inference python scripts

Absa_keras ⭐ 103

Keras Implementation of Aspect based Sentiment Analysis

Hypertransformer ⭐ 102

[CVPR'22] HyperTransformer: A Textural and Spectral Feature Fusion Transformer for Pansharpening

Densely Residual Laplacian Super-resolution, IEEE Pattern Analysis and Machine Intelligence (TPAMI), 2020

H Transformer 1d ⭐ 100

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

Attention-guided CNN for image denoising(Neural Networks,2020)

Transformers Rl ⭐ 96

An easy PyTorch implementation of "Stabilizing Transformers for Reinforcement Learning"

Tensorflow Implement of GeoMAN, IJCAI-18

Bidirectional Cross Attention ⭐ 95

A simple cross attention that updates both the source and target in one step

Calm Pytorch ⭐ 93

Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind

Implementation of Knowledge Aided Consistency for Weakly Supervised Phrase Grounding in Tensorflow

Self Attentive Emb Tf ⭐ 91

Simple Tensorflow Implementation of "A Structured Self-attentive Sentence Embedding" (ICLR 2017)

Transganformer ⭐ 91

Implementation of TransGanFormer, an all-attention GAN that combines the finding from the recent GanFormer and TransGan paper

Long Short Transformer ⭐ 91

Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch

Aiatrack ⭐ 90

[ECCV'22] The official PyTorch implementation of our ECCV 2022 paper: "AiATrack: Attention in Attention for Transformer Visual Tracking".

Trajectory Transformer ⭐ 87

Code for "Transformer Networks for Trajectory Forecasting"

A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction

Compressive Transformer Pytorch ⭐ 86

Pytorch implementation of Compressive Transformers, from Deepmind

Zorro Pytorch ⭐ 83

Implementation of Zorro, Masked Multimodal Transformer, in Pytorch

Vista Net ⭐ 82

Code for the paper "VistaNet: Visual Aspect Attention Network for Multimodal Sentiment Analysis", AAAI'19

Various Attention Mechanisms ⭐ 81

This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention etc in Pytorch, Tensorflow, Keras

Grounder ⭐ 81

Implementation of Grounding of Textual Phrases in Images by Reconstruction in Tensorflow

Deepaffinity ⭐ 80

Protein-compound affinity prediction through unified RNN-CNN

Eeg Transformer ⭐ 79

i. A practical application of Transformer (ViT) on 2-D physiological signal (EEG) classification tasks. Also could be tried with EMG, EOG, ECG, etc. ii. Including the attention of spatial dimension (channel attention) and *temporal dimension*. iii. Common spatial pattern (CSP), an efficient feature enhancement method, realized with Python.

Attend_infer_repeat ⭐ 77

A Tensorfflow implementation of Attend, Infer, Repeat

Mixture Of Attention ⭐ 74

Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts

Mirasol Pytorch ⭐ 74

Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch

Uniformer Pytorch ⭐ 74

Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, debuted in ICLR 2022

Fast Transformer Pytorch ⭐ 73

Implementation of Fast Transformer in Pytorch

Neural Chatbot ⭐ 73

A Neural Network based Chatbot

The official repo for [Arxiv'23] "Vision Transformer with Quadrangle Attention"

Writing Editing Network ⭐ 72

Code for Paper Abstract Writing through Editing Mechanism

This repo contains the official implementation of ICCV 2023 paper "Keep It SimPool: Who Said Supervised Transformers Suffer from Attention Deficit?"

Feedback Transformer Pytorch ⭐ 71

Implementation of Feedback Transformer in Pytorch

Transformercpi ⭐ 71

TransformerCPI: Improving compound–protein interaction prediction by sequence-based deep learning with self-attention mechanism and label reversal experiments(BIOINFORMATICS 2020) https://doi.org/10.1093/bioinformatics/btaa524

A Tree-Based Transformer Architecture for Code Generation. (AAAI'20)

Image Caption Generator ⭐ 70

A neural network to generate captions for an image using CNN and RNN with BEAM Search.

Implementation of Query-guided Regression Network with Context Policy for Phrase Grounding in Tensorflow

Trihorn Net ⭐ 70

Official PyTorch implementation of TriHorn-Net

Image Captioning ⭐ 69

Perceiver Ar Pytorch ⭐ 69

Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch

This is our implementation of NARRE:Neural Attentional Regression with Review-level Explanations

Predict materials properties using only the composition information!

Softalignments ⭐ 65

Neural macine translation soft alignment visualisations for web and command line

Pytorch_sentiment_rnn ⭐ 64

Example Recurrent Neural Networks for Sentiment Analysis (Aspect-Based) on SemEval 2014

Optic Disc Unet ⭐ 62

Attention Unet model with post process for retina optic disc segmention

Transxnet ⭐ 61

TransXNet: Learning Both Global and Local Dynamics with a Dual Dynamic Token Mixer for Visual Recognition

Taylor Series Linear Attention ⭐ 61

Explorations into the recently proposed Taylor Series Linear Attention

Related Searches

Python Machine Learning (20,195)

Python Dataset (14,792)

Python Tensorflow (13,736)

Python Deep Learning (13,092)

Python Jupyter Notebook (12,976)

Python Network (11,495)

Python Natural Language Processing (9,064)

Python Artificial Intelligence (8,580)

Python Pytorch (7,877)

Python Neural (7,444)

101-200 of 444 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.