Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Attention Mechanism Open Source Projects

Open source projects categorized as Attention Mechanism
Categories > Machine Learning > Attention Mechanism
Local Attention ⭐ 270
An implementation of local windowed attention for language modeling
dependent packages 17total releases 34most recent commit 6 months agopypi local-attention} Downloads
Memory Efficient Attention Pytorch ⭐ 267
Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
dependent packages 3total releases 31most recent commit 9 months agopypi memory-efficient-attention-pytorch} Downloads
Eqtransformer ⭐ 260
EQTransformer, a python package for earthquake signal detection and phase picking using AI.
dependent packages 3total releases 46most recent commit 5 months agopypi EQTransformer} Downloads
Seq2seq Summarizer ⭐ 259
Pointer-generator reinforced seq2seq summarization in PyTorch
most recent commit 5 years ago
Q Transformer ⭐ 253
Implementation of Q-Transformer, Scalable Offline Reinforcement Learning via Autoregressive Q-Functions, out of Google Deepmind
most recent commit 3 months ago
Metal Flash Attention ⭐ 252
Faster alternative to Metal Performance Shaders
most recent commit 3 months ago
Magvit2 Pytorch ⭐ 244
Implementation of MagViT2 Tokenizer in Pytorch
most recent commit 3 months ago
Hierarchical Multi Label Text Classification ⭐ 239
The code of CIKM'19 paper《Hierarchical Multi-label Text Classification: An Attention-based Recurrent Network Approach》
most recent commit a year ago
Lightnetplusplus ⭐ 237
LightNet++: Boosted Light-weighted Networks for Real-time Semantic Segmentation
most recent commit 4 years ago
Da Rnn ⭐ 234
📃 **Unofficial** PyTorch Implementation of DA-RNN (arXiv:1704.02971)
most recent commit 3 years ago
Scribe ⭐ 234
Realistic Handwriting with Tensorflow
most recent commit 10 months ago
Attentionalpoolingaction ⭐ 228
Code/Model release for NIPS 2017 paper "Attentional Pooling for Action Recognition"
most recent commit 6 years ago
Pan ⭐ 227
(ECCV2020 Workshops) Efficient Image Super-Resolution Using Pixel Attention.
most recent commit 2 years ago
Yolo Multi Backbones Attention ⭐ 223
Model Compression—YOLOv3 with multi lightweight backbones(ShuffleNetV2 HuaWei GhostNet), attention, prune and quantization
most recent commit 3 years ago
Attentive Gan Derainnet ⭐ 222
Unofficial tensorflow implemention of "Attentive Generative Adversarial Network for Raindrop Removal from A Single Image (CVPR 2018) " model https://maybeshewill-cv.github.io/attentive-gan-de
most recent commit 2 years ago
Pytorch Attention ⭐ 222
🦖Pytorch implementation of popular Attention Mechanisms, Vision Transformers, MLP-Like models and CNNs.🔥🔥🔥
total releases 1most recent commit 3 months ago
Rt 2 ⭐ 215
Democratization of RT-2 "RT-2: New model translates vision and language into action"
total releases 8most recent commit 3 months ago
Colt5 Attention ⭐ 207
Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
dependent packages 5total releases 69most recent commit 5 months agopypi CoLT5-attention} Downloads
Equiformer Pytorch ⭐ 207
Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and adopted for use by EquiFold for protein folding
total releases 52most recent commit 3 months ago
Multimodal Sentiment Analysis ⭐ 205
Attention-based multimodal fusion for sentiment analysis
most recent commit 3 years ago
Se3 Transformer Pytorch ⭐ 205
Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.
dependent packages 1total releases 78most recent commit a year agopypi se3-transformer-pytorch} Downloads
Routing Transformer ⭐ 202
Fully featured implementation of Routing Transformer
total releases 79most recent commit 2 years ago
Saits ⭐ 201
The official PyTorch implementation of the paper "SAITS: Self-Attention-based Imputation for Time Series". A fast and state-of-the-art (SOTA) model with efficiency for time series imputation (imputing multivariate incomplete time series containing missing data/values). https://arxiv.org/abs/2202.08516
most recent commit 4 months ago
The 10 Latest Releases In Attention Mechanism Open Source Projects
Feedback Transformer Pytorch ⭐ 71
Implementation of Feedback Transformer in Pytorch
total releases 11latest release March 02, 2021most recent commit 3 years ago
Lie Transformer Pytorch ⭐ 49
Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch
dependent packages 1total releases 14latest release February 19, 2021most recent commit 3 years agopypi lie-transformer-pytorch} Downloads
Eqtransformer ⭐ 260
EQTransformer, a python package for earthquake signal detection and phase picking using AI.
dependent packages 3total releases 46latest release January 30, 2021most recent commit 5 months agopypi EQTransformer} Downloads
Arelu ⭐ 58
AReLU: Attention-based-Rectified-Linear-Unit
dependent packages 1total releases 1latest release January 23, 2021most recent commit 3 years agopypi activations} Downloads
Linformer ⭐ 194
Implementation of Linformer for Pytorch
dependent packages 2total releases 8latest release December 13, 2020most recent commit 4 months agopypi linformer} Downloads
Global Self Attention Network ⭐ 49
A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks
dependent packages 1total releases 7latest release November 21, 2020most recent commit 3 years agopypi gsa-pytorch} Downloads
Memformer ⭐ 30
Implementation of Memformer, a Memory-augmented Transformer, in Pytorch
total releases 15latest release November 13, 2020most recent commit 3 years ago
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.