Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Pytorch Attention Mechanism Open Source Projects

Open source projects categorized as Python Pytorch Attention Mechanism
Categories > Machine Learning > Attention Mechanism
Vit Pytorch ⭐ 16,298
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
dependent packages 6total releases 184most recent commit 4 months agopypi vit-pytorch} Downloads
Rwkv Lm ⭐ 10,705
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
most recent commit 3 months ago
A Pytorch Tutorial To Image Captioning ⭐ 2,084
Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning
most recent commit 2 years ago
Reformer Pytorch ⭐ 1,917
Reformer, the efficient Transformer, in Pytorch
total releases 139most recent commit 10 months ago
Pytorch Gat ⭐ 1,815
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
most recent commit a year ago
Pygat ⭐ 1,684
Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
most recent commit 3 years ago
Whisper Timestamped ⭐ 1,217
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
dependent packages 3total releases 3most recent commit 3 months agopypi whisper-timestamped} Downloads
Sockeye ⭐ 1,190
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
total releases 85most recent commit 6 months ago
Alphafold2 ⭐ 1,086
To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
dependent packages 1total releases 135most recent commit 2 years agopypi alphafold2-pytorch} Downloads
Pointer_summarizer ⭐ 859
pytorch implementation of "Get To The Point: Summarization with Pointer-Generator Networks"
most recent commit a year ago
Performer Pytorch ⭐ 777
An implementation of Performer, a linear attention-based transformer, in Pytorch
dependent packages 5total releases 77most recent commit 2 years agopypi performer-pytorch} Downloads
Seq2seq Pytorch ⭐ 653
Sequence to Sequence Models with PyTorch
most recent commit 7 years ago
Tab Transformer Pytorch ⭐ 609
Implementation of TabTransformer, attention network for tabular data, in Pytorch
total releases 19most recent commit 5 months ago
Transformer Tts ⭐ 599
A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"
most recent commit 6 months ago
Simgnn ⭐ 540
A PyTorch implementation of "SimGNN: A Neural Network Approach to Fast Graph Similarity Computation" (WSDM 2019).
most recent commit a year ago
Wama_modules ⭐ 501
A PyTorch Computer Vision (CV) module library for building n-D networks flexibly ~
most recent commit a year ago
Neural_sp ⭐ 466
End-to-end ASR/LM implementation with PyTorch
most recent commit 3 years ago
Openstl ⭐ 450
OpenSTL: A Comprehensive Benchmark of Spatio-Temporal Predictive Learning
most recent commit 4 months ago
Mirnet ⭐ 436
[ECCV 2020] Learning Enriched Features for Real Image Restoration and Enhancement. SOTA results for image denoising, super-resolution, and image enhancement.
most recent commit 2 years ago
Geotransformer ⭐ 422
[CVPR2022] Geometric Transformer for Fast and Robust Point Cloud Registration
most recent commit 5 months ago
Structured Self Attention ⭐ 412
A Structured Self-attentive Sentence Embedding
most recent commit 5 years ago
Point Transformer Pytorch ⭐ 402
Implementation of the Point Transformer layer, in Pytorch
total releases 8most recent commit 2 years ago
Time Series Autoencoder ⭐ 386
📈 PyTorch Dual-Attention LSTM-Autoencoder For Multivariate Time Series 📈
most recent commit a year ago
The 10 Most Depended On Python Pytorch Attention Mechanism Open Source Projects
Performer Pytorch ⭐ 777
An implementation of Performer, a linear attention-based transformer, in Pytorch
dependent packages 5total releases 77latest release February 02, 2022most recent commit 2 years agopypi performer-pytorch} Downloads
Whisper Timestamped ⭐ 1,217
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
dependent packages 3total releases 3latest release December 08, 2023most recent commit 3 months agopypi whisper-timestamped} Downloads
Linformer ⭐ 194
Implementation of Linformer for Pytorch
dependent packages 2total releases 8latest release December 13, 2020most recent commit 4 months agopypi linformer} Downloads
Linear Attention Transformer ⭐ 278
Transformer based on a variant of attention that is linear complexity in respect to sequence length
dependent packages 2total releases 50latest release September 07, 2021most recent commit 3 years agopypi linear-attention-transformer} Downloads
Axial Attention ⭐ 140
Implementation of Axial attention - attending to multi-dimensional data efficiently
dependent packages 2total releases 24latest release August 26, 2021most recent commit 3 years agopypi axial-attention} Downloads
Lie Transformer Pytorch ⭐ 49
Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch
dependent packages 1total releases 14latest release February 19, 2021most recent commit 3 years agopypi lie-transformer-pytorch} Downloads
Arelu ⭐ 58
AReLU: Attention-based-Rectified-Linear-Unit
dependent packages 1total releases 1latest release January 23, 2021most recent commit 3 years agopypi activations} Downloads
Global Self Attention Network ⭐ 49
A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks
dependent packages 1total releases 7latest release November 21, 2020most recent commit 3 years agopypi gsa-pytorch} Downloads
The 10 Latest Releases In Python Pytorch Attention Mechanism Open Source Projects
Whisper Timestamped ⭐ 1,217
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
dependent packages 3total releases 3latest release December 08, 2023most recent commit 3 months agopypi whisper-timestamped} Downloads
Flash Attention Softmax N ⭐ 41
CUDA and Triton implementations of Flash Attention with SoftmaxN.
total releases 11latest release November 21, 2023most recent commit 5 months ago
Sockeye ⭐ 1,190
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
total releases 85latest release March 03, 2023most recent commit 6 months ago
Isab Pytorch ⭐ 44
An implementation of (Induced) Set Attention Block, from the Set Transformers paper
dependent packages 1total releases 9latest release January 10, 2023most recent commit a year agopypi isab-pytorch} Downloads
Galerkin Transformer ⭐ 152
[NeurIPS 2021] Galerkin Transformer: a linear attention without softmax
total releases 8latest release November 04, 2022most recent commit a year ago
Tab Transformer Pytorch ⭐ 609
Implementation of TabTransformer, attention network for tabular data, in Pytorch
total releases 19latest release November 01, 2022most recent commit 5 months ago
Point Transformer Pytorch ⭐ 402
Implementation of the Point Transformer layer, in Pytorch
total releases 8latest release February 12, 2022most recent commit 2 years ago
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.