Project Name	Stars	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Annotated_deep_learning_paper_implementations	53,666	2	8 months ago	79	November 05, 2023	30	mit	Python
🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
Vit Pytorch	16,298	6	a year ago	184	November 15, 2023	114	mit	Python
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
Nlp Tutorial	13,226		a year ago			35	mit	Jupyter Notebook
Natural Language Processing Tutorial for Deep Learning Researchers
External Attention Pytorch	10,361		a year ago	2	September 27, 2022	63	mit	Python
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
Attention Is All You Need Pytorch	7,910		2 years ago			74	mit	Python
A PyTorch implementation of the Transformer model in "Attention is All You Need".
Espnet	7,563	5	a year ago	33	October 25, 2023	270	apache-2.0	Python
End-to-End Speech Processing Toolkit
Bertviz	5,547	3	2 years ago	5	April 02, 2022	8	apache-2.0	Python
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
Pytorch Seq2seq	5,024		a year ago				mit	Jupyter Notebook
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
Informer2020	4,553		a year ago			128	apache-2.0	Python
The GitHub repository for the paper "Informer" accepted by AAAI 2021.
Image_segmentation	2,186		2 years ago					Python
Pytorch implementation of U-Net, R2U-Net, Attention U-Net, and Attention R2U-Net.

Alternatives To Attention Is All You Need Pytorch

Select To Compare

Annotated_deep_learning_paper_implementations ⭐ 53,666

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

dependent packages 2total releases 79most recent commit 8 months ago

Vit Pytorch ⭐ 16,298

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

dependent packages 6total releases 184most recent commit a year ago

Nlp Tutorial ⭐ 13,226

Natural Language Processing Tutorial for Deep Learning Researchers

most recent commit a year ago

External Attention Pytorch ⭐ 10,361

🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐

total releases 2most recent commit a year ago

Attention Is All You Need Pytorch ⭐ 7,910

A PyTorch implementation of the Transformer model in "Attention is All You Need".

most recent commit 2 years ago

Espnet ⭐ 7,563

End-to-End Speech Processing Toolkit

dependent packages 5total releases 33most recent commit a year ago

Bertviz ⭐ 5,547

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

dependent packages 3total releases 5most recent commit 2 years ago

Pytorch Seq2seq ⭐ 5,024

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

most recent commit a year ago

Informer2020 ⭐ 4,553

The GitHub repository for the paper "Informer" accepted by AAAI 2021.

most recent commit a year ago

Image_segmentation ⭐ 2,186

Pytorch implementation of U-Net, R2U-Net, Attention U-Net, and Attention R2U-Net.

most recent commit 2 years ago

Suggest An Alternative To attention-is-all-you-need-pytorch

Alternative Project Comparisons

Attention Is All You Need Pytorch vs Annotated_deep_learning_paper_implementations

Attention Is All You Need Pytorch vs Vit Pytorch

Attention Is All You Need Pytorch vs Nlp Tutorial

Attention Is All You Need Pytorch vs External Attention Pytorch

Attention Is All You Need Pytorch vs Espnet

Attention Is All You Need Pytorch vs Bertviz

Attention Is All You Need Pytorch vs Pytorch Seq2seq

Attention Is All You Need Pytorch vs Informer2020

Attention Is All You Need Pytorch vs Image_segmentation

Popular Attention Projects

Numpy Ml ⭐ 14,162

Machine learning, in numpy

total releases 3latest release June 20, 2020most recent commit a year ago

Text_classification ⭐ 7,628

all kinds of text classification models and more with deep learning

most recent commit 2 years ago

Nmt ⭐ 6,085

TensorFlow Neural Machine Translation Tutorial

most recent commit 3 years ago

Transformer ⭐ 3,882

A TensorFlow Implementation of the Transformer: Attention Is All You Need

most recent commit 2 years ago

X Transformers ⭐ 3,840

A simple but complete full-attention transformer with a set of promising experimental features from various papers

dependent packages 10total releases 317latest release December 02, 2023most recent commit a year ago

Popular Pytorch Projects

Transformers ⭐ 143,208

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

dependent packages 2,484total releases 125latest release November 15, 2023most recent commit 8 days ago

Stable Diffusion Webui ⭐ 118,856

Stable Diffusion web UI

total releases 2latest release January 17, 2022most recent commit a year ago

Pytorch ⭐ 74,794

Tensors and Dynamic neural networks in Python with strong GPU acceleration

dependent packages 8,272total releases 39latest release November 15, 2023most recent commit a year ago

Keras ⭐ 62,903

Deep Learning for humans

dependent packages 697total releases 87latest release December 06, 2023most recent commit 9 days ago

Real Time Voice Cloning ⭐ 52,759

Clone a voice in 5 seconds to generate arbitrary speech in real-time

most recent commit 8 months ago

Popular Machine Learning Categories

Natural Language Processing

Neural Network

Neural

Computer Vision

Convolutional Neural Networks

Keras