Awesome Open Source
Awesome Open Source

A Pytorch Implementation of the Transformer Network

This repository includes pytorch implementations of "Attention is All You Need" (Vaswani et al., NIPS 2017) and "Weighted Transformer Network for Machine Translation" (Ahmed et al., arXiv 2017)



  • Vaswani et al., "Attention is All You Need", NIPS 2017
  • Ahmed et al., "Weighted Transformer Network for Machine Translation", Arxiv 2017


Get A Weekly Email With Trending Projects For These Topics
No Spam. Unsubscribe easily at any time.
python (51,962
attention-mechanism (125
machine-translation (64
self-attention (30
attention-is-all-you-need (19

Find Open Source By Browsing 7,000 Topics Across 59 Categories