Linear Attention Recurrent Neural Network

A recurrent attention module consisting of an LSTM cell which can query its own past cell states by the means of windowed multi-head attention. The formulas are derived from the BN-LSTM and the Transformer Network. The LARNN cell with attention can be easily used inside a loop on the cell state, just like any other RNN. (LARNN)
Alternatives To Linear Attention Recurrent Neural Network
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Numpy Ml14,162
6 months ago3June 20, 202035gpl-3.0Python
Machine learning, in numpy
Pytorch Seq2seq5,024
3 months agomitJupyter Notebook
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
Nlp_paper_study3,373
8 months ago1C++
该仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记
Nlp Models Tensorflow1,329
4 years ago3mitJupyter Notebook
Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0
Vad632
3 years ago32MATLAB
Voice activity detection (VAD) toolkit including DNN, bDNN, LSTM and ACAM based VAD. We also provide our directly recorded dataset.
Text Classification622
5 years agoapache-2.0Python
Implementation of papers for text classification task on DBpedia
Eeg Dl563
a year ago10May 13, 20204mitPython
A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.
Text Classification Pytorch538
5 years ago4mitPython
Text classification using deep learning models in Pytorch
Chinesenre523
2 years ago21Python
中文实体关系抽取,pytorch,bilstm+attention
Attention Networks For Classification477
4 years ago8Jupyter Notebook
Hierarchical Attention Networks for Document Classification in PyTorch
Alternatives To Linear Attention Recurrent Neural Network
Select To Compare


Alternative Project Comparisons
Popular Lstm Projects
Popular Attention Projects
Popular Machine Learning Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Jupyter Notebook
Pytorch
Lstm
Attention
Recurrent Neural Networks
Attention Mechanism
Attention Model