Longnet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
Alternatives To Longnet
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Annotated_deep_learning_paper_implementations41,87725 months ago79November 05, 202330mitJupyter Notebook
🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
Numpy Ml14,162
8 months ago3June 20, 202035gpl-3.0Python
Machine learning, in numpy
Bertviz5,547310 months ago5April 02, 20228apache-2.0Python
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
Reformer Pytorch1,917
a year ago139November 06, 202114mitPython
Reformer, the efficient Transformer, in Pytorch
Deepvoice3_pytorch1,906
6 months ago43otherPython
PyTorch implementation of convolutional neural networks-based text-to-speech synthesis models
Nlp Models Tensorflow1,329
4 years ago3mitJupyter Notebook
Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0
Attention Ocr957
8 months ago21April 19, 201926mitPython
A Tensorflow model for text recognition (CNN + seq2seq with visual attention) available as a Python package and compatible with Google Cloud ML Engine.
Keras Attention656
5 years ago22agpl-3.0Python
Visualizing RNNs using the attention mechanism
Longnet613
5 months ago37August 10, 20233apache-2.0Python
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
Self Attention Cv550
3 years ago5July 26, 20211mitPython
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
Alternatives To Longnet
Select To Compare


Alternative Project Comparisons
Popular Attention Projects
Popular Machine Learning Projects
Popular Machine Learning Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Machine Learning
Artificial Intelligence
Attention
Attention Mechanism