Efficient Attention

[EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
Alternatives To Efficient Attention
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Ml Nlp10,874
2 years ago29Jupyter Notebook
此项目是机器学习(Machine Learning)、深度学习(Deep Learning)、NLP面试中常考到的知识点和代码实现,也是作为一个算法工程师必会的理论基础知识。
Reformer Pytorch1,917
10 months ago139November 06, 202114mitPython
Reformer, the efficient Transformer, in Pytorch
Whisper Timestamped1,21733 months ago3December 08, 202315agpl-3.0Python
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
Sockeye1,190
26 months ago85March 03, 20233apache-2.0Python
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
Keras Attention656
5 years ago22agpl-3.0Python
Visualizing RNNs using the attention mechanism
Longnet613
4 months ago37August 10, 20233apache-2.0Python
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
Self Attention Cv550
3 years ago5July 26, 20211mitPython
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
Simgnn540
a year ago2gpl-3.0Python
A PyTorch implementation of "SimGNN: A Neural Network Approach to Fast Graph Similarity Computation" (WSDM 2019).
Deeplearning.ai Natural Language Processing Specialization523
3 years agogpl-3.0Jupyter Notebook
This repository contains my full work and notes on Coursera's NLP Specialization (Natural Language Processing) taught by the instructor Younes Bensouda Mourri and Łukasz Kaiser offered by deeplearning.ai
Nmt Keras514
3 years ago4mitPython
Neural Machine Translation with Keras
Alternatives To Efficient Attention
Select To Compare


Alternative Project Comparisons
Popular Attention Mechanism Projects
Popular Machine Learning Projects
Popular Machine Learning Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Machine Learning
Pytorch
Language Model
Attention Mechanism
Machine Translation