Dodrio

Exploring attention weights in transformer-based models with linguistic knowledge.
Alternatives To Dodrio
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Ml Nlp10,874
2 years ago29Jupyter Notebook
此项目是机器学习(Machine Learning)、深度学习(Deep Learning)、NLP面试中常考到的知识点和代码实现,也是作为一个算法工程师必会的理论基础知识。
Rwkv Lm10,705
2 months ago60apache-2.0Python
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
Palm Rlhf Pytorch7,496
2 months ago69January 26, 202314mitPython
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
Dalle Pytorch5,383
6 months ago174May 30, 2022125mitPython
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
Awesome Transformer Attention3,895
2 months ago15
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
X Transformers3,840102 months ago317December 02, 202355mitPython
A simple but complete full-attention transformer with a set of promising experimental features from various papers
Keras Attention2,791
4 months ago2apache-2.0Python
Keras Attention Layer (Luong and Bahdanau scores).
Musiclm Pytorch2,686
7 months ago38September 06, 202318mitPython
Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch
Audiolm Pytorch2,11253 months ago311December 02, 202336mitPython
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch
Pytorch Gat1,815
a year ago12mitJupyter Notebook
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
Alternatives To Dodrio
Select To Compare


Alternative Project Comparisons
Popular Attention Mechanism Projects
Popular Deep Learning Projects
Popular Machine Learning Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Deep Learning
Natural Language Processing
Visualization
Attention Mechanism