Attention
This repository will house a visualization that will attempt to convey instant enlightenment of how Attention works to someone not working in artificial intelligence, with 3Blue1Brown as inspiration
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Vit Pytorch | 16,298 |  | 6 | 5 months ago | 184 | November 15, 2023 | 114 | mit | Python | |
| Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch | ||||||||||
| Palm Rlhf Pytorch | 7,496 | 4 months ago | 69 | January 26, 2023 | 14 | mit | Python | |||
| Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM | ||||||||||
| Dalle Pytorch | 5,477 | 3 months ago | 174 | May 30, 2022 | 125 | mit | Python | |||
| Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch | ||||||||||
| X Transformers | 3,840 |  | 10 | 3 months ago | 317 | December 02, 2023 | 55 | mit | Python | |
| A simple but complete full-attention transformer with a set of promising experimental features from various papers | ||||||||||
| Musiclm Pytorch | 2,686 | 8 months ago | 38 | September 06, 2023 | 18 | mit | Python | |||
| Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch | ||||||||||
| Audiolm Pytorch | 2,112 |  | 5 | 4 months ago | 311 | December 02, 2023 | 36 | mit | Python | |
| Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch | ||||||||||
| Reformer Pytorch | 1,917 | a year ago | 139 | November 06, 2021 | 14 | mit | Python | |||
| Reformer, the efficient Transformer, in Pytorch | ||||||||||
| Toolformer Pytorch | 1,788 | 5 months ago | 23 | October 15, 2023 | 8 | mit | Python | |||
| Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI | ||||||||||
| Make A Video Pytorch | 1,449 | a year ago | 17 | December 13, 2022 | 5 | mit | Python | |||
| Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch | ||||||||||
| Lambda Networks | 1,110 | 3 years ago | 11 | November 18, 2020 | 8 | mit | Python | |||
| Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute | ||||||||||
Alternatives To AttentionSelect To Compare
Alternative Project Comparisons
Popular Artificial Intelligence Projects
Popular Attention Mechanism Projects
Popular Artificial Intelligence Categories
Related Searches
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Html
Deep Learning
Artificial Intelligence
Attention Mechanism