Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Deep Learning Attention Mechanism Open Source Projects

Open source projects categorized as Deep Learning Attention Mechanism
Categories > Machine Learning > Attention Mechanism
Categories > Machine Learning > Deep Learning
Ml Nlp ⭐ 10,874
此项目是机器学习(Machine Learning)、深度学习(Deep Learning)、NLP面试中常考到的知识点和代码实现，也是作为一个算法工程师必会的理论基础知识。
most recent commit 2 years ago
Rwkv Lm ⭐ 10,705
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
most recent commit 3 months ago
Palm Rlhf Pytorch ⭐ 7,496
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
total releases 69most recent commit 3 months ago
Dalle Pytorch ⭐ 5,477
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
total releases 174most recent commit 2 months ago
Awesome Transformer Attention ⭐ 3,895
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
most recent commit 3 months ago
X Transformers ⭐ 3,840
A simple but complete full-attention transformer with a set of promising experimental features from various papers
dependent packages 10total releases 317most recent commit 3 months agopypi x-transformers} Downloads
Keras Attention ⭐ 2,794
Keras Attention Layer (Luong and Bahdanau scores).
most recent commit 5 months ago
Musiclm Pytorch ⭐ 2,686
Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch
total releases 38most recent commit 8 months ago
Audiolm Pytorch ⭐ 2,112
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch
dependent packages 5total releases 311most recent commit 3 months agopypi audiolm-pytorch} Downloads
Pytorch Gat ⭐ 1,815
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
most recent commit a year ago
Toolformer Pytorch ⭐ 1,788
Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI
total releases 23most recent commit 4 months ago
Make A Video Pytorch ⭐ 1,449
Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch
total releases 17most recent commit 10 months ago
Whisper Timestamped ⭐ 1,217
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
dependent packages 3total releases 3most recent commit 3 months agopypi whisper-timestamped} Downloads
Sockeye ⭐ 1,190
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
total releases 85most recent commit 6 months ago
Lambda Networks ⭐ 1,110
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
total releases 11most recent commit 3 years ago
Alphafold2 ⭐ 1,086
To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
dependent packages 1total releases 135most recent commit 2 years agopypi alphafold2-pytorch} Downloads
Soundstorm Pytorch ⭐ 1,054
Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch
total releases 33most recent commit 5 months ago
Perceiver Pytorch ⭐ 980
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
dependent packages 3total releases 52most recent commit 8 months agopypi perceiver-pytorch} Downloads
Coca Pytorch ⭐ 900
Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch
dependent packages 1total releases 12most recent commit 4 months agopypi CoCa-pytorch} Downloads
Pointer_summarizer ⭐ 859
pytorch implementation of "Get To The Point: Summarization with Pointer-Generator Networks"
most recent commit a year ago
Chatbot_cn ⭐ 850
基于金融-司法领域(兼有闲聊性质)的聊天机器人，其中的主要模块有信息抽取、NLU、NLG、知识图谱等
most recent commit 3 years ago
Retro Pytorch ⭐ 784
Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
total releases 67most recent commit 6 months ago
Performer Pytorch ⭐ 777
An implementation of Performer, a linear attention-based transformer, in Pytorch
dependent packages 5total releases 77most recent commit 2 years agopypi performer-pytorch} Downloads
The 10 Most Depended On Deep Learning Attention Mechanism Open Source Projects
Local Attention ⭐ 270
An implementation of local windowed attention for language modeling
dependent packages 17total releases 34latest release October 24, 2023most recent commit 6 months agopypi local-attention} Downloads
X Transformers ⭐ 3,840
A simple but complete full-attention transformer with a set of promising experimental features from various papers
dependent packages 10total releases 317latest release December 02, 2023most recent commit 3 months agopypi x-transformers} Downloads
Performer Pytorch ⭐ 777
An implementation of Performer, a linear attention-based transformer, in Pytorch
dependent packages 5total releases 77latest release February 02, 2022most recent commit 2 years agopypi performer-pytorch} Downloads
Audiolm Pytorch ⭐ 2,112
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch
dependent packages 5total releases 311latest release December 02, 2023most recent commit 3 months agopypi audiolm-pytorch} Downloads
Colt5 Attention ⭐ 207
Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
dependent packages 5total releases 69latest release December 02, 2023most recent commit 5 months agopypi CoLT5-attention} Downloads
Eqtransformer ⭐ 260
EQTransformer, a python package for earthquake signal detection and phase picking using AI.
dependent packages 3total releases 46latest release January 30, 2021most recent commit 5 months agopypi EQTransformer} Downloads
Perceiver Pytorch ⭐ 980
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
dependent packages 3total releases 52latest release August 22, 2023most recent commit 8 months agopypi perceiver-pytorch} Downloads
Whisper Timestamped ⭐ 1,217
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
dependent packages 3total releases 3latest release December 08, 2023most recent commit 3 months agopypi whisper-timestamped} Downloads
The 10 Latest Releases In Deep Learning Attention Mechanism Open Source Projects
Whisper Timestamped ⭐ 1,217
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
dependent packages 3total releases 3latest release December 08, 2023most recent commit 3 months agopypi whisper-timestamped} Downloads
Robotic Transformer Pytorch ⭐ 306
Implementation of RT1 (Robotic Transformer) in Pytorch
total releases 22latest release December 08, 2023most recent commit 5 months ago
Parti Pytorch ⭐ 487
Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch
total releases 21latest release December 08, 2023most recent commit 5 months ago
Colt5 Attention ⭐ 207
Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
dependent packages 5total releases 69latest release December 02, 2023most recent commit 5 months agopypi CoLT5-attention} Downloads
Audiolm Pytorch ⭐ 2,112
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch
dependent packages 5total releases 311latest release December 02, 2023most recent commit 3 months agopypi audiolm-pytorch} Downloads
X Transformers ⭐ 3,840
A simple but complete full-attention transformer with a set of promising experimental features from various papers
dependent packages 10total releases 317latest release December 02, 2023most recent commit 3 months agopypi x-transformers} Downloads
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.