Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Artificial Intelligence Attention Mechanism Open Source Projects

Open source projects categorized as Artificial Intelligence Attention Mechanism
Categories > Artificial Intelligence > Artificial Intelligence
Categories > Machine Learning > Attention Mechanism
Vit Pytorch ⭐ 16,298
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
dependent packages 6total releases 184most recent commit 4 months agopypi vit-pytorch} Downloads
Palm Rlhf Pytorch ⭐ 7,496
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
total releases 69most recent commit 3 months ago
Dalle Pytorch ⭐ 5,477
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
total releases 174most recent commit 2 months ago
X Transformers ⭐ 3,840
A simple but complete full-attention transformer with a set of promising experimental features from various papers
dependent packages 10total releases 317most recent commit 3 months agopypi x-transformers} Downloads
Musiclm Pytorch ⭐ 2,686
Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch
total releases 38most recent commit 8 months ago
Audiolm Pytorch ⭐ 2,112
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch
dependent packages 5total releases 311most recent commit 3 months agopypi audiolm-pytorch} Downloads
Reformer Pytorch ⭐ 1,917
Reformer, the efficient Transformer, in Pytorch
total releases 139most recent commit 10 months ago
Toolformer Pytorch ⭐ 1,788
Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI
total releases 23most recent commit 4 months ago
Make A Video Pytorch ⭐ 1,449
Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch
total releases 17most recent commit 10 months ago
Lambda Networks ⭐ 1,110
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
total releases 11most recent commit 3 years ago
Alphafold2 ⭐ 1,086
To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
dependent packages 1total releases 135most recent commit 2 years agopypi alphafold2-pytorch} Downloads
Soundstorm Pytorch ⭐ 1,054
Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch
total releases 33most recent commit 5 months ago
Perceiver Pytorch ⭐ 980
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
dependent packages 3total releases 52most recent commit 8 months agopypi perceiver-pytorch} Downloads
Coca Pytorch ⭐ 900
Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch
dependent packages 1total releases 12most recent commit 4 months agopypi CoCa-pytorch} Downloads
Retro Pytorch ⭐ 784
Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
total releases 67most recent commit 6 months ago
Performer Pytorch ⭐ 777
An implementation of Performer, a linear attention-based transformer, in Pytorch
dependent packages 5total releases 77most recent commit 2 years agopypi performer-pytorch} Downloads
Muse Maskgit Pytorch ⭐ 739
Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch
total releases 39most recent commit 5 months ago
Phenaki Pytorch ⭐ 674
Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch
total releases 73most recent commit 5 months ago
Longnet ⭐ 613
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
total releases 37most recent commit 4 months ago
Tab Transformer Pytorch ⭐ 609
Implementation of TabTransformer, attention network for tabular data, in Pytorch
total releases 19most recent commit 5 months ago
Memorizing Transformers Pytorch ⭐ 556
Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch
dependent packages 1total releases 62most recent commit 9 months agopypi memorizing-transformers-pytorch} Downloads
Self Attention Cv ⭐ 550
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
total releases 5most recent commit 3 years ago
Flamingo Pytorch ⭐ 549
Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
dependent packages 3total releases 19most recent commit 2 years agopypi flamingo-pytorch} Downloads
The 10 Most Depended On Artificial Intelligence Attention Mechanism Open Source Projects
Local Attention ⭐ 270
An implementation of local windowed attention for language modeling
dependent packages 17total releases 34latest release October 24, 2023most recent commit 6 months agopypi local-attention} Downloads
X Transformers ⭐ 3,840
A simple but complete full-attention transformer with a set of promising experimental features from various papers
dependent packages 10total releases 317latest release December 02, 2023most recent commit 3 months agopypi x-transformers} Downloads
Swarms ⭐ 376
Build, Deploy, and Scale Reliable Swarms of Autonomous Agents for Workflow Automation. Join our Community: https://discord.gg/DbjBMJTSWD
dependent packages 9total releases 208latest release December 11, 2023most recent commit 3 months agopypi swarms} Downloads
Performer Pytorch ⭐ 777
An implementation of Performer, a linear attention-based transformer, in Pytorch
dependent packages 5total releases 77latest release February 02, 2022most recent commit 2 years agopypi performer-pytorch} Downloads
Audiolm Pytorch ⭐ 2,112
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch
dependent packages 5total releases 311latest release December 02, 2023most recent commit 3 months agopypi audiolm-pytorch} Downloads
Colt5 Attention ⭐ 207
Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
dependent packages 5total releases 69latest release December 02, 2023most recent commit 5 months agopypi CoLT5-attention} Downloads
Eqtransformer ⭐ 260
EQTransformer, a python package for earthquake signal detection and phase picking using AI.
dependent packages 3total releases 46latest release January 30, 2021most recent commit 5 months agopypi EQTransformer} Downloads
The 10 Latest Releases In Artificial Intelligence Attention Mechanism Open Source Projects
Rt 2 ⭐ 215
Democratization of RT-2 "RT-2: New model translates vision and language into action"
total releases 8latest release December 23, 2023most recent commit 3 months ago
Swarms ⭐ 376
Build, Deploy, and Scale Reliable Swarms of Autonomous Agents for Workflow Automation. Join our Community: https://discord.gg/DbjBMJTSWD
dependent packages 9total releases 208latest release December 11, 2023most recent commit 3 months agopypi swarms} Downloads
Robotic Transformer Pytorch ⭐ 306
Implementation of RT1 (Robotic Transformer) in Pytorch
total releases 22latest release December 08, 2023most recent commit 5 months ago
Parti Pytorch ⭐ 487
Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch
total releases 21latest release December 08, 2023most recent commit 5 months ago
Colt5 Attention ⭐ 207
Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
dependent packages 5total releases 69latest release December 02, 2023most recent commit 5 months agopypi CoLT5-attention} Downloads
Audiolm Pytorch ⭐ 2,112
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch
dependent packages 5total releases 311latest release December 02, 2023most recent commit 3 months agopypi audiolm-pytorch} Downloads
Popular Artificial Intelligence Categories
Artificial Intelligence
Robot
Ros
Discord Bot
Home Assistant
Telegram Bot
Chatbot
Robotics
Object Detection
Home Automation
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.