Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Transformer Attention Open Source Projects

Open source projects categorized as Transformer Attention
Annotated_deep_learning_paper_implementations ⭐ 41,877
🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
dependent packages 2total releases 79most recent commit 3 months agopypi labml-nn} Downloads
Vit Pytorch ⭐ 16,298
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
dependent packages 6total releases 184most recent commit 4 months agopypi vit-pytorch} Downloads
Nlp Tutorial ⭐ 13,226
Natural Language Processing Tutorial for Deep Learning Researchers
most recent commit 5 months ago
Espnet ⭐ 7,563
End-to-End Speech Processing Toolkit
dependent packages 5total releases 33most recent commit 3 months agopypi espnet} Downloads
Gpt Neox ⭐ 6,366
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
most recent commit 3 months ago
Bertviz ⭐ 5,547
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
dependent packages 3total releases 5most recent commit 8 months agopypi bertviz} Downloads
Pytorch Seq2seq ⭐ 5,024
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
most recent commit 3 months ago
Informer2020 ⭐ 4,553
The GitHub repository for the paper "Informer" accepted by AAAI 2021.
most recent commit 4 months ago
Transformer ⭐ 3,882
A TensorFlow Implementation of the Transformer: Attention Is All You Need
most recent commit a year ago
X Transformers ⭐ 3,840
A simple but complete full-attention transformer with a set of promising experimental features from various papers
dependent packages 10total releases 317most recent commit 3 months agopypi x-transformers} Downloads
Nlp_paper_study ⭐ 3,373
该仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记
most recent commit 8 months ago
Scenic ⭐ 2,733
Scenic: A Jax Library for Computer Vision Research and Beyond
most recent commit 3 months ago
Reformer Pytorch ⭐ 1,917
Reformer, the efficient Transformer, in Pytorch
total releases 139most recent commit 10 months ago
Yoloair ⭐ 1,714
🔥🔥🔥YOLOv5, YOLOv6, YOLOv7, YOLOv8, PPYOLOE, YOLOX, YOLOR, YOLOv4, YOLOv3, Transformer, Attention, TOOD and Improved-YOLOv5-YOLOv7... Support to improve backbone, neck, head, loss, IoU, NMS and other modules🚀
most recent commit a year ago
Transformer Explainability ⭐ 1,596
[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.
most recent commit 3 months ago
Nlp Journey ⭐ 1,563
Documents, papers and codes related to Natural Language Processing, including Topic Model, Word Embedding, Named Entity Recognition, Text Classificatin, Text Generation, Text Similarity, Machine Translation)，etc. All codes are implemented intensorflow 2.0.
total releases 3most recent commit 5 months ago
Fast Transformers ⭐ 1,369
Pytorch library for fast transformer implementations
dependent packages 5total releases 8most recent commit a year agopypi pytorch-fast-transformers} Downloads
Hopfield Layers ⭐ 1,258
Hopfield Networks is All You Need
most recent commit 2 years ago
Gansformer ⭐ 1,188
Generative Adversarial Transformers
most recent commit 2 years ago
Nlp Paper ⭐ 1,070
自然语言处理领域下的相关论文（附阅读笔记），复现模型以及数据处理等（代码含TensorFlow和Py
total releases 2most recent commit 4 months ago
Transformer ⭐ 1,014
PyTorch Implementation of "Attention Is All You Need"
most recent commit 10 months ago
Sparse_attention ⭐ 1,002
Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
most recent commit 4 years ago
Vit Pytorch ⭐ 984
Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)
most recent commit 2 years ago
The 10 Most Depended On Transformer Attention Open Source Projects
X Transformers ⭐ 3,840
A simple but complete full-attention transformer with a set of promising experimental features from various papers
dependent packages 10total releases 317latest release December 02, 2023most recent commit 3 months agopypi x-transformers} Downloads
Fast Transformers ⭐ 1,369
Pytorch library for fast transformer implementations
dependent packages 5total releases 8latest release October 14, 2020most recent commit a year agopypi pytorch-fast-transformers} Downloads
Espnet ⭐ 7,563
End-to-End Speech Processing Toolkit
dependent packages 5total releases 33latest release October 25, 2023most recent commit 3 months agopypi espnet} Downloads
Performer Pytorch ⭐ 777
An implementation of Performer, a linear attention-based transformer, in Pytorch
dependent packages 5total releases 77latest release February 02, 2022most recent commit 2 years agopypi performer-pytorch} Downloads
Livereactload Api ⭐ 8
[OBSOLETE] API for LiveReactload browser integrations
dependent packages 4total releases 9latest release October 18, 2015most recent commit 9 years agonpm livereactload-api} Downloads
Keras Transformer ⭐ 312
Transformer implemented in Keras
dependent packages 3total releases 39latest release January 22, 2022most recent commit 2 years agopypi keras-transformer} Downloads
Bertviz ⭐ 5,547
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
dependent packages 3total releases 5latest release April 02, 2022most recent commit 8 months agopypi bertviz} Downloads
Vit Keras ⭐ 276
Keras implementation of ViT (Vision Transformer)
dependent packages 2total releases 19latest release July 22, 2021most recent commit a year agopypi vit-keras} Downloads
The 10 Latest Releases In Transformer Attention Open Source Projects
X Transformers ⭐ 3,840
A simple but complete full-attention transformer with a set of promising experimental features from various papers
dependent packages 10total releases 317latest release December 02, 2023most recent commit 3 months agopypi x-transformers} Downloads
Spear Tts Pytorch ⭐ 178
Implementation of Spear-TTS - multi-speaker text-to-speech attention network, in Pytorch
dependent packages 2total releases 52latest release October 30, 2023most recent commit 6 months agopypi spear-tts-pytorch} Downloads
Espnet ⭐ 7,563
End-to-End Speech Processing Toolkit
dependent packages 5total releases 33latest release October 25, 2023most recent commit 3 months agopypi espnet} Downloads
Gcvit Tf ⭐ 20
Tensorflow 2.0 Implementation of GCViT: Global Context Vision Transformer
total releases 16latest release October 16, 2023most recent commit 4 months ago
Isab Pytorch ⭐ 44
An implementation of (Induced) Set Attention Block, from the Set Transformers paper
dependent packages 1total releases 9latest release January 10, 2023most recent commit a year agopypi isab-pytorch} Downloads
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.