Awesome Open Source
Awesome Open Source
Combined Topics
attention x

The Top 3,886 Attention Open Source Projects

Categories > Machine Learning > Attention
Annotated_deep_learning_paper_implementations ⭐ 11,598
🧑‍🏫 59 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
dependent packages 1total releases 71most recent commit 3 days agopypi labml-nn} Downloads
Numpy Ml ⭐ 11,141
Machine learning, in numpy
total releases 3most recent commit 7 months ago
Vit Pytorch ⭐ 10,913
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
dependent packages 3total releases 142most recent commit 21 days agopypi vit-pytorch} Downloads
Nlp Tutorial ⭐ 9,097
Natural Language Processing Tutorial for Deep Learning Researchers
most recent commit a year ago
Mingpt ⭐ 7,718
A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
most recent commit 12 days ago
Text_classification ⭐ 7,354
all kinds of text classification models and more with deep learning
most recent commit a month ago
External Attention Pytorch ⭐ 6,274
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
most recent commit 7 hours ago
Attention Is All You Need Pytorch ⭐ 6,220
A PyTorch implementation of the Transformer model in "Attention is All You Need".
most recent commit 6 months ago
Nmt ⭐ 5,815
TensorFlow Neural Machine Translation Tutorial
most recent commit a year ago
Espnet ⭐ 5,376
End-to-End Speech Processing Toolkit
dependent packages 1total releases 26most recent commit 4 hours agopypi espnet} Downloads
Dalle Pytorch ⭐ 4,599
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
total releases 172most recent commit a month ago
Bertviz ⭐ 4,256
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
total releases 5most recent commit 24 days ago
Transformer ⭐ 3,690
A TensorFlow Implementation of the Transformer: Attention Is All You Need
most recent commit 6 months ago
Pytorch Seq2seq ⭐ 2,634
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
most recent commit a year ago
Keras Attention Mechanism ⭐ 2,580
Attention mechanism Implementation for Keras.
most recent commit 4 months ago
Nlp_paper_study ⭐ 2,531
该仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记
most recent commit a month ago
Gpt Neox ⭐ 2,386
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
most recent commit 3 days ago
Informer2020 ⭐ 2,274
The GitHub repository for the paper "Informer" accepted by AAAI 2021.
most recent commit 4 months ago
Spektral ⭐ 2,136
Graph Neural Networks with Keras and Tensorflow 2.
dependent packages 2total releases 32most recent commit a month agopypi spektral} Downloads
Leader Line ⭐ 2,094
Draw a leader line in your web page.
dependent packages 13total releases 14most recent commit 3 months agonpm leader-line} Downloads
A Pytorch Tutorial To Image Captioning ⭐ 2,084
Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning
most recent commit 20 days ago
Gat ⭐ 2,078
Graph Attention Networks (https://arxiv.org/abs/1710.10903)
most recent commit a year ago
Self Attention Gan ⭐ 1,822
Pytorch implementation of Self-Attention Generative Adversarial Networks (SAGAN)
most recent commit 2 years ago
X Transformers ⭐ 1,770
A simple but complete full-attention transformer with a set of promising experimental features from various papers
dependent packages 6total releases 162most recent commit 2 days agopypi x-transformers} Downloads
Reformer Pytorch ⭐ 1,755
Reformer, the efficient Transformer, in Pytorch
total releases 139most recent commit 2 months ago
Tacotron ⭐ 1,742
A TensorFlow Implementation of Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
most recent commit 4 years ago
Pygat ⭐ 1,684
Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
most recent commit a year ago
Chinese Text Classification Pytorch ⭐ 1,609
中文文本分类，TextCNN，TextRNN，FastText，TextRCNN，BiLSTM_At
most recent commit 2 years ago
Yolov4 Pytorch ⭐ 1,572
This is a pytorch repository of YOLOv4, attentive YOLOv4 and mobilenet YOLOv4 with PASCAL VOC and COCO
most recent commit 4 months ago
Danet ⭐ 1,556
Dual Attention Network for Scene Segmentation (CVPR2019)
most recent commit 2 years ago
Deepvoice3_pytorch ⭐ 1,449
PyTorch implementation of convolutional neural networks-based text-to-speech synthesis models
most recent commit 2 years ago
Absa Pytorch ⭐ 1,446
Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析，使用PyTorch实现。
most recent commit 7 months ago
Reflection_summary ⭐ 1,379
算法理论基础知识应知应会
most recent commit 2 years ago
Swipebackhelper ⭐ 1,378
make your activity can swipe to close
most recent commit 5 years ago
Bi Att Flow ⭐ 1,367
Bi-directional Attention Flow (BiDAF) network is a multi-stage hierarchical process that represents context at different levels of granularity and uses a bi-directional attention flow mechanism to achieve a query-aware context representation without early summarization.
most recent commit 3 years ago
Nlp Models Tensorflow ⭐ 1,329
Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0
most recent commit 2 years ago
Nlp Journey ⭐ 1,328
Documents, papers and codes related to Natural Language Processing, including Topic Model, Word Embedding, Named Entity Recognition, Text Classificatin, Text Generation, Text Similarity, Machine Translation)，etc. All codes are implemented intensorflow 2.0.
total releases 3most recent commit a year ago
Scenic ⭐ 1,259
Scenic: A Jax Library for Computer Vision Research and Beyond
most recent commit 7 hours ago
Hopfield Layers ⭐ 1,258
Hopfield Networks is All You Need
most recent commit 7 months ago
Deep_architecture_genealogy ⭐ 1,196
Deep Learning Architecture Genealogy Project
most recent commit 2 years ago
Gansformer ⭐ 1,188
Generative Adversarial Transformers
most recent commit 2 months ago
Seq2seq Attn ⭐ 1,167
Sequence-to-sequence model with LSTM encoder/decoders and attention
most recent commit 2 years ago
Attention Transfer ⭐ 1,120
Improving Convolutional Networks via Attention Transfer (ICLR 2017)
most recent commit 4 years ago
Lambda Networks ⭐ 1,110
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
total releases 11most recent commit 2 years ago
Sha Rnn ⭐ 1,110
Single Headed Attention RNN - "Stop thinking with your head"
most recent commit 3 years ago
Attention Gated Networks ⭐ 1,099
Use of Attention Gates in a Convolutional Neural Network / Medical Image Classification and Segmentation
most recent commit 2 years ago
Rebar ⭐ 1,089
ATTENTION: Please find the canonical repository here:
most recent commit 6 years ago
Rcan ⭐ 1,082
PyTorch code for our ECCV 2018 paper "Image Super-Resolution Using Very Deep Residual Channel Attention Networks"
most recent commit 5 months ago
Ccnet ⭐ 1,061
CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).
most recent commit a year ago
Chibisafe ⭐ 1,005
Blazing fast file uploader and awesome bunker written in node! 🚀
most recent commit a month ago
Textclassifier ⭐ 1,003
Text classifier for Hierarchical Attention Networks for Document Classification
most recent commit a year ago
Sparse_attention ⭐ 1,002
Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
most recent commit 2 years ago
Transformer Explainability ⭐ 985
[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.
most recent commit a month ago
Vit Pytorch ⭐ 984
Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)
most recent commit 7 months ago
Bottom Up Attention ⭐ 979
Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome
most recent commit 2 years ago
Attention Ocr ⭐ 973
Visual Attention based OCR
most recent commit 4 years ago
Fast Transformers ⭐ 930
Pytorch library for fast transformer implementations
dependent packages 2total releases 8most recent commit a year agopypi pytorch-fast-transformers} Downloads
Deberta ⭐ 900
The implementation of DeBERTa
total releases 13most recent commit 5 months ago
Simplecvreproduction ⭐ 890
👊 Reproduce simple cv project including attention module, classification, object detection, segmentation, keypoint detection, tracking 😄 etc.
most recent commit 4 months ago
Show Attend And Tell ⭐ 885
TensorFlow Implementation of "Show, Attend and Tell"
most recent commit 4 years ago
Image_segmentation ⭐ 880
Pytorch implementation of U-Net, R2U-Net, Attention U-Net, and Attention R2U-Net.
most recent commit 2 years ago
Attention Ocr ⭐ 874
A Tensorflow model for text recognition (CNN + seq2seq with visual attention) available as a Python package and compatible with Google Cloud ML Engine.
total releases 21most recent commit 10 months ago
Arctic Captions ⭐ 831
most recent commit 7 years ago
Awesome Image Captioning ⭐ 828
A curated list of image captioning and related area resources. :-)
most recent commit 3 months ago
Ride ⭐ 827
Test data editor for Robot Framework
dependent packages 6total releases 52most recent commit 9 days agopypi robotframework-ride} Downloads
Performer Pytorch ⭐ 777
An implementation of Performer, a linear attention-based transformer, in Pytorch
dependent packages 4total releases 77most recent commit 6 months agopypi performer-pytorch} Downloads
Django Bootstrap ⭐ 735
Django Form Implementation of the Twitter-Bootstrap UI
most recent commit 10 years ago
Self Attention Gan ⭐ 722
most recent commit 3 years ago
Pytorch Gat ⭐ 719
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
most recent commit 2 years ago
Awesome Fast Attention ⭐ 717
list of efficient attention modules
most recent commit a year ago
Nlp Paper ⭐ 707
自然语言处理领域下的相关论文（附阅读笔记），复现模型以及数据处理等（代码含TensorFlow和Py
total releases 2most recent commit 17 days ago
Tf Rnn Attention ⭐ 703
Tensorflow implementation of attention mechanism for text classification tasks.
most recent commit 3 years ago
Awesome Bert Nlp ⭐ 703
A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.
most recent commit 19 days ago
Dockerjenkins_tutorial ⭐ 693
A repository for items learned in my Getting Started with Jenkins and Docker tutorial series
most recent commit 3 years ago
Attention Module ⭐ 680
Official PyTorch code for "BAM: Bottleneck Attention Module (BMVC2018)" and "CBAM: Convolutional Block Attention Module (ECCV2018)"
most recent commit 3 years ago
Spatial Transformer Network ⭐ 661
A Tensorflow implementation of Spatial Transformer Networks.
total releases 3most recent commit 4 years ago
Ecanet ⭐ 658
Code for ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks
most recent commit a year ago
Keras Attention ⭐ 656
Visualizing RNNs using the attention mechanism
most recent commit 3 years ago
Seq2seq Pytorch ⭐ 653
Sequence to Sequence Models with PyTorch
most recent commit 5 years ago
Androidtouchgallery ⭐ 651
Android widget for gallery, using viewpager. Allow pinch zoom and drag for images by url
most recent commit 2 years ago
Textclassification Keras ⭐ 649
Text classification models implemented in Keras, including: FastText, TextCNN, TextRNN, TextBiRNN, TextAttBiRNN, HAN, RCNN, RCNNVariant, etc.
most recent commit a year ago
Image_captioning ⭐ 634
Tensorflow implementation of "Show, Attend and Tell: Neural Image Caption Generation with Visual Attention"
most recent commit 4 years ago
Vad ⭐ 632
Voice activity detection (VAD) toolkit including DNN, bDNN, LSTM and ACAM based VAD. We also provide our directly recorded dataset.
most recent commit a year ago
Cbam.pytorch ⭐ 630
Non-official implement of Paper：CBAM: Convolutional Block Attention Module
most recent commit a year ago
Text Classification ⭐ 622
Implementation of papers for text classification task on DBpedia
most recent commit 3 years ago
Tensorflow Ocr ⭐ 616
🖺 OCR using tensorflow with attention
most recent commit 3 years ago
Rlseq2seq ⭐ 610
Deep Reinforcement Learning For Sequence to Sequence Models
most recent commit 3 years ago
Nlp Tutorials ⭐ 609
Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com
most recent commit 6 months ago
Bottom Up Attention Vqa ⭐ 606
An efficient PyTorch implementation of the winning entry of the 2017 VQA Challenge.
most recent commit 3 years ago
Dota Doai ⭐ 598
This repo is the codebase for our team to participate in DOTA related competitions, including rotation and horizontal detection.
most recent commit 20 days ago
Quill Image Extend Module ⭐ 583
vue-quill-editor的增强模块，提供图片上传，复制插入，拖拽插入，支持与其他模块一起使用
dependent packages 10total releases 4most recent commit 3 years agonpm quill-image-extend-module} Downloads
Text2image ⭐ 579
Generating Images from Captions with Attention
most recent commit 6 years ago
Keras Self Attention ⭐ 570
Attention mechanism for processing sequential data that considers the context for each timestamp.
dependent packages 4total releases 43most recent commit 7 months agopypi keras-self-attention} Downloads
R Net ⭐ 569
Tensorflow Implementation of R-Net
most recent commit 4 years ago
Adaptive Span ⭐ 557
Transformer training code for sequential tasks
most recent commit a year ago
Self Attention Cv ⭐ 550
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
total releases 5most recent commit a year ago
Joeynmt ⭐ 550
Minimalist NMT for educational purposes
dependent packages 1total releases 11most recent commit 2 months agopypi joeynmt} Downloads
Attention Cnn ⭐ 550
Source code for "On the Relationship between Self-Attention and Convolutional Layers"
most recent commit 2 years ago
Text Classification Pytorch ⭐ 538
Text classification using deep learning models in Pytorch
most recent commit 4 years ago
Residual Attention Network ⭐ 534
Residual Attention Network for Image Classification
most recent commit 5 years ago
1-100 of 3,886 projects
Related Awesome Lists
Python Attention Projects (2,327)
Pytorch Attention Projects (645)
Jupyter Notebook Attention Projects (547)
Tensorflow Attention Projects (387)
Categories
Advertising 📦 8
All Projects
Application Programming Interfaces 📦 107
Applications 📦 174
Artificial Intelligence 📦 69
Blockchain 📦 66
Build Tools 📦 105
Cloud Computing 📦 68
Code Quality 📦 24
Collaboration 📦 27
Command Line Interface 📦 38
Community 📦 79
Companies 📦 60
Compilers 📦 59
Computer Science 📦 73
Configuration Management 📦 37
Content Management 📦 153
Control Flow 📦 187
Data Formats 📦 72
Data Processing 📦 249
Data Storage 📦 116
Economics 📦 56
Frameworks 📦 178
Games 📦 110
Graphics 📦 92
Hardware 📦 137
Integrated Development Environments 📦 43
Learning Resources 📦 139
Legal 📦 24
Libraries 📦 117
Lists Of Projects 📦 19
Machine Learning 📦 313
Mapping 📦 57
Marketing 📦 15
Mathematics 📦 54
Media 📦 214
Messaging 📦 96
Networking 📦 292
Operating Systems 📦 72
Operations 📦 114
Package Managers 📦 50
Programming Languages 📦 173
Runtime Environments 📦 90
Science 📦 42
Security 📦 342
Social Media 📦 23
Software Architecture 📦 65
Software Development 📦 60
Software Performance 📦 53
Software Quality 📦 116
Text Editors 📦 40
Text Processing 📦 118
User Interface 📦 291
User Interface Components 📦 440
Version Control 📦 26
Virtualization 📦 63
Web Browsers 📦 35
Web Servers 📦 23
Web User Interface 📦 167
Top Programming Languages
Javascript  (1,075,498)
Python  (822,999)
Java  (392,633)
Php  (287,834)
Typescript  (256,558)
C Plus Plus  (242,387)
Ruby  (222,199)
C  (183,944)
Shell  (173,475)
C Sharp  (166,775)
Golang  (161,056)
Swift  (65,974)
Rust  (59,742)
R  (58,838)
Objective C  (57,096)
Dart  (54,358)
Kotlin  (47,839)
Lua  (34,766)
Matlab  (31,457)
Perl  (30,579)
Language  (29,988)
Scala  (28,789)
Haskell  (20,507)
Powershell  (19,320)
Clojure  (19,193)
Bash  (18,792)
Coffeescript  (17,253)
Elixir  (16,804)
Assembly  (14,792)
Processing  (13,287)
Julia  (13,043)
Basic  (10,715)
Flow  (10,533)
Emacs Lisp  (10,478)
Erlang  (9,064)
Groovy  (8,464)
Solidity  (8,429)
Scheme  (8,416)
Ocaml  (6,751)
Pascal  (6,490)
Hack  (6,442)
Lisp  (6,338)
Fortran  (5,599)
Elm  (5,476)
Common Lisp  (5,328)
Dlang  (4,749)
Shell Script  (4,691)
Python Library  (4,469)
Crystal  (4,398)
Scripting  (4,218)
Top Projects
Freecodecamp ⭐ 351,419
996.icu ⭐ 263,365
Free Programming Books ⭐ 244,883
Coding Interview University ⭐ 229,270
Awesome ⭐ 214,149
Developer Roadmap ⭐ 206,515
Public Apis ⭐ 205,440
Vue ⭐ 198,670
React ⭐ 193,290
System Design Primer ⭐ 191,492
Tensorflow ⭐ 167,144
Build Your Own X ⭐ 161,431
Bootstrap ⭐ 159,016
You Dont Know Js ⭐ 157,541
Cs Notes ⭐ 155,369
Ohmyzsh ⭐ 148,894
Javascript Algorithms ⭐ 147,967
Flutter ⭐ 143,647
Python ⭐ 142,183
Awesome Python ⭐ 137,284
Gitignore ⭐ 137,038
Linux ⭐ 136,348
Vscode ⭐ 135,414
Javaguide ⭐ 126,279
Javascript ⭐ 125,450
Python 100 Days ⭐ 122,176
Computer Science ⭐ 121,209
Youtube Dl ⭐ 112,353
The Art Of Command Line ⭐ 108,745
Fucking Algorithm ⭐ 108,035
React Native ⭐ 104,302
Electron ⭐ 103,120
Go ⭐ 102,827
D3 ⭐ 101,796
30 Seconds Of Code ⭐ 100,507
Awesome Selfhosted ⭐ 98,825
Create React App ⭐ 96,479
Axios ⭐ 95,139
Free Programming Books Zh_cn ⭐ 94,901
Kubernetes ⭐ 91,182
Next.js ⭐ 91,139
Node ⭐ 89,531
Awesome Go ⭐ 85,911
Terminal ⭐ 84,698
Deno ⭐ 84,637
Three.js ⭐ 84,427
Typescript ⭐ 83,254
Angular ⭐ 83,247
Ant Design ⭐ 81,449
Material Ui ⭐ 80,496
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2022 Awesome Open Source.  All rights reserved.