Awesome Open Source

Programming Languages

Search results for deep learning attention

deep-learning x

282 search results found

Annotated_deep_learning_paper_implementations ⭐ 41,877

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

Attention Is All You Need Pytorch ⭐ 7,910

A PyTorch implementation of the Transformer model in "Attention is All You Need".

Espnet ⭐ 7,563

End-to-End Speech Processing Toolkit

Informer2020 ⭐ 4,553

The GitHub repository for the paper "Informer" accepted by AAAI 2021.

X Transformers ⭐ 3,840

A simple but complete full-attention transformer with a set of promising experimental features from various papers

Scenic ⭐ 2,733

Scenic: A Jax Library for Computer Vision Research and Beyond

Spektral ⭐ 2,317

Graph Neural Networks with Keras and Tensorflow 2.

Pytorch Gat ⭐ 1,815

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

Yoloair ⭐ 1,714

🔥🔥🔥YOLOv5, YOLOv6, YOLOv7, YOLOv8, PPYOLOE, YOLOX, YOLOR, YOLOv4, YOLOv3, Transformer, Attention, TOOD and Improved-YOLOv5-YOLOv7... Support to improve backbone, neck, head, loss, IoU, NMS and other modules🚀

Deberta ⭐ 1,673

The implementation of DeBERTa

Transformer Explainability ⭐ 1,596

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

Nlp Journey ⭐ 1,563

Documents, papers and codes related to Natural Language Processing, including Topic Model, Word Embedding, Named Entity Recognition, Text Classificatin, Text Generation, Text Similarity, Machine Translation)，etc. All codes are implemented intensorflow 2.0.

Nlp Models Tensorflow ⭐ 1,329

Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0

Attention Transfer ⭐ 1,120

Improving Convolutional Networks via Attention Transfer (ICLR 2017)

Lambda Networks ⭐ 1,110

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

Performer Pytorch ⭐ 777

An implementation of Performer, a linear attention-based transformer, in Pytorch

Attentiondeepmil ⭐ 727

Implementation of Attention-based Deep Multiple Instance Learning in PyTorch

Keras Attention ⭐ 656

Visualizing RNNs using the attention mechanism

Seq2seq Pytorch ⭐ 653

Sequence to Sequence Models with PyTorch

Long Range Arena ⭐ 635

Long Range Arena for Benchmarking Efficient Transformers

Tab Transformer Pytorch ⭐ 609

Implementation of TabTransformer, attention network for tabular data, in Pytorch

Transformer Tts ⭐ 599

A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"

Nlp Paper ⭐ 579

Attentiongan ⭐ 564

AttentionGAN for Unpaired Image-to-Image Translation & Multi-Domain Image-to-Image Translation

A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.

Self Attention Cv ⭐ 550

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

Text Classification Pytorch ⭐ 538

Text classification using deep learning models in Pytorch

Seq2seq ⭐ 502

Minimal Seq2Seq model with Attention for Neural Machine Translation in PyTorch

Medical Transformer ⭐ 484

Official Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation" - MICCAI 2021

Transformers.jl ⭐ 479

Julia Implementation of Transformer models

Attention Networks For Classification ⭐ 477

Hierarchical Attention Networks for Document Classification in PyTorch

PyTorch source code for "Stacked Cross Attention for Image-Text Matching" (ECCV 2018)

Bigbird ⭐ 433

Transformers for Longer Sequences

Attention_keras ⭐ 429

Keras Layer implementation of Attention for Sequential models

Dl4j Tutorials ⭐ 429

dl4j 基础教程配套视频：https://space.bilibili.com/327018681/#/

Deep learning for audio processing

Keras Text ⭐ 417

Text Classification Library in Keras

Aspect Based Sentiment Analysis ⭐ 413

💭 Aspect-Based-Sentiment-Analysis: Transformer & Explainable ML (TensorFlow)

Structured Self Attention ⭐ 412

A Structured Self-attentive Sentence Embedding

Point Transformer Pytorch ⭐ 402

Implementation of the Point Transformer layer, in Pytorch

Hierarchical Attention Networks ⭐ 396

Document classification with Hierarchical Attention Networks in TensorFlow. WARNING: project is currently unmaintained, issues will probably not be addressed.

Pytorch Original Transformer ⭐ 376

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Deep Xi: A deep learning approach to a priori SNR estimation implemented in TensorFlow 2/Keras. For speech enhancement and robust ASR.

Deep_learning_nlp ⭐ 359

Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP

PraNet: Parallel Reverse Attention Network for Polyp Segmentation, MICCAI 2020 (Oral). Code using Jittor Framework is available.

Action Recognition Visual Attention ⭐ 338

Action recognition using soft attention based deep recurrent neural networks

Mprgdeeplearninglecturenotebook ⭐ 324

Linformer Pytorch ⭐ 323

My take on a practical implementation of Linformer for Pytorch.

A PyTorch implementation of "Predict then Propagate: Graph Neural Networks meet Personalized PageRank" (ICLR 2019).

Text Classification Models Pytorch ⭐ 309

Implementation of State-of-the-art Text Classification Models in Pytorch

Transformer Tensorflow ⭐ 304

TensorFlow implementation of 'Attention Is All You Need (2017. 6)'

Keras Gat ⭐ 301

Keras implementation of the graph attention networks (GAT) by Veličković et al. (2017; https://arxiv.org/abs/1710.10903)

Attentionwalk ⭐ 299

A PyTorch Implementation of "Watch Your Step: Learning Node Embeddings via Graph Attention" (NeurIPS 2018).

Attention_is_all_you_need ⭐ 293

Transformer of "Attention Is All You Need" (Vaswani et al. 2017) by Chainer.

Deep Time Series Prediction ⭐ 287

Seq2Seq, Bert, Transformer, WaveNet for time series prediction.

Tf Keras Vis ⭐ 286

Neural network visualization toolkit for tf.keras

Slot Attention ⭐ 286

Implementation of Slot Attention from GoogleAI

Linear Attention Transformer ⭐ 278

Transformer based on a variant of attention that is linear complexity in respect to sequence length

Latex_ocr ⭐ 276

💎 数学公式识别 Math Formula OCR

Local Attention ⭐ 270

An implementation of local windowed attention for language modeling

Mtad Gat Pytorch ⭐ 265

PyTorch implementation of MTAD-GAT (Multivariate Time-Series Anomaly Detection via Graph Attention Networks) by Zhao et. al (2020, https://arxiv.org/abs/2009.02040).

Vit Explain ⭐ 260

Explainability for Vision Transformers

Dual-Stage Attention-Based Recurrent Neural Net for Time Series Prediction

📃 **Unofficial** PyTorch Implementation of DA-RNN (arXiv:1704.02971)

Pytorch Lesson Zh ⭐ 214

pytorch 包教不包会

Dl_paperreadingmeeting ⭐ 214

Deep Learning Paper Reading Meeting-Archive

Se3 Transformer Pytorch ⭐ 205

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

Implementing Vi(sion)T(transformer)

Deepviewagg ⭐ 195

[CVPR'22 Best Paper Finalist] Official PyTorch implementation of the method presented in "Learning Multi-View Aggregation In the Wild for Large-Scale 3D Semantic Segmentation"

Linformer ⭐ 194

Implementation of Linformer for Pytorch

Doc Han Att ⭐ 193

Hierarchical Attention Networks for Chinese Sentiment Classification

Sparse Structured Attention ⭐ 190

Sparse and structured neural attention mechanisms

Hey Jetson ⭐ 189

Deep Learning based Automatic Speech Recognition with attention for the Nvidia Jetson.

Guided Attention Inference Network ⭐ 187

Contains implementation of Guided Attention Inference Network (GAIN) presented in Tell Me Where to Look(CVPR 2018). This repository aims to apply GAIN on fcn8 architecture used for segmentation.

Train and visualize Hierarchical Attention Networks

Spear Tts Pytorch ⭐ 178

Implementation of Spear-TTS - multi-speaker text-to-speech attention network, in Pytorch

Sinkhorn Transformer ⭐ 178

Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention

Neat Vision ⭐ 175

Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)

Multihead Siamese Nets ⭐ 173

Implementation of Siamese Neural Networks built upon multihead attention mechanism for text semantic similarity task.

Datastories Semeval2017 Task4 ⭐ 171

Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".

Multi Scale Attention ⭐ 166

Code for our paper "Multi-scale Guided Attention for Medical Image Segmentation"

Tldr Transformers ⭐ 163

The "tl;dr" on a few notable transformer papers.

Attentions ⭐ 154

PyTorch implementation of some attentions for Deep Learning Researchers.

Fastpunct ⭐ 152

Punctuation restoration and spell correction experiments.

Reading Paper ⭐ 149

Speech2text ⭐ 148

A Deep-Learning-Based Persian Speech Recognition System

Visualization ⭐ 142

a collection of visualization function

Text_recognition_toolbox ⭐ 141

text_recognition_toolbox: The reimplementation of a series of classical scene text recognition papers with Pytorch in a uniform way.

Axial Attention ⭐ 140

Implementation of Axial attention - attending to multi-dimensional data efficiently

Llama Qrlhf ⭐ 137

Implementation of the Llama architecture with RLHF + Q-learning

Prediction Flow ⭐ 136

Deep-Learning based CTR models implemented by PyTorch

nmtpy is a Python framework based on dl4mt-tutorial to experiment with Neural Machine Translation pipelines.

PyTorch reimplementation of the paper "MaxViT: Multi-Axis Vision Transformer" [arXiv 2022].

Hierarchical Attention Network ⭐ 117

Implementation of Hierarchical Attention Networks in PyTorch

Atten_deep_mil ⭐ 117

Attention-based Deep MIL implementation and application

Abstractive Summarization ⭐ 113

Implementation of abstractive summarization using LSTM in the encoder-decoder architecture with local attention.

PyTorch code for "SOLAR: Second-Order Loss and Attention for Image Retrieval". In ECCV 2020

Pytorch Model Zoo ⭐ 108

A collection of deep learning models implemented in PyTorch

Sa Papers ⭐ 108

📄 Deep Learning 中 Sentiment Analysis 論文統整與分析 😀😡☹️😭🙄🤢

Tf2deepfloorplan ⭐ 107

TF2 Deep FloorPlan Recognition using a Multi-task Network with Room-boundary-Guided Attention. Enable tensorboard, quantization, flask, tflite, docker, github actions and google colab.

Related Searches

Python Deep Learning (13,092)

Jupyter Notebook Deep Learning (10,328)

Deep Learning Pytorch (6,767)

Deep Learning Tensorflow (5,868)

Deep Learning Neural Network (5,801)

Deep Learning Convolutional Neural Networks (4,142)

Deep Learning Neural (3,734)

Network Deep Learning (3,532)

Deep Learning Computer Vision (3,365)

Deep Learning Keras (3,258)

1-100 of 282 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.