Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Self Attention Open Source Projects

Open source projects categorized as Self Attention
Categories > Self Attention
Leedl Tutorial ⭐ 8,682
《李宏毅深度学习教程》，PDF下载地址：https://github.com/datawhalech
most recent commit 3 months ago
Informer2020 ⭐ 4,553
The GitHub repository for the paper "Informer" accepted by AAAI 2021.
most recent commit 3 months ago
Awesome Transformer Attention ⭐ 3,895
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
most recent commit 3 months ago
Gat ⭐ 2,078
Graph Attention Networks (https://arxiv.org/abs/1710.10903)
most recent commit 3 years ago
Codesearchnet ⭐ 2,054
Datasets, tools, and benchmarks for representation learning of code.
most recent commit 2 years ago
Pytorch Gat ⭐ 1,815
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
most recent commit a year ago
Pygat ⭐ 1,684
Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
most recent commit 3 years ago
Deberta ⭐ 1,673
The implementation of DeBERTa
total releases 13most recent commit 7 months ago
Transformer In Vision ⭐ 1,220
Recent Transformer-based CV and related works.
most recent commit 8 months ago
Ccnet ⭐ 1,061
CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).
most recent commit 3 years ago
Bert_language_understanding ⭐ 886
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
most recent commit 5 years ago
Awesome Fast Attention ⭐ 717
list of efficient attention modules
most recent commit 3 years ago
Speech Transformer ⭐ 714
A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.
most recent commit a year ago
How Do Vits Work ⭐ 571
(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"
most recent commit 2 years ago
Self Attention Cv ⭐ 550
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
total releases 5most recent commit 3 years ago
Fastervit ⭐ 539
[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention
total releases 19most recent commit 3 months ago
Text Classification Pytorch ⭐ 538
Text classification using deep learning models in Pytorch
most recent commit 5 years ago
Transformer ⭐ 505
A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"
most recent commit 4 years ago
Structured Self Attention ⭐ 412
A Structured Self-attentive Sentence Embedding
most recent commit 5 years ago
Graph Transformer ⭐ 408
Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)
most recent commit 2 years ago
Gcvit ⭐ 399
[ICML 2023] Official PyTorch implementation of Global Context Vision Transformers
most recent commit 4 months ago
Fan ⭐ 389
Official PyTorch implementation of Fully Attentional Networks
most recent commit 2 years ago
Deep_learning_nlp ⭐ 359
Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP
most recent commit 4 years ago
The 9 Latest Releases In Self Attention Open Source Projects
Gcvit Tf ⭐ 20
Tensorflow 2.0 Implementation of GCViT: Global Context Vision Transformer
total releases 16latest release October 16, 2023most recent commit 4 months ago
Perceiver Io ⭐ 110
Unofficial implementation of Perceiver IO
total releases 5latest release June 20, 2022most recent commit 2 years ago
Transformer Physx ⭐ 40
Transformers for modeling physical systems
total releases 8latest release October 28, 2021most recent commit 2 years ago
Deberta ⭐ 1,673
The implementation of DeBERTa
total releases 13latest release February 09, 2021most recent commit 7 months ago
Global Self Attention Network ⭐ 49
A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks
dependent packages 1total releases 7latest release November 21, 2020most recent commit 3 years agopypi gsa-pytorch} Downloads
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.