Awesome Open Source

Programming Languages

Search results for transformer architecture

transformer-architecture x

67 search results found

Vall E X ⭐ 6,055

An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io

Awesome Transformer Attention ⭐ 3,895

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

Llama2.mojo ⭐ 1,723

Inference Llama 2 in one file of pure 🔥

Spago ⭐ 1,691

Self-contained Machine Learning and Natural Language Processing library in Go

Sockeye ⭐ 1,190

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

Code for CRATE (Coding RAte reduction TransformEr).

Joeynmt ⭐ 647

Minimalist NMT for educational purposes

CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation

Illumination Adaptive Transformer ⭐ 359

[BMVC 2022] You Only Need 90K Parameters to Adapt Light: A Light Weight Transformer for Image Enhancement and Exposure Correction. SOTA for low light enhancement, 0.004 seconds try this for pre-processing.

[ECCV 2022] Official repository for "MaxViT: Multi-Axis Vision Transformer". SOTA foundation models for classification, detection, segmentation, image quality, and generative modeling...

Changeformer ⭐ 335

[IGARSS'22]: A Transformer-Based Siamese Network for Change Detection

Multimodalmamba ⭐ 321

A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.

Deep Learning Specialization Coursera ⭐ 266

This repo contains the updated version of all the assignments/labs (done by me) of Deep Learning Specialization on Coursera by Andrew Ng. It includes building various deep learning models from scratch and implementing them for object detection, facial recognition, autonomous driving, neural machine translation, trigger word detection, etc.

Seqformer ⭐ 255

SeqFormer: Sequential Transformer for Video Instance Segmentation (ECCV 2022 Oral)

Multigraph_transformer ⭐ 232

accepted by IEEE TNNLS, transformer, multi-graph transformer, graph, graph classification, sketch recognition, sketch classification, free-hand sketch, official code of the paper "Multi-Graph Transformer for Free-Hand Sketch Recognition"

Et Bert ⭐ 219

The repository of ET-BERT, a network traffic classification model on encrypted traffic. The work has been accepted as The Web Conference (WWW) 2022 accepted paper.

Simple State-of-the-Art BERT-Based Sentence Classification with Keras / TensorFlow 2. Built with HuggingFace's Transformers.

Seq2seqsharp ⭐ 188

Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, x86, x64, ARM), multimodal model for text and images and so on.

Pycontinual ⭐ 185

PyContinual (An Easy and Extendible Framework for Continual Learning)

A Pytorch Tutorial To Transformers ⭐ 175

Attention Is All You Need | a PyTorch Tutorial to Transformers

Transmef ⭐ 106

Official PyTorch implementation of our AAAI22 paper: TransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework via Self-Supervised Multi-Task Learning.

Pytorch Psetae ⭐ 98

PyTorch implementation of the model presented in "Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention"

Textaugmentation Gpt2 ⭐ 85

Fine-tuned pre-trained GPT2 for custom topic specific text generation. Such system can be used for Text Augmentation.

Mmwave Gesture Recognition ⭐ 73

Basic Gesture Recognition Using mmWave Sensor - TI AWR1642

Swin Transformer Pytorch ⭐ 71

Implementation of the Swin Transformer in PyTorch.

Ba Transformer ⭐ 58

[MICCAI 2021] Boundary-aware Transformers for Skin Lesion Segmentation

Egt_pytorch ⭐ 58

Edge-Augmented Graph Transformer

Continuallm ⭐ 55

An Extensible Continual Learning Framework Focused on Language Models (LMs)

Transformers4vision ⭐ 54

A summarization of Transformer-based architectures for CV tasks, including image classification, object detection, segmentation, and Few-shot Learning. Keep updated frequently.

[AAAI 2023 Oral] VLTinT: Visual-Linguistic Transformer-in-Transformer for Coherent Video Paragraph Captioning

Particle_transformer ⭐ 44

Official implementation of "Particle Transformer for Jet Tagging".

Algorithm Of Thoughts ⭐ 44

My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"

Official PyTorch implementation of our ECCV 2022 paper "Sliced Recursive Transformer"

Sigir2021_conure ⭐ 39

One Person, One Model, One World: Learning Continual User Representation without Forgetting

Tit_open_source ⭐ 35

The official implementation of "Transformer in Transformer as Backbone for Deep Reinforcement Learning"

Time Enriched Multimodal Depression Detection ⭐ 25

Official source code for the paper: "It’s Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformers"

Queryotr ⭐ 24

[ECCV2022] Official PyTorch implementation of the paper "Outpainting by Queries"

Traffic Speed Prediction ⭐ 23

Using to predict the highway traffic speed

Numpy Transformer ⭐ 21

A numpy implementation of the Transformer model in "Attention is All You Need"

Seq2seq Type Inference using Static Analysis and CodeT5

Aggforecaster ⭐ 18

Code for "Coherent Probabilistic Aggregate Queries on Long-horizon Forecasts", IJCAI 2022

CASPR is a deep learning framework applying transformer architecture to learn and predict from tabular data at scale.

Multimodal Transformer ⭐ 17

Attention Based Multi-modal Emotion Recognition; Stanford Emotional Narratives Dataset

G2p_seq2seq_pytorch ⭐ 16

Grapheme to phoneme model for PyTorch

Ost Opensourcetransformers ⭐ 15

OST Collection: An AI-powered suite of models that predict the next word matches with remarkable accuracy (Text Generative Models). OST Collection is based on a novel approach to work as a full and intelligent NLP Model.

This is the official source code of "BiCAT: Self-Knowledge Distillation with Bidirectional Chronological Augmentation of Transformer for Sequential Recommendation" based on TensorFlow.

Coeditor ⭐ 15

Leveraging Contextual Changes for Multi-round Code Auto-editing

Human Scene Transformer ⭐ 14

Human Scene Transformer: A framework for trajectory prediction and wrappers for reframing the JRDB dataset for the prediction task.

Perceive Transform And Act ⭐ 14

PyTorch code for the paper: "Perceive, Transform, and Act: Multi-Modal Attention Networks for Vision-and-Language Navigation"

Point Transformer ⭐ 13

This is the official repository of the original Point Transformer architecture.

Nas_transformer ⭐ 12

Evolutionary Neural Architecture Search on Transformers for RUL Prediction

Personal Accepted Research ⭐ 12

Welcome to quote our published papers, and the codes have been uploaded.

official implementation of the paper: Towards End-to-End Generative Modeling of Long Videos with Memory-Efficient Bidirectional Transformers (CVPR 2023)

Minimalgpt ⭐ 11

MinimalGPT is a concise, adaptable, and streamlined code framework that encompasses the essential components necessary for the construction, training, inference, and fine-tuning of the GPT model. This framework is implemented exclusively using Keras and TensorFlow, ensuring compatibility and coherence within the broader deep learning ecosystem.

Transantivirus ⭐ 10

Transformer-based molecular generative model for antiviral drug design

Shuttlenet ⭐ 10

Official Implementation for ShuttleNet: Position-aware Fusion of Rally Progress and Player Styles for Stroke Forecasting in Badminton (AAAI'22)

Autoregressive_inference ⭐ 10

Code for "Discovering Non-monotonic Autoregressive Orderings with Variational Inference" (paper and code updated from ICLR 2021)

Linkorgs Software ⭐ 9

LinkOrgs: An R package for linking linking records on organizations using half-a-billion open-collaborated records from LinkedIn

Multistepretrosynthesisttl ⭐ 8

Multi-Step Retrosynthesis Tool based on Augmented Disconnection Aware Triple Transformer Loop Predictions

Official repository for the paper "Salient Mask-Guided Vision Transformer for Fine-Grained Classification" (VISIGRAPP '23)

Sota Vision ⭐ 8

Implementation of various state of the art architectures used in computer vision.

Makespeare ⭐ 7

Repository for a transformer I coded from scratch and trained on the tiny-shakespeare dataset.

Language2motion ⭐ 7

The goal of this project is to create multi-modal implementation of Transformer architecture in Swift.

Deep Natural Language Processing ⭐ 5

Curated implementation notebooks and scripts of deep learning based natural language processing tasks and challenges in TensorFlow.

Transformer Tf ⭐ 5

This repository contains the code for the paper "Attention Is All You Need" i.e The Transformer.

Socialmedia App ⭐ 5

Full Stack Social Media App with Nuxt 3, TailwindCSS , Prisma, Auth using JWT.

1-67 of 67 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.