Awesome Open Source
Awesome Open Source
Combined Topics
python x
transformer x
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194

The Top 862 Python Transformer Open Source Projects on Github

Transformers ⭐ 53,092
🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.
Trax ⭐ 6,530
Trax — Deep Learning with Clear Code and Speed
Vit Pytorch ⭐ 5,896
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
Gpt Neo ⭐ 5,726
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
Jukebox ⭐ 4,560
Code for the paper "Jukebox: A Generative Model for Music"
Bert Pytorch ⭐ 4,189
Google AI 2018 BERT pytorch implementation
Gpt2 Chinese ⭐ 4,137
Chinese version of GPT2 training code, using BERT tokenizer.
Deep Daze ⭐ 3,797
Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
Transformer ⭐ 3,558
A TensorFlow Implementation of the Transformer: Attention Is All You Need
Dalle Pytorch ⭐ 3,479
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
Speechbrain ⭐ 3,190
A PyTorch-based Speech Toolkit
Bertviz ⭐ 3,187
Tool for visualizing attention in the Transformer model (BERT, GPT-2, Albert, XLNet, RoBERTa, CTRL, etc.)
Simpletransformers ⭐ 2,759
Transformers for Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
Nlp Architect ⭐ 2,729
A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks
Mmsegmentation ⭐ 2,532
OpenMMLab Semantic Segmentation Toolbox and Benchmark.
Clue ⭐ 2,276
中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
Paddlenlp ⭐ 2,218
An NLP library with Awesome pre-trained Transformer models and easy-to-use interface, supporting wide-range of NLP tasks from research to industrial applications.
Hrnet Semantic Segmentation ⭐ 2,143
The OCR approach is rephrased as Segmentation Transformer: https://arxiv.org/abs/1909.11065. This is an official implementation of semantic segmentation for HRNet. https://arxiv.org/abs/1908.07919
Mmocr ⭐ 1,748
OpenMMLab Text Detection, Recognition and Understanding Toolbox
Fast Bert ⭐ 1,654
Super easy library for BERT based NLP models
Cv Backbones ⭐ 1,636
CV backbones including GhostNet, TinyNet and TNT, developed by Huawei Noah's Ark Lab.
Reformer Pytorch ⭐ 1,577
Reformer, the efficient Transformer, in Pytorch
Bertopic ⭐ 1,510
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
Deepspeech ⭐ 1,464
A Speech Toolkit based on PaddlePaddle.
Dialogpt ⭐ 1,430
Large-scale pretraining for dialogue
Jiant ⭐ 1,341
jiant is an nlp toolkit
Gpt2 Chitchat ⭐ 1,333
GPT2 for Chinese chitchat/用于中文闲聊的GPT2模型(实现了DialoGPT的MMI思想)
Mleap ⭐ 1,304
MLeap: Deploy ML Pipelines to Production
Gpt Neox ⭐ 1,206
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
Transgan ⭐ 1,186
[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang
Pytorch Openai Transformer Lm ⭐ 1,182
🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI
X Transformers ⭐ 1,149
A simple but complete full-attention transformer with a set of promising experimental features from various papers
Keras Textclassification ⭐ 1,098
中文长文本分类、短句子分类、多标签分类、两句子相似度（Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short），字词句向量嵌入层（embeddings）和网络层（graph）构建基类，FastText，TextCNN，CharCNN，TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, 胶囊网络-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN
Sockeye ⭐ 1,022
Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet
Tsai ⭐ 889
Time series Timeseries Deep Learning Machine Learning Pytorch fastai | State-of-the-art Deep Learning library for Time Series and Sequences in Pytorch / fastai
Pvt ⭐ 872
Bert Keras ⭐ 802
Keras implementation of BERT with pre-trained weights
Gansformer ⭐ 756
Generative Adversarial Transformers
Flow Forecast ⭐ 737
Deep learning PyTorch library for time series forecasting, classification, and anomaly detection (originally for flood forecasting).
Performer Pytorch ⭐ 722
An implementation of Performer, a linear attention-based transformer, in Pytorch
Awesome Fast Attention ⭐ 717
list of efficient attention modules
Contextualized Topic Models ⭐ 688
A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021.
Graph2vec ⭐ 686
A parallel implementation of "graph2vec: Learning Distributed Representations of Graphs" (MLGWorkshop 2017).
Rasa_chatbot_cn ⭐ 677
building a chinese dialogue system based on the newest version of rasa(基于最新版本rasa搭建的对话系统)
Bert For Tf2 ⭐ 665
A Keras TensorFlow 2.0 implementation of BERT, ALBERT and adapter-BERT.
Athena ⭐ 626
an open-source implementation of sequence-to-sequence based speech processing engine
This Word Does Not Exist ⭐ 619
This Word Does Not Exist
Adapter Transformers ⭐ 590
Huggingface Transformers + Adapters = ❤️
Image To Latex ⭐ 578
Convert images of LaTex math equations into LaTex code.
Yolov5 Lite ⭐ 565
🍅🍅🍅YOLOv5-Lite: lighter, faster and easier to deploy. Evolved from yolov5 and the size of model is only 1.7M (int8) and 3.3M (fp16). It can reach 10+ FPS on the Raspberry Pi 4B when the input size is 320×320~
Openprompt ⭐ 563
An Open-Source Toolkit for Prompt-Learning.
Former ⭐ 556
Simple transformer implementation from scratch in pytorch.
Self Attention Cv ⭐ 550
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
Swinir ⭐ 550
SwinIR: Image Restoration Using Swin Transformer
Cogview ⭐ 528
Text-to-Image generation
Bottleneck Transformer Pytorch ⭐ 523
Implementation of Bottleneck Transformer in Pytorch
Nmt Keras ⭐ 514
Neural Machine Translation with Keras
Segformer ⭐ 510
Official implementation of "SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers"
Bert Multi Label Text Classification ⭐ 509
This repo contains a PyTorch implementation of a pretrained BERT model for multi-label text classification.
Nlp Tutorials ⭐ 504
Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com
Graphormer ⭐ 492
This is the official implementation for "Do Transformers Really Perform Bad for Graph Representation?".
Joeynmt ⭐ 484
Minimalist NMT for educational purposes
Vistr ⭐ 471
[CVPR2021 Oral] End-to-End Video Instance Segmentation with Transformers
Gector ⭐ 469
Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)
Transformers Interpret ⭐ 468
Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.
Neural_sp ⭐ 466
End-to-end ASR/LM implementation with PyTorch
Latex Ocr ⭐ 454
pix2tex: Using a ViT to convert images of equations into LaTeX code.
Parser ⭐ 446
State-of-the-art Dependency, Constituency and Semantic Dependency Parsers, with pretrained models for more than 19 languages.
Seq2seqchatbots ⭐ 433
A wrapper around tensor2tensor to flexibly train, interact, and generate data for neural chatbots.
Omninet ⭐ 426
Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain
Graphwaveletneuralnetwork ⭐ 426
A PyTorch implementation of "Graph Wavelet Neural Network" (ICLR 2019)
Torchdistill ⭐ 425
A coding-free framework built on PyTorch for reproducible deep learning studies. 🏆20 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemented so far. 🎁 Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
Uniter ⭐ 418
Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
Cdqa ⭐ 418
⛔ [NOT MAINTAINED] An End-To-End Closed Domain Question Answering System.
Pyhgt ⭐ 412
Code for "Heterogeneous Graph Transformer" (WWW'20), which is based on pytorch_geometric
Speech Transformer ⭐ 406
A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.
Nlp Interview Notes ⭐ 395
本项目是作者们根据个人面试和经验总结出的自然语言处理(NLP)面试准备的学习笔记与资料，该资料目前包含 自然语言处理各领域的 面试题积累。
Transformer Tts ⭐ 390
A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"
Deep Ctr Prediction ⭐ 389
CTR prediction models based on deep learning(基于深度学习的广告推荐CTR预估模型)
Vedastr ⭐ 389
A scene text recognition toolbox based on PyTorch
Koelectra ⭐ 386
Pretrained ELECTRA Model for Korean
Vectorhub ⭐ 380
Vector Hub - Library for easy discovery, and consumption of State-of-the-art models to turn data into vectors. (text2vec, image2vec, video2vec, graph2vec, bert, inception, etc)
Medical Transformer ⭐ 377
Official Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation" - MICCAI 2021
Pytorch Original Transformer ⭐ 376
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
Nlu ⭐ 368
1 line for thousands of State of The Art NLP models in hundreds of languages The fastest and most accurate way to solve text problems.
Deepsvg ⭐ 368
Official code for the paper "DeepSVG: A Hierarchical Generative Network for Vector Graphics Animation". Includes a PyTorch library for deep learning with SVG data.
Bertweet ⭐ 365
BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)
Lightning Transformers ⭐ 362
Flexible interface for high-performance research using SOTA Transformers leveraging Pytorch Lightning, Transformers, and Hydra.
Allrank ⭐ 354
allRank is a framework for training learning-to-rank neural models based on PyTorch.
Gpt2client ⭐ 341
✍🏻 gpt2-client: Easy-to-use TensorFlow Wrapper for GPT-2 117M, 345M, 774M, and 1.5B Transformer Models 🤖 📝
Nncf ⭐ 339
Neural Network Compression Framework for enhanced OpenVINO™ inference
Long Range Arena ⭐ 335
Long Range Arena for Benchmarking Efficient Transformers
Rezero ⭐ 326
Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"
Transformer Pointer Generator ⭐ 314
A Abstractive Summarization Implementation with Transformer and Pointer-generator
Text Classification Models Pytorch ⭐ 309
Implementation of State-of-the-art Text Classification Models in Pytorch
Keras Transformer ⭐ 305
Transformer implemented in Keras
Remi ⭐ 305
"Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions", ACM Multimedia 2020
Transformer Tensorflow ⭐ 304
TensorFlow implementation of 'Attention Is All You Need (2017. 6)'
Jointbert ⭐ 303
Pytorch implementation of JointBERT: "BERT for Joint Intent Classification and Slot Filling"
Abstractive Summarization With Transfer Learning ⭐ 301
Abstractive summarisation using Bert as encoder and Transformer Decoder
1-100 of 862 projects

Related Projects

Python Python3 Projects (27,710)
Python Machine Learning Projects (14,523)
Python Deep Learning Projects (12,124)
Python Jupyter Notebook Projects (10,428)
Python Django Projects (10,393)
Python Tensorflow Projects (8,302)
Python Pytorch Projects (8,107)
Python Flask Projects (7,613)
Javascript Python Projects (5,788)
Python Data Science Projects (4,215)
Python Neural Network Projects (4,136)
Python Api Projects (4,086)
Python Nlp Projects (4,065)
Python Computer Vision Projects (3,997)
Python Keras Projects (3,652)
Python Hacktoberfest Projects (3,499)
Python Discord Projects (2,882)
Python Linux Projects (2,854)
Python Jupyter Notebook Machine Learning Projects (2,831)
Python Pandas Projects (2,785)
Python Algorithms Projects (2,731)
Python Cli Projects (2,729)
Python Raspberry Pi Projects (2,682)
Python Deep Learning Pytorch Projects (2,623)
Python Deep Learning Tensorflow Projects (2,614)
Python Numpy Projects (2,604)
Python Artificial Intelligence Projects (2,459)
Python Java Projects (2,429)
Python Css Projects (2,348)
Python Natural Language Processing Projects (2,334)
Python Aws Projects (2,331)
Python C Projects (1,963)
Python Telegram Projects (1,941)
Python Machine Learning Data Science Projects (1,923)
Python Security Projects (1,904)
Python Machine Learning Tensorflow Projects (1,852)
Python C Plus Plus Projects (1,765)
Python Deep Learning Neural Network Projects (1,716)
Python Deep Learning Computer Vision Projects (1,696)
Python Selenium Projects (1,695)
Python Matplotlib Projects (1,654)
Python Data Analysis Projects (1,634)
Python Tensorflow Keras Projects (1,630)
Python Tkinter Projects (1,624)
Python Machine Learning Neural Network Projects (1,611)
Python Database Projects (1,556)
Python Asyncio Projects (1,554)
Python Shell Projects (1,532)
Python Object Detection Projects (1,530)
Python Postgresql Projects (1,516)
Python Json Projects (1,515)
Python Deep Neural Networks Projects (1,490)
Python Visualization Projects (1,472)
Python Gui Projects (1,429)
Python Crawler Projects (1,421)
Python Deep Learning Keras Projects (1,417)
Python Ansible Projects (1,410)
Python Scikit Learn Projects (1,385)
Python Jupyter Notebook Data Science Projects (1,353)
Python Reactjs Projects (1,335)
Python Rest Api Projects (1,321)
Python Mysql Projects (1,313)
Python Data Visualization Projects (1,311)
Python Jupyter Notebook Deep Learning Projects (1,304)
Python Tutorial Projects (1,292)
Python Sql Projects (1,281)
Python Machine Learning Pytorch Projects (1,231)
Python Data Structures Projects (1,205)
Python Windows Projects (1,200)
Python Jupyter Notebook Pandas Projects (1,143)
Python Tool Projects (1,139)
Python Iot Projects (1,109)
Python Lstm Projects (1,102)
Python Requests Projects (1,054)
Python Android Projects (1,045)
Python Machine Learning Algorithms Projects (1,042)
Python Web Projects (1,033)
Python Jupyter Projects (1,031)
Python Open Source Projects (1,023)
Python Machine Learning Computer Vision Projects (1,004)
Python Github Projects (999)
Python R Projects (996)
Python Statistics Projects (990)
Python Hacking Projects (968)
Python Tensorflow Neural Network Projects (960)
Python Face Recognition Projects (941)
Python Machine Learning Scikit Learn Projects (891)
Python Sklearn Projects (880)
Python Graph Projects (866)
Python Machine Learning Keras Projects (865)
Python Pandas Numpy Projects (854)
Python Testing Projects (839)
Python Fastapi Projects (814)
Python Face Detection Projects (811)
Python Machine Learning Deep Projects (15)
Python Machine Learning Deep Tensorflow Projects (5)
Python Machine Learning Deep Neural Network Projects (3)
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.

All non readme contents or Github based topics or project metadata copyright Awesome Open Source 2018-2021