Awesome Open Source
Awesome Open Source
Combined Topics
language-model x
Advertising 📦 10
All Projects
Application Programming Interfaces 📦 124
Applications 📦 192
Artificial Intelligence 📦 78
Blockchain 📦 73
Build Tools 📦 113
Cloud Computing 📦 80
Code Quality 📦 28
Collaboration 📦 32
Command Line Interface 📦 49
Community 📦 83
Companies 📦 60
Compilers 📦 63
Computer Science 📦 80
Configuration Management 📦 42
Content Management 📦 175
Control Flow 📦 213
Data Formats 📦 78
Data Processing 📦 276
Data Storage 📦 135
Economics 📦 64
Frameworks 📦 215
Games 📦 129
Graphics 📦 110
Hardware 📦 152
Integrated Development Environments 📦 49
Learning Resources 📦 166
Legal 📦 29
Libraries 📦 129
Lists Of Projects 📦 22
Machine Learning 📦 347
Mapping 📦 64
Marketing 📦 15
Mathematics 📦 55
Media 📦 239
Messaging 📦 98
Networking 📦 315
Operating Systems 📦 89
Operations 📦 121
Package Managers 📦 55
Programming Languages 📦 245
Runtime Environments 📦 100
Science 📦 42
Security 📦 396
Social Media 📦 27
Software Architecture 📦 72
Software Development 📦 72
Software Performance 📦 58
Software Quality 📦 133
Text Editors 📦 49
Text Processing 📦 136
User Interface 📦 330
User Interface Components 📦 514
Version Control 📦 30
Virtualization 📦 71
Web Browsers 📦 42
Web Servers 📦 26
Web User Interface 📦 210

The Top 114 Language Model Open Source Projects

Categories > Machine Learning > Language Model
Transformers ⭐ 48,997
🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.
Nlp_chinese_corpus ⭐ 6,313
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
Gpt Neo ⭐ 5,396
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
Tokenizers ⭐ 4,711
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
Bert Pytorch ⭐ 4,374
Google AI 2018 BERT pytorch implementation
Speechbrain ⭐ 2,664
A PyTorch-based Speech Toolkit
Lingvo ⭐ 2,265
Lingvo
Keras Bert ⭐ 2,202
Implementation of BERT that could load official pre-trained models for feature extraction and prediction
Haystack ⭐ 2,154
🔍 End-to-end Python framework for building natural language search interfaces to data. Leverages Transformers and the State-of-the-Art of NLP. Supports DPR, Elasticsearch, Hugging Face’s Hub, and much more!
Clue ⭐ 2,089
中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
Awesome Speech Recognition Speech Synthesis Papers ⭐ 1,936
Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)
Lazynlp ⭐ 1,934
Library to scrape and clean web pages to create massive datasets.
Awesome Sentence Embedding ⭐ 1,904
A curated list of pretrained sentence and word embedding models
Awd Lstm Lm ⭐ 1,823
LSTM and QRNN Language Model Toolkit for PyTorch
Openseq2seq ⭐ 1,409
Toolkit for efficient experimentation with Speech Recognition, Text2Speech and NLP
Pytorch Openai Transformer Lm ⭐ 1,300
🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI
Pytorch Cpp ⭐ 1,106
C++ Implementation of PyTorch Tutorials for Everyone
Nlp Library ⭐ 1,047
curated collection of papers for the nlp practitioner 📖👩‍🔬
Gpt Neox ⭐ 1,038
An implementation of model parallel GPT-3-like models on GPUs, based on the DeepSpeed library. Designed to be able to train models in the hundreds of billions of parameters or larger.
Spacy Transformers ⭐ 996
🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
Bert_language_understanding ⭐ 949
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
Spago ⭐ 944
Self-contained Machine Learning and Natural Language Processing library in Go
Chinese Electra ⭐ 934
Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）
Pykaldi ⭐ 802
A Python wrapper for Kaldi
Lm Lstm Crf ⭐ 799
Empower Sequence Labeling with Task-Aware Language Model
Lightnlp ⭐ 766
基于Pytorch和torchtext的自然语言处理深度学习框架。
Deberta ⭐ 688
The implementation of DeBERTa
Kobert ⭐ 673
Korean BERT pre-trained cased (KoBERT)
Dl Nlp Readings ⭐ 672
My Reading Lists of Deep Learning and Natural Language Processing
Keras Language Modeling ⭐ 664
📖 Some language modeling tools for Keras
Awesome Bert Nlp ⭐ 612
A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.
Albert_pytorch ⭐ 584
A Lite Bert For Self-Supervised Learning Language Representations
Ctcdecoder ⭐ 578
Connectionist Temporal Classification (CTC) decoding algorithms: best path, beam search, lexicon search, prefix search, and token passing. Implemented in Python.
Sentiment_analysis_fine_grain ⭐ 559
Multi-label Classification with BERT; Fine Grained Sentiment Analysis from AI challenger
Nlp Paper ⭐ 524
NLP Paper
Trankit ⭐ 507
Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
Neural_sp ⭐ 452
End-to-end ASR/LM implementation with PyTorch
Ctcwordbeamsearch ⭐ 431
Connectionist Temporal Classification (CTC) decoder with dictionary and language model.
Zamia Speech ⭐ 402
Open tools and data for cloudless automatic speech recognition
Tf_chatbot_seq2seq_antilm ⭐ 368
Seq2seq chatbot with attention and anti-language model to suppress generic response, option for further improve by deep reinforcement learning.
Azureml Bert ⭐ 352
End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service
Bertweet ⭐ 343
BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)
Koelectra ⭐ 339
Pretrained ELECTRA Model for Korean
Bluebert ⭐ 317
BlueBERT, pre-trained on PubMed abstracts and clinical notes (MIMIC-III).
Xlnet Pytorch ⭐ 304
An implementation of Google Brain's 2019 XLNet in PyTorch
Transfer Nlp ⭐ 287
NLP library designed for reproducible experimentation management
A Pytorch Tutorial To Sequence Labeling ⭐ 277
Empower Sequence Labeling with Task-Aware Neural Language Model | a PyTorch Tutorial to Sequence Labeling
Zeroth ⭐ 264
Kaldi-based Korean ASR (한국어 음성인식) open-source project
Macbert ⭐ 240
Revisiting Pre-trained Models for Chinese Natural Language Processing (Findings of EMNLP 2020)
Mead Baseline ⭐ 239
Deep-Learning Model Exploration and Development for NLP
Relational Rnn Pytorch ⭐ 239
An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.
Attention Mechanisms ⭐ 237
Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with TensorFlow 2.0 and Keras.
Pytorch Nce ⭐ 222
The Noise Contrastive Estimation for softmax output written in Pytorch
Kobart ⭐ 222
Korean BART
Optimus ⭐ 215
Optimus: the first large-scale pre-trained VAE language model
Xlnet_zh ⭐ 210
中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large
Gpt Scrolls ⭐ 208
A collaborative collection of open-source safe GPT-3 prompts that work well
Bert Sklearn ⭐ 205
a sklearn wrapper for Google's BERT model
Protein Sequence Embedding Iclr2019 ⭐ 204
Source code for "Learning protein sequence embeddings using information from structure" - ICLR 2019
Automatic Speech Recognition ⭐ 203
🎧 Automatic Speech Recognition: DeepSpeech & Seq2Seq (TensorFlow)
Bert As Language Model ⭐ 200
bert as language model, fork from https://github.com/google-research/bert
Nlp_learning ⭐ 198
结合python一起学习自然语言处理 (nlp): 语言模型、HMM、PCFG、Word2vec、完形填空式阅读理解任务、朴素贝叶斯分类器、TFIDF、PCA、SVD
Lotclass ⭐ 198
[EMNLP 2020] Text Classification Using Label Names Only: A Language Model Self-Training Approach
Indic Bert ⭐ 197
BERT-based Multilingual Model for Indian Languages
Backprop ⭐ 196
Backprop makes it simple to use, finetune, and deploy state-of-the-art ML models.
Char Rnn Chinese ⭐ 193
Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch. Based on code of https://github.com/karpathy/char-rnn. Support Chinese and other things.
Qagnn ⭐ 193
[NAACL 2021] QA-GNN: Question Answering using Language Models and Knowledge Graphs
Electra_pytorch ⭐ 191
Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)
Tupe ⭐ 175
Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.
Fnet Pytorch ⭐ 169
Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms
Xlnet Gen ⭐ 166
XLNet for generating language.
Keras Xlnet ⭐ 159
Implementation of XLNet that can load pretrained checkpoints
F Lm ⭐ 156
Language Modeling
Mlm Scoring ⭐ 156
Python library & examples for Masked Language Model Scoring (ACL 2020)
Transformer Lm ⭐ 155
Transformer language model (GPT-2) with sentencepiece tokenizer
Speecht ⭐ 154
An opensource speech-to-text software written in tensorflow
Kogpt2 ⭐ 154
Korean GPT-2 pretrained cased (KoGPT2)
Ld Net ⭐ 149
Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling
Bio_embeddings ⭐ 140
Get protein embeddings from protein sequences
Chars2vec ⭐ 138
Character-based word embeddings model based on RNN for handling real world texts
Kogpt2 Finetuning ⭐ 137
🔥 Korean GPT-2, KoGPT2 FineTuning cased. 한국어 가사 데이터 학습 🔥
Lm Scorer ⭐ 136
📃Language Model based sentences scoring library
Electra ⭐ 134
中文 预训练 ELECTRA 模型: 基于对抗学习 pretrain Chinese Model
Ckip Transformers ⭐ 132
CKIP Transformers
Robbert ⭐ 131
A Dutch RoBERTa-based language model
Nezha_chinese_pytorch ⭐ 130
NEZHA: Neural Contextualized Representation for Chinese Language Understanding
Dynamic Memory Networks Plus Pytorch ⭐ 122
Implementation of Dynamic memory networks plus in Pytorch
Getlang ⭐ 118
Natural language detection package in pure Go
Lingo ⭐ 117
package lingo provides the data structures and algorithms required for natural language processing
Easy Bert ⭐ 117
A Dead Simple BERT API for Python and Java (https://github.com/google-research/bert)
Keras Gpt 2 ⭐ 114
Load GPT-2 checkpoint and generate texts
Autoprompt ⭐ 110
AutoPrompt: Automatic Prompt Construction for Masked Language Models.
Pytorch_gbw_lm ⭐ 103
PyTorch Language Model for 1-Billion Word (LM1B / GBW) Dataset
Pyclue ⭐ 103
Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark
Tner ⭐ 95
Language model finetuning on NER with an easy interface, and cross-domain evaluation. We released NER models finetuned on various domain via huggingface model hub.
Tongrams ⭐ 93
A C++ library providing fast language model queries in compressed space.
Greek Bert ⭐ 92
A Greek edition of BERT pre-trained language model
Tf Transformers ⭐ 91
State of the art faster Natural Language Processing in Tensorflow 2.0 .
Bit Rnn ⭐ 89
Quantize weights and activations in Recurrent Neural Networks.
Text Gan Tensorflow ⭐ 89
TensorFlow GAN implementation using Gumbel Softmax
1-100 of 114 projects
Advertising 📦 10
All Projects
Application Programming Interfaces 📦 124
Applications 📦 192
Artificial Intelligence 📦 78
Blockchain 📦 73
Build Tools 📦 113
Cloud Computing 📦 80
Code Quality 📦 28
Collaboration 📦 32
Command Line Interface 📦 49
Community 📦 83
Companies 📦 60
Compilers 📦 63
Computer Science 📦 80
Configuration Management 📦 42
Content Management 📦 175
Control Flow 📦 213
Data Formats 📦 78
Data Processing 📦 276
Data Storage 📦 135
Economics 📦 64
Frameworks 📦 215
Games 📦 129
Graphics 📦 110
Hardware 📦 152
Integrated Development Environments 📦 49
Learning Resources 📦 166
Legal 📦 29
Libraries 📦 129
Lists Of Projects 📦 22
Machine Learning 📦 347
Mapping 📦 64
Marketing 📦 15
Mathematics 📦 55
Media 📦 239
Messaging 📦 98
Networking 📦 315
Operating Systems 📦 89
Operations 📦 121
Package Managers 📦 55
Programming Languages 📦 245
Runtime Environments 📦 100
Science 📦 42
Security 📦 396
Social Media 📦 27
Software Architecture 📦 72
Software Development 📦 72
Software Performance 📦 58
Software Quality 📦 133
Text Editors 📦 49
Text Processing 📦 136
User Interface 📦 330
User Interface Components 📦 514
Version Control 📦 30
Virtualization 📦 71
Web Browsers 📦 42
Web Servers 📦 26
Web User Interface 📦 210