Awesome Open Source
Awesome Open Source
Combined Topics
language-model x

The Top 1,063 Language Model Open Source Projects

Categories > Machine Learning > Language Model
Transformers ⭐ 70,872
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
dependent packages 911total releases 91most recent commit 13 hours agopypi transformers} Downloads
Nlp_chinese_corpus ⭐ 7,283
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
most recent commit 5 days ago
Unilm ⭐ 6,706
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
most recent commit 3 days ago
Gpt Neo ⭐ 6,412
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
most recent commit 7 months ago
Introduction_to_ml_with_python ⭐ 6,273
Notebooks and code for the book "Introduction to Machine Learning with Python"
total releases 10most recent commit a month ago
Tokenizers ⭐ 5,900
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
dependent packages 131total releases 72most recent commit 4 days agopypi tokenizers} Downloads
Haystack ⭐ 5,504
🔍 Haystack is an open source NLP framework that leverages pre-trained Transformer models. It enables developers to quickly implement production-ready semantic search, question answering, summarization and document ranking for a wide range of NLP applications.
dependent packages 2total releases 29most recent commit 2 days agopypi farm-haystack} Downloads
Nemo ⭐ 4,784
NeMo: a toolkit for conversational AI
dependent packages 5total releases 58most recent commit 17 hours agopypi nemo-toolkit} Downloads
Speechbrain ⭐ 4,605
A PyTorch-based Speech Toolkit
most recent commit 3 days ago
Bert Pytorch ⭐ 4,189
Google AI 2018 BERT pytorch implementation
total releases 5most recent commit a year ago
Clue ⭐ 2,861
中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
most recent commit 15 hours ago
Lingvo ⭐ 2,608
Lingvo
most recent commit 2 days ago
Xlm ⭐ 2,551
PyTorch original implementation of Cross-lingual Language Model Pretraining.
most recent commit 8 months ago
Gpt Neox ⭐ 2,492
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
most recent commit 14 hours ago
Pretrained Language Model ⭐ 2,452
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
most recent commit 9 days ago
Awesome Speech Recognition Speech Synthesis Papers ⭐ 2,350
Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)
most recent commit 3 days ago
Keras Bert ⭐ 2,281
Implementation of BERT that could load official pre-trained models for feature extraction and prediction
dependent packages 13total releases 98most recent commit 8 months agopypi keras-bert} Downloads
Lazynlp ⭐ 1,867
Library to scrape and clean web pages to create massive datasets.
most recent commit 2 years ago
Open_clip ⭐ 1,859
An open source implementation of CLIP.
dependent packages 1total releases 7most recent commit 20 hours agopypi open-clip-torch} Downloads
Awd Lstm Lm ⭐ 1,838
LSTM and QRNN Language Model Toolkit for PyTorch
most recent commit 7 months ago
Awesome Sentence Embedding ⭐ 1,831
A curated list of pretrained sentence and word embedding models
most recent commit a year ago
Farm ⭐ 1,570
🏡 Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
total releases 2most recent commit a month ago
Openseq2seq ⭐ 1,393
Toolkit for efficient experimentation with Speech Recognition, Text2Speech and NLP
most recent commit a year ago
Argos Translate ⭐ 1,390
Open-source offline translation library written in Python
dependent packages 10total releases 20most recent commit 15 hours agopypi argostranslate} Downloads
Pytorch Cpp ⭐ 1,368
C++ Implementation of PyTorch Tutorials for Everyone
most recent commit 2 months ago
Ecco ⭐ 1,284
Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
dependent packages 1total releases 18most recent commit 8 months agopypi ecco} Downloads
Spago ⭐ 1,237
Self-contained Machine Learning and Natural Language Processing library in Go
dependent packages 1total releases 32most recent commit 8 days ago
Pytorch Openai Transformer Lm ⭐ 1,182
🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI
most recent commit 4 years ago
Spacy Transformers ⭐ 1,144
🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
dependent packages 6total releases 4most recent commit a month ago
Codegen ⭐ 1,141
CodeGen is an open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.
most recent commit 25 days ago
Chinese Electra ⭐ 1,100
Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）
most recent commit 6 months ago
Nlp Library ⭐ 955
curated collection of papers for the nlp practitioner 📖👩‍🔬
most recent commit 2 years ago
Kobert ⭐ 930
Korean BERT pre-trained cased (KoBERT)
most recent commit 2 months ago
Deberta ⭐ 900
The implementation of DeBERTa
total releases 13most recent commit 6 months ago
Pykaldi ⭐ 899
A Python wrapper for Kaldi
dependent packages 1total releases 1most recent commit 8 days agopypi PyKaldi} Downloads
Bert_language_understanding ⭐ 886
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
most recent commit 4 years ago
Lm Lstm Crf ⭐ 830
Empower Sequence Labeling with Task-Aware Language Model
most recent commit 3 months ago
Finbert ⭐ 822
Financial Sentiment Analysis with BERT
most recent commit 17 days ago
Lstm Char Cnn ⭐ 812
LSTM language model with CNN over characters
most recent commit 6 years ago
Dl Nlp Readings ⭐ 752
My Reading Lists of Deep Learning and Natural Language Processing
most recent commit 5 months ago
Lightnlp ⭐ 725
基于Pytorch和torchtext的自然语言处理深度学习框架。
total releases 17most recent commit 2 years ago
Awesome Bert Nlp ⭐ 703
A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.
most recent commit 2 months ago
Keras Language Modeling ⭐ 673
📖 Some language modeling tools for Keras
most recent commit 5 years ago
Rwkv Lm ⭐ 644
RWKV is a RNN with transformer-level performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
most recent commit 4 days ago
Transformers4rec ⭐ 634
Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.
total releases 9most recent commit 2 days ago
Trankit ⭐ 581
Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
dependent packages 1total releases 20most recent commit 6 months agopypi trankit} Downloads
Ctcdecoder ⭐ 577
Connectionist Temporal Classification (CTC) decoding algorithms: best path, beam search, lexicon search, prefix search, and token passing. Implemented in Python.
most recent commit a year ago
Lm Bff ⭐ 550
ACL'2021: LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723
most recent commit a month ago
Sentiment_analysis_fine_grain ⭐ 504
Multi-label Classification with BERT; Fine Grained Sentiment Analysis from AI challenger
most recent commit 4 years ago
Neural_sp ⭐ 466
End-to-end ASR/LM implementation with PyTorch
most recent commit a year ago
Phobert ⭐ 461
PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)
most recent commit 2 months ago
Ctcwordbeamsearch ⭐ 453
Connectionist Temporal Classification (CTC) decoder with dictionary and language model.
most recent commit 9 months ago
Koelectra ⭐ 448
Pretrained ELECTRA Model for Korean
most recent commit 6 months ago
Bertweet ⭐ 447
BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)
most recent commit 4 months ago
Albert_pytorch ⭐ 423
A Lite Bert For Self-Supervised Learning Language Representations
most recent commit 2 years ago
Zamia Speech ⭐ 413
Open tools and data for cloudless automatic speech recognition
most recent commit a year ago
Pynlpl ⭐ 406
PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP spec
dependent packages 3total releases 102most recent commit 4 years agopypi PyNLPl} Downloads
Codet5 ⭐ 402
Code for CodeT5: a new code-aware pre-trained encoder-decoder model.
most recent commit 3 months ago
Bluebert ⭐ 386
BlueBERT, pre-trained on PubMed abstracts and clinical notes (MIMIC-III).
most recent commit 5 months ago
Kogpt2 ⭐ 382
Korean GPT-2 pretrained cased (KoGPT2)
most recent commit 6 days ago
Nlp Paper ⭐ 381
NLP Paper
most recent commit 2 years ago
Tf_chatbot_seq2seq_antilm ⭐ 373
Seq2seq chatbot with attention and anti-language model to suppress generic response, option for further improve by deep reinforcement learning.
most recent commit 6 years ago
Adaptnlp ⭐ 371
An easy to use Natural Language Processing library and framework for predicting, training, fine-tuning, and serving up state-of-the-art NLP models.
total releases 23most recent commit 10 months ago
Adaptive Softmax ⭐ 368
Implements an efficient softmax approximation as described in the paper "Efficient softmax approximation for GPUs" (http://arxiv.org/abs/1609.04309)
most recent commit 4 years ago
Macbert ⭐ 357
Revisiting Pre-trained Models for Chinese Natural Language Processing (Findings of EMNLP 2020)
most recent commit 5 months ago
Azureml Bert ⭐ 354
End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service
most recent commit 10 months ago
Trl ⭐ 354
Train transformer language models with reinforcement learning.
total releases 4most recent commit 4 months ago
Treasure Of Transformers ⭐ 345
💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️
most recent commit 2 months ago
Kobart ⭐ 320
Korean BART
most recent commit 4 months ago
Happy Transformer ⭐ 315
A package built on top of Hugging Face's transformers library that makes it easy to utilize state-of-the-art NLP models
dependent packages 1total releases 22most recent commit a month agopypi happytransformer} Downloads
Deep Generative Models For Natural Language Processing ⭐ 308
DGMs for NLP. A roadmap.
most recent commit 2 months ago
Ckip Transformers ⭐ 301
CKIP Transformers
most recent commit 2 months ago
Lora ⭐ 299
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
total releases 2most recent commit a month ago
Attention Mechanisms ⭐ 294
Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with TensorFlow 2.0 and Keras.
most recent commit 9 months ago
Guwenbert ⭐ 289
GuwenBERT: 古文预训练语言模型（古文BERT） A Pre-trained Language Model for Classical Chinese (Literary Chinese)
most recent commit a year ago
Bio_embeddings ⭐ 286
Get protein embeddings from protein sequences
most recent commit 2 days ago
Qagnn ⭐ 284
[NAACL 2021] QA-GNN: Question Answering using Language Models and Knowledge Graphs
most recent commit 8 months ago
Transfer Nlp ⭐ 281
NLP library designed for reproducible experimentation management
total releases 8most recent commit 2 years ago
Multifit ⭐ 269
The code to reproduce results from paper "MultiFiT: Efficient Multi-lingual Language Model Fine-tuning" https://arxiv.org/abs/1909.04761
most recent commit 2 years ago
Autoprompt ⭐ 268
AutoPrompt: Automatic Prompt Construction for Masked Language Models.
most recent commit a month ago
Electra_pytorch ⭐ 246
Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)
most recent commit 7 months ago
Optimus ⭐ 243
Optimus: the first large-scale pre-trained VAE language model
most recent commit 8 months ago
Mead Baseline ⭐ 242
Deep-Learning Model Exploration and Development for NLP
most recent commit 6 days ago
Indic Bert ⭐ 234
BERT-based Multilingual Model for Indian Languages
most recent commit 6 months ago
Lotclass ⭐ 231
[EMNLP 2020] Text Classification Using Label Names Only: A Language Model Self-Training Approach
most recent commit 8 months ago
Relational Rnn Pytorch ⭐ 228
An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.
most recent commit 4 years ago
Simctg ⭐ 219
[NeurIPS'22] A Contrastive Framework for Neural Text Generation
total releases 4most recent commit 8 days ago
Spacyr ⭐ 212
R wrapper to spaCy NLP
dependent packages 3total releases 7most recent commit 8 months ago
Zeroth ⭐ 211
Kaldi-based Korean ASR (한국어 음성인식) open-source project
most recent commit 3 years ago
Lm Scorer ⭐ 206
📃Language Model based sentences scoring library
total releases 12most recent commit 8 months ago
Chatbot_data ⭐ 206
Chatbot_data_for_Korean
most recent commit 8 months ago
Prompt Tuning ⭐ 204
Original Implementation of Prompt Tuning from Lester, et al, 2021
most recent commit a month ago
Protein Sequence Embedding Iclr2019 ⭐ 203
Source code for "Learning protein sequence embeddings using information from structure" - ICLR 2019
most recent commit a year ago
A Pytorch Tutorial To Sequence Labeling ⭐ 202
Empower Sequence Labeling with Task-Aware Neural Language Model | a PyTorch Tutorial to Sequence Labeling
most recent commit 2 years ago
Lm Spanish ⭐ 195
Official source for spanish Language Models and resources made @ BSC-TEMU within the "Plan de las Tecnologías del Lenguaje" (Plan-TL).
most recent commit 2 months ago
Tner ⭐ 194
Language model fine-tuning on NER with an easy interface and cross-domain evaluation. "T-NER: An All-Round Python Library for Transformer-based Named Entity Recognition, EACL 2021"
total releases 9most recent commit 25 days ago
Roformer_pytorch ⭐ 192
RoFormer V1 & V2 pytorch
total releases 17most recent commit 4 months ago
Bert As Language Model ⭐ 191
bert as language model, fork from https://github.com/google-research/bert
most recent commit 3 years ago
Char Rnn Chinese ⭐ 190
Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch. Based on code of https://github.com/karpathy/char-rnn. Support Chinese and other things.
most recent commit 6 years ago
Neural Language Model ⭐ 180
Implementation of neural language models, in particular Collobert + Weston (2008) and a stochastic margin-based version of Mnih's LBL.
most recent commit 12 years ago
1-100 of 1,063 projects
Related Awesome Lists
Python Language Model Projects (540)
Categories
Advertising 📦 8
All Projects
Application Programming Interfaces 📦 107
Applications 📦 174
Artificial Intelligence 📦 69
Blockchain 📦 66
Build Tools 📦 105
Cloud Computing 📦 68
Code Quality 📦 24
Collaboration 📦 27
Command Line Interface 📦 38
Community 📦 79
Companies 📦 60
Compilers 📦 59
Computer Science 📦 73
Configuration Management 📦 37
Content Management 📦 153
Control Flow 📦 187
Data Formats 📦 72
Data Processing 📦 249
Data Storage 📦 116
Economics 📦 56
Frameworks 📦 178
Games 📦 110
Graphics 📦 92
Hardware 📦 137
Integrated Development Environments 📦 43
Learning Resources 📦 139
Legal 📦 24
Libraries 📦 117
Lists Of Projects 📦 19
Machine Learning 📦 313
Mapping 📦 57
Marketing 📦 15
Mathematics 📦 54
Media 📦 214
Messaging 📦 96
Networking 📦 292
Operating Systems 📦 72
Operations 📦 114
Package Managers 📦 50
Programming Languages 📦 173
Runtime Environments 📦 90
Science 📦 42
Security 📦 342
Social Media 📦 23
Software Architecture 📦 65
Software Development 📦 60
Software Performance 📦 53
Software Quality 📦 116
Text Editors 📦 40
Text Processing 📦 118
User Interface 📦 291
User Interface Components 📦 440
Version Control 📦 26
Virtualization 📦 63
Web Browsers 📦 35
Web Servers 📦 23
Web User Interface 📦 167
Top Programming Languages
Javascript  (1,090,060)
Python  (836,862)
Java  (396,315)
Php  (289,821)
Typescript  (266,127)
C Plus Plus  (245,644)
Ruby  (222,621)
C  (186,064)
Shell  (175,562)
C Sharp  (169,379)
Golang  (163,592)
Swift  (66,730)
Rust  (61,591)
R  (59,598)
Objective C  (57,116)
Dart  (56,061)
Kotlin  (49,101)
Lua  (35,607)
Matlab  (31,776)
Perl  (30,633)
Language  (29,988)
Scala  (28,906)
Haskell  (20,613)
Powershell  (19,524)
Clojure  (19,265)
Bash  (18,860)
Coffeescript  (17,224)
Elixir  (16,943)
Assembly  (15,003)
Processing  (13,286)
Julia  (13,275)
Basic  (10,702)
Emacs Lisp  (10,558)
Flow  (10,532)
Erlang  (9,072)
Solidity  (8,893)
Groovy  (8,490)
Scheme  (8,419)
Ocaml  (6,797)
Pascal  (6,570)
Hack  (6,461)
Lisp  (6,345)
Fortran  (5,644)
Elm  (5,505)
Common Lisp  (5,379)
Dlang  (4,763)
Shell Script  (4,727)
Python Library  (4,474)
Crystal  (4,402)
Scripting  (4,218)
Top Projects
Freecodecamp ⭐ 353,860
996.icu ⭐ 263,876
Free Programming Books ⭐ 249,820
Coding Interview University ⭐ 234,090
Awesome ⭐ 220,672
Developer Roadmap ⭐ 212,635
Public Apis ⭐ 209,615
Vue ⭐ 199,611
System Design Primer ⭐ 197,601
React ⭐ 195,230
Tensorflow ⭐ 167,934
Build Your Own X ⭐ 165,260
Bootstrap ⭐ 159,657
You Dont Know Js ⭐ 159,180
Cs Notes ⭐ 156,901
Javascript Algorithms ⭐ 151,359
Ohmyzsh ⭐ 150,386
Python ⭐ 145,251
Flutter ⭐ 145,242
Awesome Python ⭐ 142,001
Gitignore ⭐ 138,733
Linux ⭐ 138,490
Vscode ⭐ 136,934
Javaguide ⭐ 127,508
Javascript ⭐ 127,377
Computer Science ⭐ 123,917
Python 100 Days ⭐ 123,512
Youtube Dl ⭐ 113,542
Fucking Algorithm ⭐ 110,396
The Art Of Command Line ⭐ 109,914
React Native ⭐ 105,024
Go ⭐ 104,049
Awesome Selfhosted ⭐ 103,828
Electron ⭐ 103,793
30 Seconds Of Code ⭐ 102,805
D3 ⭐ 101,796
Create React App ⭐ 97,104
Axios ⭐ 95,834
Free Programming Books Zh_cn ⭐ 94,901
Next.js ⭐ 93,062
Kubernetes ⭐ 92,328
Node ⭐ 90,542
Awesome Go ⭐ 88,320
Three.js ⭐ 85,553
Deno ⭐ 85,410
Terminal ⭐ 85,389
Typescript ⭐ 84,486
Angular ⭐ 84,020
Ant Design ⭐ 81,977
Nodebestpractices ⭐ 81,676
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2022 Awesome Open Source.  All rights reserved.