The Top 1,102 Bert Open Source Projects on Github

Awesome Open Source

Awesome Open Source

Combined Topics

Advertising 📦 9

Application Programming Interfaces 📦 120

Applications 📦 181

Artificial Intelligence 📦 72

Blockchain 📦 70

Build Tools 📦 111

Cloud Computing 📦 79

Code Quality 📦 28

Collaboration 📦 30

Command Line Interface 📦 48

Community 📦 81

Companies 📦 60

Compilers 📦 60

Computer Science 📦 74

Configuration Management 📦 39

Content Management 📦 167

Control Flow 📦 197

Data Formats 📦 77

Data Processing 📦 266

Data Storage 📦 132

Economics 📦 60

Frameworks 📦 198

Graphics 📦 103

Hardware 📦 148

Integrated Development Environments 📦 47

Learning Resources 📦 147

Libraries 📦 119

Lists Of Projects 📦 21

Machine Learning 📦 336

Mapping 📦 61

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 97

Networking 📦 304

Operating Systems 📦 84

Operations 📦 120

Package Managers 📦 52

Programming Languages 📦 229

Runtime Environments 📦 96

Science 📦 42

Security 📦 375

Social Media 📦 26

Software Architecture 📦 70

Software Development 📦 68

Software Performance 📦 57

Software Quality 📦 127

Text Editors 📦 45

Text Processing 📦 131

User Interface 📦 310

User Interface Components 📦 465

Version Control 📦 29

Virtualization 📦 68

Web Browsers 📦 38

Web Servers 📦 25

Web User Interface 📦 194

The Top 1,102 Bert Open Source Projects on Github

Topic > Bert

Transformers ⭐ 52,884

🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.

Bert As Service ⭐ 9,360

Mapping a variable-length sentence to a fixed-length vector using BERT model

Nlp Tutorial ⭐ 9,097

Natural Language Processing Tutorial for Deep Learning Researchers

Chinese Bert Wwm ⭐ 6,077

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

Nlp_chinese_corpus ⭐ 5,454

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

Tokenizers ⭐ 4,851

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Ernie ⭐ 4,347

Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimodal Understanding & Generation, and beyond.

Bert Pytorch ⭐ 4,189

Google AI 2018 BERT pytorch implementation

Bert Bilstm Crf Ner ⭐ 3,550

Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services

Bertviz ⭐ 3,187

Tool for visualizing attention in the Transformer model (BERT, GPT-2, Albert, XLNet, RoBERTa, CTRL, etc.)

Pytorch Sentiment Analysis ⭐ 2,905

Tutorials on getting started with PyTorch and TorchText for sentiment analysis.

Albert_zh ⭐ 2,899

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

Nlp Architect ⭐ 2,729

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

Pycorrector ⭐ 2,667

pycorrector is a toolkit for text error correction. 文本纠错，Kenlm，Seq2Seq_Attention，BERT，MacBERT，ELECTRA，ERNIE，Transformer等模型实现，开箱即用。

Haystack ⭐ 2,570

🔍 End-to-end Python framework for building natural language search interfaces to data. Leverages Transformers and the State-of-the-Art of NLP. Supports DPR, Elasticsearch, Hugging Face’s Hub, and much more!

Spark Nlp ⭐ 2,436

State of the Art Natural Language Processing

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

Paddlenlp ⭐ 2,190

An NLP library with Awesome pre-trained Transformer models and easy-to-use interface, supporting wide-range of NLP tasks from research to industrial applications.

Keras Bert ⭐ 2,179

Implementation of BERT that could load official pre-trained models for feature extraction and prediction

Kashgari ⭐ 2,141

Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.

Texar ⭐ 2,008

Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow

Awesome Sentence Embedding ⭐ 1,831

A curated list of pretrained sentence and word embedding models

Mt Dnn ⭐ 1,818

Multi-Task Deep Neural Networks for Natural Language Understanding

Roberta_zh ⭐ 1,769

RoBERTa中文预训练模型: RoBERTa for Chinese

Lightseq ⭐ 1,742

LightSeq: A High Performance Library for Sequence Processing and Generation

Uer Py ⭐ 1,704

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

Fast Bert ⭐ 1,654

Super easy library for BERT based NLP models

Nlp_paper_study ⭐ 1,641

研读顶会论文，复现论文相关代码

Awesome Bert ⭐ 1,630

bert nlp papers, applications and github resources, including the newst xlnet ， BERT、XLNet 相关论文和 github 项目

Bertopic ⭐ 1,510

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

Chineseglue ⭐ 1,489

Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard

Codesearchnet ⭐ 1,446

Datasets, tools, and benchmarks for representation learning of code.

🏡 Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

Jiant ⭐ 1,341

jiant is an nlp toolkit

Nlp Journey ⭐ 1,328

Documents, papers and codes related to Natural Language Processing, including Topic Model, Word Embedding, Named Entity Recognition, Text Classificatin, Text Generation, Text Similarity, Machine Translation)，etc. All codes are implemented intensorflow 2.0.

Absa Pytorch ⭐ 1,307

Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析，使用PyTorch实现。

Top2vec ⭐ 1,289

Top2Vec learns jointly embedded topic, document and word vectors.

⭕ N2O: Distributed Application Server

Gpt2 Ml ⭐ 1,223

GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型

Nlp_xiaojiang ⭐ 1,129

自然语言处理（nlp），小姜机器人（闲聊检索式chatbot），BERT句向量-相似度（Sentence Similarity），XLNET句向量-相似度（text xlnet embedding），文本分类（Text classification），实体提取（ner，bert+bilstm+crf），数据增强（text augment, data enhance），同义句同义词生成，句子主干提取（mainpart），中文汉语短文本相似度，文本特征工程，keras-http-service调用

Keras Textclassification ⭐ 1,098

中文长文本分类、短句子分类、多标签分类、两句子相似度（Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short），字词句向量嵌入层（embeddings）和网络层（graph）构建基类，FastText，TextCNN，CharCNN，TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, 胶囊网络-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN

Spacy Transformers ⭐ 1,045

🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy

Chinese Electra ⭐ 1,015

Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）

Bert Ner ⭐ 1,000

Use Google's BERT for named entity recognition （CoNLL-2003 as the dataset）.

Turbotransformers ⭐ 993

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

Promptpapers ⭐ 988

Must-read papers on prompt-based tuning for pre-trained language models.

Nlp Knowledge Graph ⭐ 949

自然语言处理、知识图谱、对话系统三大技术研究与应用。

Textbrewer ⭐ 937

A PyTorch-based knowledge distillation toolkit for natural language processing

Self-contained Machine Learning and Natural Language Processing library in Go

Shift Ctrl F ⭐ 887

🔎 Search the information available on a webpage using natural language instead of an exact string match.

Keybert ⭐ 879

Minimal keyword extraction with BERT

Getting Things Done With Pytorch ⭐ 873

Jupyter Notebook tutorials on solving real-world problems with Machine Learning & Deep Learning using PyTorch. Topics: Face detection with Detectron 2, Time Series anomaly detection with LSTM Autoencoders, Object Detection with YOLO v5, Build your first Neural Network, Time Series forecasting for Coronavirus daily cases, Sentiment Analysis with BERT.

Bert Ner ⭐ 872

Pytorch-Named-Entity-Recognition-with-BERT

Service Streamer ⭐ 860

Boosting your Web Services of Deep Learning Applications.

Cluener2020 ⭐ 859

CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition

Bert Extractive Summarizer ⭐ 782

Easy to use extractive text summarization with BERT

Bert Ner Pytorch ⭐ 749

Chinese NER(Named Entity Recognition) using BERT(Softmax, CRF, Span)

Transformers Tutorials ⭐ 743

This repository contains demos I made with the Transformers library by HuggingFace.

Rust Bert ⭐ 737

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

Awesome Deeplearning ⭐ 719

深度学习入门课、资深课、特色课、学术案例、产业实践案例、深度学习知识百科及面试题库The course, case and knowledge of Deep Learning and AI

Deberta ⭐ 716

The implementation of DeBERTa

Texar Pytorch ⭐ 688

Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/

Easytransfer ⭐ 681

EasyTransfer is designed to make the development of transfer learning in NLP applications easier.

Rasa_chatbot_cn ⭐ 677

building a chinese dialogue system based on the newest version of rasa(基于最新版本rasa搭建的对话系统)

Korean BERT pre-trained cased (KoBERT)

Bert For Tf2 ⭐ 665

A Keras TensorFlow 2.0 implementation of BERT, ALBERT and adapter-BERT.

Contextualized Topic Models ⭐ 657

A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021.

Scibert ⭐ 643

A BERT model for scientific text.

Bert Chinese Ner ⭐ 637

使用预训练语言模型BERT做中文NER

Awesome Bert Nlp ⭐ 636

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

Bertsearch ⭐ 620

Elasticsearch with BERT for advanced document search.

Awesome Qa ⭐ 616

😎 A curated list of the Question Answering (QA)

Awesome Vision Language Pretraining Papers ⭐ 608

Recent Advances in Vision and Language PreTrained Models (VL-PTMs)

Bert_seq2seq ⭐ 581

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

Adapter Transformers ⭐ 580

Huggingface Transformers + Adapters = ❤️

Cluepretrainedmodels ⭐ 536

高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型

Fasthan ⭐ 535

fastHan是基于fastNLP与pytorch实现的中文自然语言处理工具，像spacy一样调用方便。

Fastertransformer ⭐ 526

Transformer related optimization, including BERT, GPT

Kbqa Bert ⭐ 522

基于知识图谱的问答系统，BERT做命名实体识别和句子相似度，分为online和outline模式

Awesome Pretrained Chinese Nlp Models ⭐ 519

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型集合

Docproduct ⭐ 511

Medical Q&A with Deep Language Models

Bert Multi Label Text Classification ⭐ 509

This repo contains a PyTorch implementation of a pretrained BERT model for multi-label text classification.

Sentiment_analysis_fine_grain ⭐ 504

Multi-label Classification with BERT; Fine Grained Sentiment Analysis from AI challenger

Nlp Tutorials ⭐ 504

Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com

Bert_paper_chinese_translation ⭐ 498

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 论文的中文翻译 Chinese Translation!

Fastbert ⭐ 482

The score code of FastBERT (ACL2020)

Xlnet Pytorch ⭐ 475

Simple XLNet implementation with Pytorch Wrapper

Transformer Explainability ⭐ 472

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

Official implementation of the paper “GECToR – Grammatical Error Correction: Tag, Not Rewrite” // Published on BEA15 Workshop (co-located with ACL 2020) https://www.aclweb.org/anthology/2020.bea-1.16.pdf

A Novel Cascade Binary Tagging Framework for Relational Triple Extraction. Accepted by ACL 2020.

Bert Multitask Learning ⭐ 436

BERT for Multitask Learning

Albert_pytorch ⭐ 423

A Lite Bert For Self-Supervised Learning Language Representations

⛔ [NOT MAINTAINED] An End-To-End Closed Domain Question Answering System.

Portuguese Bert ⭐ 402

Portuguese pre-trained BERT models

Phobert ⭐ 399

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

Bert Embedding ⭐ 392

🔡 Token level embeddings from BERT model on mxnet and gluonnlp

Nlp Paper ⭐ 381

Mrc_competition_dureader ⭐ 374

机器阅读理解冠军/亚军代码及中文预训练MRC模型

Vl Bert ⭐ 371

Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".

Bertweet ⭐ 365

BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)

1-100 of 1,102 projects

Related Projects

Python Bert Projects (663)

Nlp Bert Projects (405)

Transformer Bert Projects (267)

Pytorch Bert Projects (246)

Jupyter Notebook Bert Projects (234)

Python Nlp Bert Projects (227)

Natural Language Processing Bert Projects (200)

Deep Learning Bert Projects (174)

Python Pytorch Bert Projects (166)

Python Transformer Bert Projects (155)

Tensorflow Bert Projects (145)

Python Natural Language Processing Bert Projects (119)

Nlp Transformer Bert Projects (118)

Nlp Natural Language Processing Bert Projects (110)

Machine Learning Bert Projects (108)

Python Deep Learning Bert Projects (107)

Pytorch Nlp Bert Projects (104)

Jupyter Notebook Nlp Bert Projects (103)

Python Tensorflow Bert Projects (98)

Bert Ner Projects (96)

Bert Language Model Projects (94)

Deep Learning Nlp Bert Projects (92)

Text Classification Bert Projects (90)

Pytorch Transformer Bert Projects (82)

Bert Roberta Projects (76)

Bert Albert Projects (72)

Python Bert Ner Projects (69)

Sentiment Analysis Bert Projects (69)

Tensorflow Nlp Bert Projects (68)

Python Pytorch Nlp Bert Projects (66)

Bert Question Answering Projects (66)

Python Machine Learning Bert Projects (66)

Machine Learning Nlp Bert Projects (64)

Jupyter Notebook Transformer Bert Projects (64)

Natural Language Processing Transformer Bert Projects (61)

Python Text Classification Bert Projects (60)

Python Nlp Transformer Bert Projects (58)

Python Pytorch Transformer Bert Projects (55)

Python Nlp Natural Language Processing Bert Projects (55)

Deep Learning Transformer Bert Projects (55)

Deep Learning Natural Language Processing Bert Projects (53)

Pytorch Natural Language Processing Bert Projects (51)

Advertising 📦 9

Application Programming Interfaces 📦 120

Applications 📦 181

Artificial Intelligence 📦 72

Blockchain 📦 70

Build Tools 📦 111

Cloud Computing 📦 79

Code Quality 📦 28

Collaboration 📦 30

Command Line Interface 📦 48

Community 📦 81

Companies 📦 60

Compilers 📦 60

Computer Science 📦 74

Configuration Management 📦 39

Content Management 📦 167

Control Flow 📦 197

Data Formats 📦 77

Data Processing 📦 266

Data Storage 📦 132

Economics 📦 60

Frameworks 📦 198

Graphics 📦 103

Hardware 📦 148

Integrated Development Environments 📦 47

Learning Resources 📦 147

Libraries 📦 119

Lists Of Projects 📦 21

Machine Learning 📦 336

Mapping 📦 61

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 97

Networking 📦 304

Operating Systems 📦 84

Operations 📦 120

Package Managers 📦 52

Programming Languages 📦 229

Runtime Environments 📦 96

Science 📦 42

Security 📦 375

Social Media 📦 26

Software Architecture 📦 70

Software Development 📦 68

Software Performance 📦 57

Software Quality 📦 127

Text Editors 📦 45

Text Processing 📦 131

User Interface 📦 310

User Interface Components 📦 465

Version Control 📦 29

Virtualization 📦 68

Web Browsers 📦 38

Web Servers 📦 25

Web User Interface 📦 194

"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.

All non readme contents or Github based topics or project metadata copyright Awesome Open Source 2018-2021