Awesome Open Source

Programming Languages

Search results for bert roberta

74 search results found

Chinese Bert Wwm ⭐ 8,600

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

Bertviz ⭐ 5,547

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

Awesome Pretrained Chinese Nlp Models ⭐ 3,738

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

Albert_zh ⭐ 3,723

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

Uer Py ⭐ 2,802

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

Rust Bert ⭐ 2,300

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

Roberta_zh ⭐ 2,141

RoBERTa中文预训练模型: RoBERTa for Chinese

🏡 Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

Deberta ⭐ 1,673

The implementation of DeBERTa

Cluener2020 ⭐ 1,384

CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition

Turbotransformers ⭐ 1,322

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

Tencentpretrain ⭐ 951

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

Bert_seq2seq ⭐ 890

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注

Curated Transformers ⭐ 790

🤖 A PyTorch library of curated Transformer models and their composable components

Texar Pytorch ⭐ 711

Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/

Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)

Phobert ⭐ 593

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

Promptclue ⭐ 592

PromptCLUE, 全中文任务支持零样本学习模型

Bertweet ⭐ 542

BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)

Cluepretrainedmodels ⭐ 536

高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型

Cluecorpus2020 ⭐ 517

Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料

Happy Transformer ⭐ 449

Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.

📖 Korean NLU Benchmark

Transformersum ⭐ 362

Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.

Simple State-of-the-Art BERT-Based Sentence Classification with Keras / TensorFlow 2. Built with HuggingFace's Transformers.

MinT: Minimal Transformer Library and Tutorials

Embedding As Service ⭐ 182

One-Stop Solution to encode sentence to fixed length vectors from various embedding techniques

Robbert ⭐ 180

A Dutch RoBERTa-based language model

Xlnet_zh ⭐ 175

中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large

Getting Started With Google Bert ⭐ 126

Build and train state-of-the-art natural language processing models using BERT

BOND: BERT-Assisted Open-Domain Name Entity Recognition with Distant Supervision

Multi Label_classification ⭐ 108

transform multi-label classification as sentence pair task, with more training data and information

Minirbt ⭐ 102

MiniRBT (中文小型预训练模型系列)

This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.12410).

A PyTorch implementation of a BiLSTM \ BERT \ Roberta (+ BiLSTM + CRF) model for Chinese Word Segmentation (中文分词) .

Infobert ⭐ 81

[ICLR 2021] "InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective" by Boxin Wang, Shuohang Wang, Yu Cheng, Zhe Gan, Ruoxi Jia, Bo Li, Jingjing Liu

Dialog Nlu ⭐ 78

Tensorflow and Keras implementation of the state of the art researches in Dialog System NLU

Text Summarization ⭐ 76

Abstractive and Extractive Text summarization using Transformers.

Iterater ⭐ 66

Official implementation of the paper "IteraTeR: Understanding Iterative Revision from Human-Written Text" (ACL 2022)

Ko Sentence Transformers ⭐ 66

한국어 사전학습 모델을 활용한 문장 임베딩

Roberta Wwm Base Distill ⭐ 64

this is roberta wwm base distilled model which was distilled from roberta wwm by roberta wwm large

Clue_pytorch ⭐ 61

CLUE baseline pytorch CLUE的pytorch版本基线

Polish Roberta ⭐ 61

RoBERTa models for Polish

Emotion recognition in conversation

Efficient Task Transfer ⭐ 34

Research code for "What to Pre-Train on? Efficient Intermediate Task Selection", EMNLP 2021

Code for the paper "PALBERT: Teaching ALBERT to Ponder", NeurIPS 2022 Spotlight

Model Zoo ⭐ 29

NLP model zoo for Russian

Amazon Ml Challenge2021 ⭐ 28

Scripts and Approach for Amazon ML Challenge

Les Military Mrc Rank7 ⭐ 26

莱斯杯：全国第二届“军事智能机器阅读”挑战赛 - Rank7 解决方案

Transformer Qg On Squad ⭐ 26

Implement Question Generator with SOTA pre-trained Language Models (RoBERTa, BERT, GPT, BART, T5, etc.)

Bert_for_longer_texts ⭐ 25

BERT classification model for processing texts longer than 512 tokens. Text is first divided into smaller chunks and after feeding them to BERT, intermediate results are pooled. The implementation allows fine-tuning.

Distilkobilstm ⭐ 17

Distilling Task-Specific Knowledge from Teacher Model into BiLSTM

Text Classification Pytorch ⭐ 16

Summary and comparison of Chinese classification models

Bert_seq2seq_ddp ⭐ 16

bert_seq2seq的DDP版本，支持bert、roberta、nezha、t5、gpt2等模型

Fake News Classification Model ⭐ 16

✨ Fake news classification using source adaptive framework - BE Project 🎓The repository contains Detailed Documentation of the project, Classification pipeline, Architecture, System Interface Design, Tech stack used.

Tianchi2020chinesemedicinequestiongeneration ⭐ 16

2020 阿里云天池大数据竞赛-中医药文献问题生成挑战赛

Long Texts Sentiment Analysis Roberta ⭐ 16

PyTorch implementation of Sentiment Analysis of the long texts written in Serbian language (which is underused language) using pretrained Multilingual RoBERTa based model (XLM-R) on the small dataset.

Implementation of pre-training model loading architecture of bert and its variants with tensorflow2

German Transformer Training ⭐ 13

Plan and train German transformer models.

Vietnamese Roberta ⭐ 12

A Robustly Optimized BERT Pretraining Approach for Vietnamese

Pytorch Roberta ⭐ 9

Transformers_examples ⭐ 8

reference pytorch code for huggingface transformers

Code for Findings of EMNLP 2022 short paper "CDGP: Automatic Cloze Distractor Generation based on Pre-trained Language Model".

Drophead Pytorch ⭐ 7

An implementation of drophead regularization for pytorch transformers

A software for transferring pre-trained English models to foreign languages

Simpleclassification ⭐ 6

Simple Text Classification[WIP]

Security Intelligence On Exchanged Multimedia Messages Based On Deep Learning ⭐ 6

Deep learning (DL) approaches use various processing layers to learn hierarchical representations of data. Recently, many methods and designs of natural language processing (NLP) models have shown significant development, especially in text mining and analysis. For learning vector-space representations of text, there are famous models like Word2vec, GloVe, and fastText. In fact, NLP took a big step forward when BERT and recently GTP-3 came out. Deep Learning algorithms are unable to deal with te

An open-source Kazakh named entity recognition dataset (KazNERD), annotation guidelines, and baseline NER models.

Supporting code for the paper "Multilingual Transformer Ensembles for Portuguese Natural Language Tasks".

Roberta4keras ⭐ 6

An English RoBERTa based on bert4keras

Amazon Fine Food Reviews ⭐ 6

Determine the polarity of amazon fine food reviews using ULMFiT, BERT, XLNet and RoBERTa

Source code for our "MMM" paper at AAAI 2020

Sst 2 Sentiment Analysis ⭐ 5

Use BiLSTM_attention, BERT, ALBERT, RoBERTa, XLNet model to classify the SST-2 data set based on pytorch

Related Searches

Python Bert (699)

Natural Language Processing Bert (591)

Pytorch Bert (296)

Jupyter Notebook Bert (263)

Deep Learning Bert (198)

1-74 of 74 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.