Hierarchical Language Modeling

We address the task of learning contextualized word, sentence and document representations with a hierarchical language model by stacking Transformer-based encoders on a sentence level and subsequently on a document level and performing masked token prediction.
Alternatives To Hierarchical Language Modeling
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Awesome Sentence Embedding1,831
3 years ago1gpl-3.0Python
A curated list of pretrained sentence and word embedding models
Polish Nlp Resources267
7 months ago1lgpl-3.0
Pre-trained models and language resources for Natural Language Processing in Polish
Nlp Tutorial101
2 years agoapache-2.0Jupyter Notebook
自然语言处理(NLP)教程,包括:词向量,词法分析,预训练语言模型,文本分类,文本语义匹配,信息抽取,翻译,对话。
Language Games89
4 years ago1mitPython
Dead simple games made with word vectors.
Easy Bert71
4 years ago4April 28, 20195mitJava
A Dead Simple BERT API for Python and Java (https://github.com/google-research/bert)
Sifrank61
3 years agoPython
The code of our paper "SIFRank: A New Baseline for Unsupervised Keyphrase Extraction Based on Pre-trained Language Model"
Emnlp 2023 Papers54
5 months agomitPython
EMNLP 2023 Papers: Explore cutting-edge research from EMNLP 2023, the premier conference for advancing empirical methods in natural language processing. Stay updated on the latest in machine learning, deep learning, and natural language processing with code included. :star: support NLP!
Sifrank_zh43
4 years ago4Python
基于预训练模型的中文关键词抽取方法(论文SIFRank: A New Baseline for Unsupervised Keyphrase Extraction Based on Pre-trained Language Model 的中文版代码)
Boilerplate Dynet Rnn Lm36
7 years ago1Python
Boilerplate code for quickly getting set up to run language modeling experiments
Chainer Notebooks21
7 years agomitJupyter Notebook
Jupyter notebooks for Chainer hands-on
Alternatives To Hierarchical Language Modeling
Select To Compare


Alternative Project Comparisons
Popular Language Model Projects
Popular Word Embeddings Projects
Popular Machine Learning Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Jupyter Notebook
Deep Learning
Machine Learning
Pytorch
Natural Language Processing
Language Model
Transfer Learning
Attention Mechanism
Word Embeddings
Representation Learning
Information Retrieval
Natural Language Understanding