Awesome Open Source

Programming Languages

Search results for language model representation learning

language-model x

representation-learning x

6 search results found

Deberta ⭐ 1,673

The implementation of DeBERTa

Sapbert ⭐ 117

[NAACL'21 & ACL'21] SapBERT: Self-alignment pretraining for BERT & XL-BEL: Cross-Lingual Biomedical Entity Linking.

[NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

Selformer ⭐ 55

SELFormer: Molecular Representation Learning via SELFIES Language Models

[ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators

Hierarchical Language Modeling ⭐ 5

We address the task of learning contextualized word, sentence and document representations with a hierarchical language model by stacking Transformer-based encoders on a sentence level and subsequently on a document level and performing masked token prediction.

Related Searches

Python Language Model (540)

Python Representation Learning (333)

1-6 of 6 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.