Awesome Open Source

Programming Languages

Search results for pretrained language model

pretrained-language-model x

51 search results found

Torchscale ⭐ 2,804

Foundation Architecture for (M)LLMs

Awesome Sentence Embedding ⭐ 1,831

A curated list of pretrained sentence and word embedding models

P Tuning V2 ⭐ 1,790

An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks

Yayi2 ⭐ 1,264

YAYI 2 是中科闻歌研发的新一代开源大语言模型，采用了超过 2 万亿 Tokens 的高质量、多语言语料进行预训练。(Repo for YaYi 2 Chinese LLMs)

Summarization Papers ⭐ 922

Summarization Papers

Opendelta ⭐ 810

A plug-and-play library for parameter-efficient-tuning (Delta Tuning)

Lawyer Llama ⭐ 636

中文法律LLaMA (LLaMA for Chinese legel domain)

Cpm Live ⭐ 449

Live Training for Open-source Big Models

Nlp Projects ⭐ 345

word2vec, sentence2vec, machine reading comprehension, dialog system, text classification, pretrained language model (i.e., XLNet, BERT, ELMo, GPT), sequence labeling, information retrieval, information extraction (i.e., entity, relation and event extraction), knowledge graph, text generation, network embedding

Awesome Instruction Learning ⭐ 336

Papers and Datasets on Instruction Tuning and Following. ✨✨✨

Dont Stop Pretraining ⭐ 328

Code associated with the Don't Stop Pretraining ACL 2020 paper

Diffusion Bert ⭐ 217

Implementation of DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models

Attrprompt ⭐ 114

[NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.

Atpapers ⭐ 105

Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力机制、Transformer和预训练语言模型论文与相关资源集合

Mwptoolkit ⭐ 103

MWPToolkit is an open-source framework for math word problem(MWP) solvers.

Awesome Refreshing Llms ⭐ 85

EMNLP'23 survey: a curation of awesome papers and resources on refreshing large language models (LLMs) without expensive retraining.

[NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

Prompt Transferability ⭐ 79

On Transferability of Prompt Tuning for Natural Language Processing

Bert4eth ⭐ 45

BERT4ETH: A Pre-trained Transformer for Ethereum Fraud Detection (WWW23)

Supergen ⭐ 43

[NeurIPS 2022] Generating Training Data with Language Models: Towards Zero-Shot Language Understanding

[EMNLP 2022] This is the code repo for our EMNLP‘22 paper "COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning".

Dialog Koelectra ⭐ 33

ELECTRA기반 한국어 대화체 언어모델

Efficient Bert ⭐ 31

This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation".

Cokebert ⭐ 30

CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models

CODER: Knowledge infused cross-lingual medical term embedding for term normalization. [JBI, ACL-BioNLP 2022]

Nlp2sparql ⭐ 30

Translate Natural Language Processing to SPARQL Query and vice versa

[Paper][AAAI 2023] DUET: Cross-modal Semantic Grounding for Contrastive Zero-shot Learning

AiSpace: Better practices for deep learning model development and deployment For Tensorflow 2.0

BioBART: Pretraining and Evaluation of A Biomedical Generative Language Model [ACL-BioNLP 2022]

Text Clf Baselines ⭐ 24

WideMLP for Text Classification

Hierarchical Domain Adaptation ⭐ 23

Code of NAACL 2022 "Efficient Hierarchical Domain Adaptation for Pretrained Language Models" paper.

[KDD22] Official PyTorch implementation for "Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learning".

Code and data for "CoditT5: Pretraining for Source Code and Natural Language Editing" in ASE 2022.

Stage Wise Fine Tuning ⭐ 21

Code for Stage-wise Fine-tuning for Graph-to-Text Generation

Metric Fairness ⭐ 20

EMNLP'2022: BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation

Negation Learning ⭐ 16

code for our paper "Understanding by Understanding Not: Modeling Negation in Language Models"

🥥 Code & Data for Comparative Opinion Summarization via Collaborative Decoding (Iso et al; Findings of ACL 2022)

Awesome Llm Self Consistency ⭐ 15

Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models

Unify Learning Paradigms ⭐ 15

data collator for UL2 and U-PaLM

This repository is the official implementation of our EMNLP 2022 paper ELMER: A Non-Autoregressive Pre-trained Language Model for Efficient and Effective Text Generation

Transpolymer ⭐ 13

Implementation of "TransPolymer: a Transformer-based language model for polymer property predictions" in PyTorch

[ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators

[ACL2023] Preserving Commonsense Knowledge from Pre-trained Language Models via Causal Inference

Cehr Bert ⭐ 9

CEHR-BERT: Incorporating temporal information from structured EHR data to improve prediction tasks

Official repository of Generating Multiple-Length Summaries via Reinforcement Learning for Unsupervised Sentence Summarization [EMNLP'22 Findings]

[EMNLP'23 Oral] ReSee: Responding through Seeing Fine-grained Visual Knowledge in Open-domain Dialogue PyTorch Implementation

The official repo for "VER: Unifying Verbalizing Entities and Relations" (Findings of EMNLP '23)

Code for the ACL2022 paper "C-MORE: Pretraining to Answer Open-Domain Questions by Consulting Millions of References"

Multimedia Generative Script Learning ⭐ 6

Official implementation of the ACL Findings 2023 paper: Multimedia Generative Script Learning for Task Planning

Examples for Clarifai Python SDK and Integrations

Protein_pretrain ⭐ 5

Multimodal Pretraining for Unsupervised Protein Representation Learning

Related Searches

Python Pretrained Language Model (18)

Pytorch Pretrained Language Model (12)

Text Generation Pretrained Language Model (9)

1-51 of 51 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.