Awesome Open Source

Programming Languages

Search results for language model

language-model x

921 search results found

Char_rnn_lm_zh ⭐ 54

language model in Chinese，基于Pytorch官方文档实现

Efficient inference of large language models.

Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.

Language Planner ⭐ 53

Official Code for "Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents"

Insuranceqa_zh ⭐ 53

InsuranceQA models for Chinese corpus in insurance fields.

Document level Attitude and Relation Extraction toolkit (AREkit) for sampling and prompting mass-media news into datasets for ML-model training

Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers"

Top-k Approximate String Matching.

Gap Text2sql ⭐ 51

GAP-text2SQL: Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training

Mukayese ⭐ 51

State-of-the-art NLP tools for Turkish

A Toolkit for Distributional Control of Generative Models

Ukrainian instruction-tuned language models and datasets

Nlp4sciencepapers ⭐ 50

Must-read papers on NLP for science.

Gilberto ⭐ 50

GilBERTo: A pretrained language model based on RoBERTa for Italian

Generalized Language Modeling Toolkit ⭐ 49

Generalized Language Modeling toolkit

A curated collection of interesting applications, repos, and tutorials using large language models (LLM) like GPT-3

UBC ARBERT and MARBERT Deep Bidirectional Transformers for Arabic

Decomposedprompttuning ⭐ 48

This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"

Commonsense Kg Completion ⭐ 48

Smart Language Model

Cross Domain_ner ⭐ 45

Cross-domain NER using cross-domain language modeling, code for ACL 2019 paper

Two Layer Hierarchical Softmax Pytorch ⭐ 45

Two-Layer Hierarchical Softmax Implementation for PyTorch

Pyvhdlmodel ⭐ 45

An abstract language model of VHDL written in Python.

Deepspeech_frontend ⭐ 45

A webpage and API for using Mozilla DeepSpeech

Subword Lstm Lm ⭐ 45

LSTM Language Model with Subword Units Input Representations

Subword Qac ⭐ 45

Subword Language Model for Query Auto-Completion

Unsupervised Sentence Summarization ⭐ 45

Unsupervised sentence summarization by contextual matching

Lm_build ⭐ 44

Adapting your own Language Model for Kaldi

Official PyTorch implementation of QA-LoRA

Videberta ⭐ 44

ViDeBERTa: A powerful pre-trained language model for Vietnamese, EACL 2023

Cybertron ⭐ 44

mindspore implementation of transformers

Tamil Lm2 ⭐ 44

language model for tamil

Lm Context Analysis ⭐ 44

Code for the ACL 2018 paper "Sharp Nearby, Fuzzy Far Away: How Neural Language Models Use Context"

Spacy Wrap ⭐ 43

spaCy-wrap is a wrapper library for spaCy for including fine-tuned transformers from Huggingface in your spaCy pipeline allowing you to include existing fine-tuned models within your SpaCy workflow.

Sifrank_zh ⭐ 43

基于预训练模型的中文关键词抽取方法（论文SIFRank: A New Baseline for Unsupervised Keyphrase Extraction Based on Pre-trained Language Model 的中文版代码）

Latticelm ⭐ 43

Software for unsupervised word segmentation and language model learning using lattices

高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task

Mlp Gpt Jax ⭐ 42

A GPT, made only of MLPs, in Jax

Alpaca Rlhf ⭐ 42

Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat

Cognitive Custom Speech Service ⭐ 42

Code and Sample for Microsoft's Custom Speech Service

Chinese Gen ⭐ 41

中文生成式预训练模型

Deep Nlp Resources ⭐ 41

Curated list of all NLP Resources

Lm_finetuning ⭐ 41

Language Model Fine-tuning for Moby Dick

MozoLM: A language model (LM) serving library

Gpt2 French ⭐ 40

GPT-2 French demo | Démo française de GPT-2

Few Shot Lm ⭐ 40

The source code of "Language Models are Few-shot Multilingual Learners" (MRL @ EMNLP 2021)

Tinyrwkv ⭐ 40

tinygrad port of the RWKV large language model.

Wae Rnf Lm ⭐ 40

Pytorch Implemetation for our NAACL2019 Paper "Riemannian Normalizing Flow on Variational Wasserstein Autoencoder for Text Modeling" https://arxiv.org/abs/1904.02399

Autoencode ⭐ 40

AutoenCODE is a Deep Learning infrastructure that allows to encode source code fragments into vector representations, which can be used to learn similarities.

Vose Alias Method ⭐ 39

Python implementation of Vose's alias method, an efficient algorithm for sampling from a discrete probability distribution.

[ICML 2021] Towards Understanding and Mitigating Social Biases in Language Models

Handling Out Of Vocabulary Words In Natural Language Processing Using Language Modelling ⭐ 39

Lm Infinite ⭐ 38

Implementation of paper "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"

Dasher Web ⭐ 38

Dasher text entry in HTML, CSS, JavaScript, and SVG

Ratransformers ⭐ 38

RATransformers 🐭- Make your transformer (like BERT, RoBERTa, GPT-2 and T5) Relation Aware!

Tying Wv And Wc ⭐ 38

Implementation for "Tying Word Vectors and Word Classifiers: A Loss Framework for Language Modeling"

Modern_chinese_nlp ⭐ 37

(WIP) My humble contribution to the democratization of the Chinese NLP technology

Implementation of CCS'2022 paper "SymLM: Predicting Function Names in Stripped Binaries via Context-Sensitive Execution-Aware Code Embeddings"

Efficient Attention ⭐ 37

[EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling

Boilerplate Dynet Rnn Lm ⭐ 36

Boilerplate code for quickly getting set up to run language modeling experiments

Sentence Compression ⭐ 36

Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback

Language Models ⭐ 36

Keras implementations of three language models: character-level RNN, word-level RNN and Sentence VAE (Bowman, Vilnis et al 2016).

Lmgec Lite ⭐ 36

A language model-based approach to Grammatical Error Correction for English that uses minimal annotated data.

MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems

Fnet Pytorch ⭐ 36

Unofficial PyTorch implementation of Google's FNet: Mixing Tokens with Fourier Transforms. With checkpoints.

Reweight Gpt ⭐ 36

Reweight GPT - a simple neural network using transformer architecture for next character prediction

Gpt Too Amr2text ⭐ 35

Code to reproduce "GPT-too: A Language-Model-First Approach for AMR-to-Text-Generation"

Augmented Interpretable Models ⭐ 35

Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.

Spacy Fi ⭐ 35

Experimental Finnish language model for SpaCy

Language Pretraining ⭐ 35

Pre-training Language Models for Japanese

Birnn Language Model Tf ⭐ 35

Tensorflow implementation of Bi-directional RNN Langauge Model

[EMNLP 2021] Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training

Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).

MLSys Workshop NeurIPS 2023 - Redco: A Lightweight Tool to Automate Distributed Training and Inference

Tensorflow With Kenlm ⭐ 34

Tensorflow with KenLM integrated for beam search scoring

Probabilistic programming with HuggingFace language models

Transformers Embedder ⭐ 34

A Word Level Transformer layer based on PyTorch and 🤗 Transformers.

G Universal Clip ⭐ 33

4th place solution for the Google Universal Image Embedding Kaggle Challenge. Instance-Level Recognition workshop at ECCV 2022

Llama.net ⭐ 33

.NET wrapper for LLaMA.cpp for LLaMA language model inference on CPU. 🦙

Finding semantically meaningful and accurate prompts.

Chatpdf Gpt ⭐ 33

ChatPDF-GPT is an innovative chat interface application powered by LangChain and OpenAI, allowing users to upload and chat with PDF documents, stored in Pinecone vector database and Supabase storage.

Embeddings ⭐ 33

Embeddings: State-of-the-art Text Representations for Natural Language Processing tasks, an initial version of library focus on the Polish Language

Abtextsumm ⭐ 32

Abstractive Summarization IJCAI paper code

Python Arpa ⭐ 32

🐍 Python library for n-gram models in ARPA format

A ready-to-deploy container for implementing an easy to use REST API to access Language Models.

LLM inference in Fortran

Pytorch Definitions ⭐ 30

Conditional Generators of Words Definitions, ACL 2018

PALM: Pre-training an Autoencoding & Autoregressive Language Model for Context-conditioned Generation

Lstm Predict Md ⭐ 30

Learning Molecular Dynamics with Simple Language Model built upon Long Short-Term Memory Neural Network

Kominilm ⭐ 29

Korean Light Weight Language Model

Swig Srilm ⭐ 29

SWIG Wrapper for the SRILM toolkit

HerBERT is a BERT-based Language Model trained on Polish Corpora using only MLM objective with dynamic masking of whole words.

Generating Text Small Corpus ⭐ 29

Generating style-specific text from a small corpus of 2.5k sentences using a pre-trained language model. Code in PyTorch

🚀 Building Go applications with LLMs through composability

Chainer Openai Transformer Lm ⭐ 28

A Chainer implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI

Character-aware Neural Language Model implemented by PyTorch

Gptq_for_langchain ⭐ 28

A guide about how to use GPTQ models with langchain

End-to-end MOdeling of ASR (Automatic Speech Recognition)

Zicklein ⭐ 28

Finetuning instruct-LLaMA on german datasets.

Related Searches

Python Language Model (540)

401-500 of 921 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.