Awesome Open Source

Programming Languages

Search results for pytorch language model

language-model x

128 search results found

Transformers ⭐ 124,049

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Haystack ⭐ 12,474

🔍 LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

Rwkv Lm ⭐ 10,705

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

Chatrwkv ⭐ 8,991

ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

Petals ⭐ 8,040

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Lmflow ⭐ 7,589

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

Open_clip ⭐ 7,355

An open source implementation of CLIP.

Speechbrain ⭐ 7,166

A PyTorch-based Speech Toolkit

Opennmt Py ⭐ 6,449

Open Source Neural Machine Translation and (Large) Language Models in PyTorch

Bert Pytorch ⭐ 5,605

Google AI 2018 BERT pytorch implementation

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

Chatglm Efficient Tuning ⭐ 3,130

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

Open_flamingo ⭐ 3,115

An open-source framework for training large multimodal models.

Mixtral Offloading ⭐ 1,943

Run Mixtral-8x7B models in Colab or consumer desktops

Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).

Awd Lstm Lm ⭐ 1,838

LSTM and QRNN Language Model Toolkit for PyTorch

Pytorch Cpp ⭐ 1,710

C++ Implementation of PyTorch Tutorials for Everyone

🏡 Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

Spacy Transformers ⭐ 1,302

🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy

Chinese Electra ⭐ 1,253

Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）

Pytorch Openai Transformer Lm ⭐ 1,182

🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI

Kobert ⭐ 1,035

Korean BERT pre-trained cased (KoBERT)

Transformers4rec ⭐ 974

Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.

Large-scale pretrained models for goal-directed dialog

Lm Lstm Crf ⭐ 830

Empower Sequence Labeling with Task-Aware Language Model

Lightnlp ⭐ 725

基于Pytorch和torchtext的自然语言处理深度学习框架。

Trankit ⭐ 693

Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing

Primeqa ⭐ 677

The prime repository for state-of-the-art Multilingual Question Answering research and development.

Treasure Of Transformers ⭐ 541

💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️

Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-176B/bloom/gpt/bart/T5/MetaICL)

Macbert ⭐ 489

Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)

Neural_sp ⭐ 466

End-to-end ASR/LM implementation with PyTorch

Koelectra ⭐ 448

Pretrained ELECTRA Model for Korean

Albert_pytorch ⭐ 423

A Lite Bert For Self-Supervised Learning Language Representations

Azureml Bert ⭐ 384

End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service

Korean GPT-2 pretrained cased (KoGPT2)

Adaptnlp ⭐ 371

An easy to use Natural Language Processing library and framework for predicting, training, fine-tuning, and serving up state-of-the-art NLP models.

Gpu_poor ⭐ 371

Calculate GPU memory requirement & breakdown for training/inference of LLM models. Supports ggml/bnb quantization

Research code for pixel-based encoders of language (PIXEL)

Transfer Nlp ⭐ 281

NLP library designed for reproducible experimentation management

Extreme Bert ⭐ 263

ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.

Electra_pytorch ⭐ 246

Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)

Mead Baseline ⭐ 245

Deep-Learning Model Exploration and Development for NLP

Relational Rnn Pytorch ⭐ 228

An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.

Kb Albert ⭐ 222

KB국민은행에서 제공하는 경제/금융 도메인에 특화된 한국어 ALBERT 모델

Protein Sequence Embedding Iclr2019 ⭐ 203

Source code for "Learning protein sequence embeddings using information from structure" - ICLR 2019

A Pytorch Tutorial To Sequence Labeling ⭐ 202

Empower Sequence Labeling with Task-Aware Neural Language Model | a PyTorch Tutorial to Sequence Labeling

Roformer_pytorch ⭐ 192

RoFormer V1 & V2 pytorch

Pytorch Nce ⭐ 160

The Noise Contrastive Estimation for softmax output written in Pytorch

Doppel Bot ⭐ 155

Train a language model to answer Slack messages as you.

Implicit Language Q Learning ⭐ 153

Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"

Knn Transformers ⭐ 151

PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an implementation of kNN-LM and kNN-MT

Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling

Mlm Scoring ⭐ 135

Python library & examples for Masked Language Model Scoring (ACL 2020)

Nezha_chinese_pytorch ⭐ 135

NEZHA: Neural Contextualized Representation for Chinese Language Understanding

Black Box Tuning ⭐ 133

ICML'2022: Black-Box Tuning for Language-Model-as-a-Service & EMNLP'2022: BBTv2: Towards a Gradient-Free Future with Large Language Models

Personality Prediction ⭐ 130

Experiments for automated personality detection using Language Models and psycholinguistic features on various famous personality datasets including the Essays dataset (Big-Five)

Indonesian Language Models ⭐ 126

Indonesian Language Models and its Usage

Mongolian Nlp ⭐ 126

Useful resources for Mongolian NLP

Bert Sklearn ⭐ 119

a sklearn wrapper for Google's BERT model

Dynamic Memory Networks Plus Pytorch ⭐ 115

Implementation of Dynamic memory networks plus in Pytorch

Deep_learning_in_python_2018 ⭐ 114

Deep Learning workshop including image classification, face recognition, Object detection, language modelling, image captioning and neural machine translation.

Pytorch implementation of R-BERT: "Enriching Pre-trained Language Model with Entity Information for Relation Classification"

Whisper Auto Transcribe ⭐ 91

Auto transcribe tool based on whisper

Pytorch_gbw_lm ⭐ 90

PyTorch Language Model for 1-Billion Word (LM1B / GBW) Dataset

Reparam Discrete Diffusion ⭐ 81

Reparameterized Discrete Diffusion Models for Text Generation

Msr Nlp Projects ⭐ 81

This is a list of open-source projects at Microsoft Research NLP Group

Nlg Metricverse ⭐ 75

[COLING22] An End-to-End Library for Evaluating Natural Language Generation

Electra_pytorch ⭐ 73

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

PyTorch Implementation of OpenAI GPT-2

Code and pre-trained models for the paper "Domain-Agnostic Molecular Generation with Self-feedback."

Imodelsx ⭐ 60

Scikit-learn friendly library to interpret, and prompt-engineer text datasets using large language models.

Pretraining For Language Understanding ⭐ 59

Pre-training of Language Models for Language Understanding

Toolformer ⭐ 57

Implementation of Toolformer: Language Models Can Teach Themselves to Use Tools

Romanian Transformers ⭐ 55

This repo is the home of Romanian Transformers.

Char_rnn_lm_zh ⭐ 54

language model in Chinese，基于Pytorch官方文档实现

Gap Text2sql ⭐ 51

GAP-text2SQL: Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training

Gilberto ⭐ 50

GilBERTo: A pretrained language model based on RoBERTa for Italian

Two Layer Hierarchical Softmax Pytorch ⭐ 45

Two-Layer Hierarchical Softmax Implementation for PyTorch

Spacy Wrap ⭐ 43

spaCy-wrap is a wrapper library for spaCy for including fine-tuned transformers from Huggingface in your spaCy pipeline allowing you to include existing fine-tuned models within your SpaCy workflow.

Gpt2 French ⭐ 40

GPT-2 French demo | Démo française de GPT-2

Ratransformers ⭐ 38

RATransformers 🐭- Make your transformer (like BERT, RoBERTa, GPT-2 and T5) Relation Aware!

Efficient Attention ⭐ 37

[EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling

Fnet Pytorch ⭐ 36

Unofficial PyTorch implementation of Google's FNet: Mixing Tokens with Fourier Transforms. With checkpoints.

Reweight Gpt ⭐ 36

Reweight GPT - a simple neural network using transformer architecture for next character prediction

Language Pretraining ⭐ 35

Pre-training Language Models for Japanese

Transformers Embedder ⭐ 34

A Word Level Transformer layer based on PyTorch and 🤗 Transformers.

G Universal Clip ⭐ 33

4th place solution for the Google Universal Image Embedding Kaggle Challenge. Instance-Level Recognition workshop at ECCV 2022

Pytorch Definitions ⭐ 30

Conditional Generators of Words Definitions, ACL 2018

Generating Text Small Corpus ⭐ 29

Generating style-specific text from a small corpus of 2.5k sentences using a pre-trained language model. Code in PyTorch

Character-aware Neural Language Model implemented by PyTorch

Sign Language Translator ⭐ 27

Python package to bridge the communication gap between the hearing-impaired and the hearing community using Artificial Intelligence.

Languagemodel Using Attention ⭐ 25

Pytorch implementation of a basic language model using Attention in LSTM network

Highway Transformer ⭐ 25

[ACL‘20] Highway Transformer demo code.

Language Model ⭐ 24

한국어 언어 모델 학습을 위한 프로젝트(Flax, Pytorch with Huggingface Accelerate)

Sdlm Pytorch ⭐ 23

Code accompanying EMNLP 2018 paper Language Modeling with Sparse Product of Sememe Experts

Word Language Model ⭐ 23

Pytorch world language model (text generation) for PTB dataset example

Calm Dialogue ⭐ 23

Official code for the paper "Context-Aware Language Modeling for Goal-Oriented Dialogue Systems"

Meta Transfer Learning ⭐ 22

Implementation of meta-transfer-learning (ACL 2020)

Related Searches

Python Pytorch (15,943)

Deep Learning Pytorch (7,533)

Jupyter Notebook Pytorch (4,892)

Machine Learning Pytorch (2,934)

Dataset Pytorch (1,848)

Pytorch Convolutional Neural Networks (1,777)

Pytorch Neural Network (1,631)

Pytorch Natural Language Processing (1,408)

Pytorch Computer Vision (1,230)

Pytorch Neural (1,217)

1-100 of 128 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.