Awesome Open Source

Programming Languages

Search results for language model

language-model x

921 search results found

Llm Rlhf Tuning ⭐ 225

LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)

Kb Albert ⭐ 224

KB국민은행에서 제공하는 경제/금융 도메인에 특화된 한국어 ALBERT 모델

Parsbert ⭐ 222

🤗 ParsBERT: Transformer-based Model for Persian Language Understanding

Lm Spanish ⭐ 220

Official source for spanish Language Models and resources made @ BSC-TEMU within the "Plan de las Tecnologías del Lenguaje" (Plan-TL).

Domain Adapted Language Modeling Toolkit - E2E RAG

[ICLR 2023] Code for the paper "Binding Language Models in Symbolic Languages"

🐳 Aurora is a [Chinese Version] MoE model. Aurora is a further work based on Mixtral-8x7B, which activates the chat capability of the model's Chinese open domain.

Llm Analysis ⭐ 214

Latency and Memory Analysis of Transformer Models for Training and Inference

Kogpt2 Finetuning ⭐ 212

🔥 Korean GPT-2, KoGPT2 FineTuning cased. 한국어 가사 데이터 학습 🔥

Kaldi-based Korean ASR (한국어 음성인식) open-source project

Lm Scorer ⭐ 206

📃Language Model based sentences scoring library

Protein Sequence Embedding Iclr2019 ⭐ 203

Source code for "Learning protein sequence embeddings using information from structure" - ICLR 2019

A Pytorch Tutorial To Sequence Labeling ⭐ 202

Empower Sequence Labeling with Task-Aware Neural Language Model | a PyTorch Tutorial to Sequence Labeling

Neural Cherche ⭐ 196

Mathpile ⭐ 192

Generative AI for Math: MathPile

Roformer_pytorch ⭐ 192

RoFormer V1 & V2 pytorch

Vocab Coverage ⭐ 191

语言模型中文认知能力分析

Char Rnn Chinese ⭐ 190

Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch. Based on code of https://github.com/karpathy/char-rnn. Support Chinese and other things.

Scalingup ⭐ 189

[CoRL 2023] This repository contains data generation and training code for Scaling Up & Distilling Down

[NeurIPS 2022] DRAGON 🐲: Deep Bidirectional Language-Knowledge Graph Pretraining

Chatgpt Cli ⭐ 187

ChatGPT CLI is an advanced command-line interface for OpenAI's ChatGPT, offering streaming, query mode, and history tracking for seamless and context-aware conversations. Ideal for both users and developers, it provides advanced configuration and easy setup options to ensure a tailored conversational experience with the GPT model.

Open Korean Instructions ⭐ 182

언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.

Neural Language Model ⭐ 180

Implementation of neural language models, in particular Collobert + Weston (2008) and a stochastic margin-based version of Mnih's LBL.

Robbert ⭐ 180

A Dutch RoBERTa-based language model

Intellinode ⭐ 177

Access the latest AI models like ChatGPT, LLaMA, Diffusion, Gemini Hugging face, and beyond through a unified prompt layer and performance evaluation

Xlnet_zh ⭐ 175

中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large

Train very large language models in Jax.

Retromae ⭐ 171

Codebase for RetroMAE and beyond.

Recommendation Systems Without Explicit Id Features A Literature Review ⭐ 171

Large pre-trained Foundation recommender models

Thai2fit ⭐ 169

ULMFit Language Modeling, Text Feature Extraction and Text Classification in Thai Language. Created as part of pyThaiNLP

Llama Lora Tuner ⭐ 168

UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.

Two Are Better Than One ⭐ 168

Code associated with the paper **Two are Better Than One: Joint Entity and Relation Extraction with Table-Sequence Encoders**, at EMNLP 2020

Nlp_learning ⭐ 166

结合python一起学习自然语言处理 (nlp): 语言模型、HMM、PCFG、Word2vec、完形填空式阅读理解任务、朴素贝叶斯分类器、TFIDF、

Xlnet Gen ⭐ 166

XLNet for generating language.

Keras Xlnet ⭐ 165

Implementation of XLNet that can load pretrained checkpoints

Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.

Tldr Transformers ⭐ 163

The "tl;dr" on a few notable transformer papers.

Aiflows ⭐ 161

🤖🌊 aiFlows: The building blocks of your collaborative AI

Pytorch Nce ⭐ 160

The Noise Contrastive Estimation for softmax output written in Pytorch

Perplexity Ai ⭐ 159

Unofficial API Wrapper for Perplexity.ai + Account Generator

Chars2vec ⭐ 157

Character-based word embeddings model based on RNN for handling real world texts

Awesome Nlp Resources ⭐ 157

This repository contains landmark research papers in Natural Language Processing that came out in this century.

Speecht ⭐ 156

An opensource speech-to-text software written in tensorflow

Language Modeling

This is the code for our paper `Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach' (In Proc. of NAACL-HLT 2021).

Doppel Bot ⭐ 155

Train a language model to answer Slack messages as you.

Transformer Lm ⭐ 155

Transformer language model (GPT-2) with sentencepiece tokenizer

EMNLP 2022: Training Language Models with Memory Augmentation https://arxiv.org/abs/2205.12674

Implicit Language Q Learning ⭐ 153

Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"

Gpt J Api ⭐ 152

API for the GPT-J language model 🦜. Including a FastAPI backend and a streamlit frontend

Scienceworld ⭐ 151

ScienceWorld is a text-based virtual environment centered around accomplishing tasks from the standardized elementary science curriculum.

Question_extractor ⭐ 151

Generate question/answer training pairs out of raw text.

Knn Transformers ⭐ 151

PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an implementation of kNN-LM and kNN-MT

Opengpt ⭐ 150

OpenGPT 3.5/4 is a project aimed at providing practical and user-friendly APIs. The APIs allow for easy integration with various applications, making it simple for developers to incorporate the natural language processing capabilities of GPT into their projects.

Gpt Scrolls ⭐ 149

A collaborative collection of open-source safe GPT-3 prompts that work well

Greaselm ⭐ 147

[ICLR 2022 spotlight]GreaseLM: Graph REASoning Enhanced Language Models for Question Answering

Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling

Local Llm Langchain ⭐ 144

Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and KoboldAI versions of the langchain notebooks with examples.

Genomic Pre-trained Network

Chatgpt ⭐ 141

Analysis of OpenAI's ChatGPT

Llama Api Server ⭐ 140

A OpenAI API compatible REST server for llama.

Phi2 Mini Chinese ⭐ 139

Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。 your own Phi2 small chat model from scratch.

Chatgpt Plugins ⭐ 136

This is meant to be a comperehensive list of ChatGPT plugins and plugin-related resources.

Simpletod ⭐ 135

Official repository for "SimpleTOD: A Simple Language Model for Task-Oriented Dialogue"

Grounding_llms_with_online_rl ⭐ 135

We perform functional grounding of LLMs' knowledge in BabyAI-Text

Mlm Scoring ⭐ 135

Python library & examples for Masked Language Model Scoring (ACL 2020)

Nezha_chinese_pytorch ⭐ 135

NEZHA: Neural Contextualized Representation for Chinese Language Understanding

Black Box Tuning ⭐ 133

ICML'2022: Black-Box Tuning for Language-Model-as-a-Service & EMNLP'2022: BBTv2: Towards a Gradient-Free Future with Large Language Models

Tevr Asr Tool ⭐ 132

State-of-the-art (ranked #1 Aug 2022) German Speech Recognition in 284 lines of C++. This is a 100% private 100% offline 100% free CLI tool.

🏭 PDF text extraction pipeline: self-hosted, local-first, Docker-based

Code With Ai ⭐ 131

Interface for people to use my model which predicts which techniques one should use to solve a competitive programming problem to get an AC

A GPT-J API to use with python3 to generate text, blogs, code, and more

Personality Prediction ⭐ 130

Experiments for automated personality detection using Language Models and psycholinguistic features on various famous personality datasets including the Essays dataset (Big-Five)

DSIR large-scale data selection framework for language model training

Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark

Domain Adapted Atsc ⭐ 128

code for our 2019 paper: "Adapt or Get Left Behind: Domain Adaptation through BERT Language Model Finetuning for Aspect-Target Sentiment Classification"

Mc Planner ⭐ 128

Implementation of "Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents"

Mongolian Nlp ⭐ 126

Useful resources for Mongolian NLP

Indonesian Language Models ⭐ 126

Indonesian Language Models and its Usage

Simple speech recognition using your microphone.

Paperreading ⭐ 122

每天阅读过的论文的简要笔记

Keras Gpt 2 ⭐ 121

Load GPT-2 checkpoint and generate texts

Tongrams ⭐ 120

A C++ library providing fast language model queries in compressed space.

Gena_lm ⭐ 120

GENA-LM is a transformer masked language model trained on human DNA sequence.

Bert Sklearn ⭐ 119

a sklearn wrapper for Google's BERT model

Deeponto ⭐ 119

A package for ontology engineering with deep learning and language models.

Sapbert ⭐ 117

[NAACL'21 & ACL'21] SapBERT: Self-alignment pretraining for BERT & XL-BEL: Cross-Lingual Biomedical Entity Linking.

Sent2vec ⭐ 117

How to encode sentences in a high-dimensional vector space, a.k.a., sentence embedding.

Language_modeling_via_stochastic_processes ⭐ 116

Language modeling via stochastic processes. Oral @ ICLR 2022.

Mentalllama ⭐ 116

This repository introduces MentaLLaMA, the first open-source instruction following large language model for interpretable mental health analysis.

Automatic Speech Recognition ⭐ 116

🎧 Automatic Speech Recognition: DeepSpeech & Seq2Seq (TensorFlow)

Dynamic Memory Networks Plus Pytorch ⭐ 115

Implementation of Dynamic memory networks plus in Pytorch

Deep_learning_in_python_2018 ⭐ 114

Deep Learning workshop including image classification, face recognition, Object detection, language modelling, image captioning and neural machine translation.

Python Brain-Computer Interface Software

Camoscio ⭐ 112

Camoscio: An Italian instruction-tuned language model based on LLaMA

Electra ⭐ 112

中文预训练 ELECTRA 模型: 基于对抗学习 pretrain Chinese Model

Korean Safety Benchmarks ⭐ 111

Official datasets and pytorch implementation repository of SQuARe and KoSBi (ACL 2023)

A library to synthesize text datasets using Large Language Models (LLM)

Desktop AI Assistant powered by GPT-4, GPT-4 Vision, GPT-3.5, DALL-E 3, Langchain, Llama-index, chat, vision, image generation and analysis, autonomous, code and commands execution, file upload and download, speech synthesis and recognition, web access, memory, context storage, prompt presets, plugins, assistants and more. Linux, Windows and Mac.

Related Searches

Python Language Model (540)

201-300 of 921 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.