Awesome Open Source

Programming Languages

Search results for language model

language-model x

921 search results found

Llama 2 Open Source Llm Cpu Inference ⭐ 712

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

Trankit ⭐ 693

Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing

Get Things Done With Prompt Engineering And Langchain ⭐ 682

LangChain & Prompt Engineering tutorials on Large Language Models (LLMs) such as ChatGPT with custom data. Jupyter notebooks on loading and indexing data, creating prompt templates, CSV agents, and using retrieval QA chains to query the custom data. Projects for using a private LLM (Llama 2) for chat with PDF files, tweets sentiment analysis.

SkyAGI: Emerging human-behavior simulation capability in LLM

Salesforce open-source LLMs with 8k sequence length.

Primeqa ⭐ 677

The prime repository for state-of-the-art Multilingual Question Answering research and development.

Chatgpt Prompts ⭐ 675

ChatGPT and Bing AI prompt curation

Keras Language Modeling ⭐ 673

📖 Some language modeling tools for Keras

Llm Pruner ⭐ 616

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support LLaMA, Llama-2, BLOOM, Vicuna, Baichuan, etc.

Phobert ⭐ 593

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

Awesome Japanese Llm ⭐ 585

日本語LLMまとめ - Overview of Japanese LLMs

Prompt Tuning ⭐ 580

Original Implementation of Prompt Tuning from Lester, et al, 2021

Nlp Paper ⭐ 579

Ctcdecoder ⭐ 577

Connectionist Temporal Classification (CTC) decoding algorithms: best path, beam search, lexicon search, prefix search, and token passing. Implemented in Python.

Obsidian Ava ⭐ 566

Quickly format your notes with ChatGPT in Obsidian

ACL'2021: LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723

Skychat Chinese Chatbot Gpt3 ⭐ 543

SkyChat是一款基于中文GPT-3 api的聊天机器人项目。它可以像chatGPT一样，实现人机聊天、问答、中英文互译、对对联、写古诗等 SkyChat is a Chatbot project based on Chinese GPT3 API. Like chatGPT, it can do human-machine chat, question and answer, and can also complete tasks such as Chinese-English or English-Chinese translation, content continuation, couplets, and Chinese ancient poems writing.

Bertweet ⭐ 542

BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)

Treasure Of Transformers ⭐ 541

💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️

Nucliadb ⭐ 532

NucliaDB, The AI Search database for unstructured data

Asreview ⭐ 525

Active learning for systematic reviews

Wikichat ⭐ 525

WikiChat stops the hallucination of large language models by retrieving data from Wikipedia.

Awesome Efficient Llm ⭐ 521

A curated list for Efficient Large Language Models

Kg Llm Papers ⭐ 521

[Paper List] Papers integrating knowledge graphs (KGs) and large language models (LLMs)

Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-176B/bloom/gpt/bart/T5/MetaICL)

Sentiment_analysis_fine_grain ⭐ 504

Multi-label Classification with BERT; Fine Grained Sentiment Analysis from AI challenger

Lm Reasoning ⭐ 490

This repository contains a collection of papers and resources on Reasoning in Large Language Models.

Macbert ⭐ 489

Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)

Bluebert ⭐ 485

BlueBERT, pre-trained on PubMed abstracts and clinical notes (MIMIC-III).

Awesome Language Agents ⭐ 479

List of language agents based on paper "Cognitive Architectures for Language Agents"

Starrysky ⭐ 468

精选了千余项目，包括机器学习、深度学习、NLP、GNN、推荐系统、生物医药、机器视觉、前后端开发等内 more than 1000 projects, including machine learning, deep learning, NLP, GNN, recommendation system, biomedicine, machine vision, etc. Let more excellent projects be discovered by people. Continue to update! Welcome to star!

Neural_sp ⭐ 466

End-to-end ASR/LM implementation with PyTorch

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP spec

Ctcwordbeamsearch ⭐ 453

Connectionist Temporal Classification (CTC) decoder with dictionary and language model.

[NAACL 2021] QAGNN: Question Answering using Language Models and Knowledge Graphs 🤖

Happy Transformer ⭐ 449

Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.

Interactive Composition Explorer: a debugger for compositional language model programs

Koelectra ⭐ 448

Pretrained ELECTRA Model for Korean

Crosslingual Generalization through Multitask Finetuning

[NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation

Ckip Transformers ⭐ 439

CKIP Transformers

Ontogpt ⭐ 435

LLM-based ontological extraction tools, including SPIRES

Albert_pytorch ⭐ 423

A Lite Bert For Self-Supervised Learning Language Representations

This is the official code for the paper CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning (NeurIPS22).

Lemur: Open Foundation Models for Language Agents

Zamia Speech ⭐ 413

Open tools and data for cloudless automatic speech recognition

Autoprompt ⭐ 412

AutoPrompt: Automatic Prompt Construction for Masked Language Models.

Clarifai Python ⭐ 384

Experience the power of Clarifai’s AI platform with the python SDK. 🌟 Star to support our work!

Azureml Bert ⭐ 384

End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service

Korean GPT-2 pretrained cased (KoGPT2)

Hyena Dna ⭐ 379

Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena

Official release of the ProGen models

Tf_chatbot_seq2seq_antilm ⭐ 373

Seq2seq chatbot with attention and anti-language model to suppress generic response, option for further improve by deep reinforcement learning.

Openicl ⭐ 372

OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.

Adaptnlp ⭐ 371

An easy to use Natural Language Processing library and framework for predicting, training, fine-tuning, and serving up state-of-the-art NLP models.

Gpu_poor ⭐ 371

Calculate GPU memory requirement & breakdown for training/inference of LLM models. Supports ggml/bnb quantization

Adaptive Softmax ⭐ 368

Implements an efficient softmax approximation as described in the paper "Efficient softmax approximation for GPUs" (http://arxiv.org/abs/1609.04309)

Chatlm Mini Chinese ⭐ 360

中文对话0.2B小模型（ChatLM-Chinese-0.2B），开源所有数据集来源、数据清洗、to

Bio_embeddings ⭐ 357

Get protein embeddings from protein sequences

Dialogstudio ⭐ 356

DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection and Instruction-Aware Models for Conversational AI

Chatgpt Universe ⭐ 354

ChatGPT Universe is fleeting notes on ChatGPT, GPT, and large language models (LLMs)

Devlooper ⭐ 347

A program synthesis agent that autonomously fixes its output by running tests!

Optimus ⭐ 344

Optimus: the first large-scale pre-trained VAE language model

Language modeling and instruction tuning for Russian

pykoi: Active learning in one unified interface

Deep Generative Models For Natural Language Processing ⭐ 330

DGMs for NLP. A roadmap.

Searchgpt ⭐ 313

Grounded search engine (i.e. with source reference) based on LLM / ChatGPT / OpenAI API. It supports web search, file content search etc.

PaL: Program-Aided Language Models

Z Bench ⭐ 306

Z-Bench 1.0 by 真格基金：一个麻瓜的大语言模型中文测试集。Z-Bench is a LLM prompt dataset for non-technical users, developed by an enthusiastic AI-focused team in Zhenfund.

Research code for pixel-based encoders of language (PIXEL)

Nucleotide Transformer ⭐ 305

🧬 Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human Genomics

Flan Alpaca ⭐ 298

This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as Flan-T5.

AI-powered CLI tool to help you remember bash commands.

Language model fine-tuning on NER with an easy interface and cross-domain evaluation. "T-NER: An All-Round Python Library for Transformer-based Named Entity Recognition, EACL 2021"

Attention Mechanisms ⭐ 294

Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with TensorFlow 2.0 and Keras.

Chatbot_data ⭐ 293

Chatbot_data_for_Korean

Guwenbert ⭐ 289

GuwenBERT: 古文预训练语言模型（古文BERT） A Pre-trained Language Model for Classical Chinese (Literary Chinese)

Transfer Nlp ⭐ 281

NLP library designed for reproducible experimentation management

🕵️‍♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach.

Start Llms ⭐ 271

A complete guide to start and improve your LLM skills in 2023 with little background in the field and stay up-to-date with the latest news and state-of-the-art techniques!

Polish Nlp Resources ⭐ 267

Pre-trained models and language resources for Natural Language Processing in Polish

Extreme Bert ⭐ 263

ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.

Interpretability for sequence generation models 🐛 🔍

Chatgpt Prompt Splitter ⭐ 254

ChatGPT PROMPTs Splitter. Tool for safely process chunks of up to 15,000 characters per request

Indic Bert ⭐ 253

BERT-based Multilingual Model for Indian Languages

A copilot for your terminal

Trainable Agents ⭐ 248

Code and datasets for "Character-LLM: A Trainable Agent for Role-Playing"

Electra_pytorch ⭐ 246

Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)

Bert As Language Model ⭐ 245

BERT as language model, fork from https://github.com/google-research/bert

Mead Baseline ⭐ 245

Deep-Learning Model Exploration and Development for NLP

Backprop ⭐ 242

Backprop makes it simple to use, finetune, and deploy state-of-the-art ML models.

Chat.petals.dev ⭐ 240

💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client

Interactive Llm Powered Npcs ⭐ 233

Interactive LLM Powered NPCs, is an open-source project that completely transforms your interaction with non-player characters (NPCs) in any game! 🎮🤖🚀

Langsmith Sdk ⭐ 232

LangSmith Client SDK Implementations

Lotclass ⭐ 231

[EMNLP 2020] Text Classification Using Label Names Only: A Language Model Self-Training Approach

Anchoring Ai ⭐ 229

An open-source no-code tool for teams to collaborate on building, evaluating, and hosting applications leveraging GPT and other large language models. You could easily build and share LLM-powered apps, manage your budget and run batch jobs.

Swe Bench ⭐ 228

[ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues?

Relational Rnn Pytorch ⭐ 228

An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.

Tweetnlp ⭐ 226

TweetNLP for all the NLP enthusiasts working on Twitter! The Python library tweetnlp provides a collection of useful tools to analyze/understand tweets such as sentiment analysis, emoji prediction, and named entity recognition, powered by state-of-the-art language models specialised on Twitter.

Related Searches

Python Language Model (540)

101-200 of 921 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.