Awesome Open Source

Programming Languages

Search results for python language model

language-model x

502 search results found

Transformers ⭐ 124,049

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Gpt4free ⭐ 52,083

The official gpt4free repository | various collection of powerful language models

Open Assistant ⭐ 36,197

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

Stanford_alpaca ⭐ 24,846

Code and documentation to train Stanford's Alpaca models, and generate the data.

Unilm ⭐ 16,971

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Mlc Llm ⭐ 15,290

Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

Haystack ⭐ 12,474

🔍 LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

Llama Factory ⭐ 10,715

Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)

Rwkv Lm ⭐ 10,705

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

NeMo: a toolkit for conversational AI

Chatrwkv ⭐ 8,991

ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

Petals ⭐ 8,040

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Lmflow ⭐ 7,589

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

Speechbrain ⭐ 7,166

A PyTorch-based Speech Toolkit

Introduction_to_ml_with_python ⭐ 6,626

Notebooks and code for the book "Introduction to Machine Learning with Python"

Opennmt Py ⭐ 6,449

Open Source Neural Machine Translation and (Large) Language Models in PyTorch

Gpt Neox ⭐ 6,366

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

Txtai ⭐ 6,143

💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

Bert Pytorch ⭐ 5,605

Google AI 2018 BERT pytorch implementation

Freegpt Webui ⭐ 5,302

GPT 3.5/4 with a Chat Web UI. No API key required.

Codegen ⭐ 4,554

CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.

Agents ⭐ 4,056

An Open-source Framework for Autonomous Language Agents

Lm Evaluation Harness ⭐ 3,768

A framework for few-shot evaluation of language models.

Cogvlm ⭐ 3,690

a state-of-the-art-level open visual language model | 多模态预训练模型

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

Chatgpt Clone ⭐ 3,175

ChatGPT interface with better UI

Chatglm Efficient Tuning ⭐ 3,130

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

Open_flamingo ⭐ 3,115

An open-source framework for training large multimodal models.

Openagents ⭐ 3,044

OpenAgents: An Open Platform for Language Agents in the Wild

Argos Translate ⭐ 2,929

Open-source offline translation library written in Python

Pretrained Language Model ⭐ 2,912

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

A language for constraint-guided and efficient LLM programming.

Lingvo ⭐ 2,776

Docta ⭐ 2,472

A Doctor for your data

Codet5 ⭐ 2,456

Home of CodeT5: Open Code LLMs for Code Understanding and Generation

Xturing ⭐ 2,392

Easily build, customize and control your own LLMs

Keras Bert ⭐ 2,281

Implementation of BERT that could load official pre-trained models for feature extraction and prediction

Easylm ⭐ 2,087

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

Mixtral Offloading ⭐ 1,943

Run Mixtral-8x7B models in Colab or consumer desktops

Lazynlp ⭐ 1,867

Library to scrape and clean web pages to create massive datasets.

Awd Lstm Lm ⭐ 1,838

LSTM and QRNN Language Model Toolkit for PyTorch

Awesome Sentence Embedding ⭐ 1,831

A curated list of pretrained sentence and word embedding models

🏡 Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

Deberta ⭐ 1,673

The implementation of DeBERTa

Openseq2seq ⭐ 1,393

Toolkit for efficient experimentation with Speech Recognition, Text2Speech and NLP

Spacy Transformers ⭐ 1,302

🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy

Basaran ⭐ 1,279

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

Chinese Electra ⭐ 1,253

Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）

Prismer ⭐ 1,245

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

Pytorch Openai Transformer Lm ⭐ 1,182

🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI

Self Instruct ⭐ 1,156

Aligning pretrained language models with instruction data generated by themselves.

Macaw Llm ⭐ 1,090

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration

Chineseaidungeonchatgpt ⭐ 1,057

中文版的ai地牢，直接使用的openai的ChatGPT api作为讲故事的模型。

Motiongpt ⭐ 1,018

[NeurIPS 2023] MotionGPT: Human Motion as a Foreign Language, a unified motion-language generation model using LLMs

Langroid ⭐ 988

Harness LLMs with Multi-Agent Programming

Transformers4rec ⭐ 974

Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.

Pykaldi ⭐ 954

A Python wrapper for Kaldi

Bert_language_understanding ⭐ 886

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

Quillman ⭐ 880

A chat app that transcribes audio in real-time, streams back a response from a language model, and synthesizes this response as natural-sounding speech.

An Open-sourced Knowledgable Large Language Model Framework.

Lm Lstm Crf ⭐ 830

Empower Sequence Labeling with Task-Aware Language Model

Codes and Model of the paper "Text-to-Audio Generation using Instruction Tuned LLM and Latent Diffusion Model"

ToRA is a series of Tool-integrated Reasoning LLM Agents designed to solve challenging mathematical reasoning problems by interacting with tools.

Lightnlp ⭐ 725

基于Pytorch和torchtext的自然语言处理深度学习框架。

Llama 2 Open Source Llm Cpu Inference ⭐ 712

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

Trankit ⭐ 693

Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing

Get Things Done With Prompt Engineering And Langchain ⭐ 682

LangChain & Prompt Engineering tutorials on Large Language Models (LLMs) such as ChatGPT with custom data. Jupyter notebooks on loading and indexing data, creating prompt templates, CSV agents, and using retrieval QA chains to query the custom data. Projects for using a private LLM (Llama 2) for chat with PDF files, tweets sentiment analysis.

Salesforce open-source LLMs with 8k sequence length.

Primeqa ⭐ 677

The prime repository for state-of-the-art Multilingual Question Answering research and development.

Keras Language Modeling ⭐ 673

📖 Some language modeling tools for Keras

Phobert ⭐ 593

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

Prompt Tuning ⭐ 580

Original Implementation of Prompt Tuning from Lester, et al, 2021

Ctcdecoder ⭐ 577

Connectionist Temporal Classification (CTC) decoding algorithms: best path, beam search, lexicon search, prefix search, and token passing. Implemented in Python.

ACL'2021: LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723

Skychat Chinese Chatbot Gpt3 ⭐ 543

SkyChat是一款基于中文GPT-3 api的聊天机器人项目。它可以像chatGPT一样，实现人机聊天、问答、中英文互译、对对联、写古诗等 SkyChat is a Chatbot project based on Chinese GPT3 API. Like chatGPT, it can do human-machine chat, question and answer, and can also complete tasks such as Chinese-English or English-Chinese translation, content continuation, couplets, and Chinese ancient poems writing.

Bertweet ⭐ 542

BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)

Treasure Of Transformers ⭐ 541

💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️

Nucliadb ⭐ 532

NucliaDB, The AI Search database for unstructured data

Wikichat ⭐ 525

WikiChat stops the hallucination of large language models by retrieving data from Wikipedia.

Asreview ⭐ 525

Active learning for systematic reviews

Awesome Efficient Llm ⭐ 521

A curated list for Efficient Large Language Models

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP spec

Neural_sp ⭐ 466

End-to-end ASR/LM implementation with PyTorch

[NAACL 2021] QAGNN: Question Answering using Language Models and Knowledge Graphs 🤖

Happy Transformer ⭐ 449

Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.

Koelectra ⭐ 448

Pretrained ELECTRA Model for Korean

Interactive Composition Explorer: a debugger for compositional language model programs

Ckip Transformers ⭐ 439

CKIP Transformers

Albert_pytorch ⭐ 423

A Lite Bert For Self-Supervised Learning Language Representations

This is the official code for the paper CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning (NeurIPS22).

Lemur: Open Foundation Models for Language Agents

Autoprompt ⭐ 412

AutoPrompt: Automatic Prompt Construction for Masked Language Models.

Clarifai Python ⭐ 384

Experience the power of Clarifai’s AI platform with the python SDK. 🌟 Star to support our work!

Official release of the ProGen models

Tf_chatbot_seq2seq_antilm ⭐ 373

Seq2seq chatbot with attention and anti-language model to suppress generic response, option for further improve by deep reinforcement learning.

Openicl ⭐ 372

OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.

Chatlm Mini Chinese ⭐ 360

中文对话0.2B小模型（ChatLM-Chinese-0.2B），开源所有数据集来源、数据清洗、to

Dialogstudio ⭐ 356

DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection and Instruction-Aware Models for Conversational AI

Devlooper ⭐ 347

A program synthesis agent that autonomously fixes its output by running tests!

Related Searches

Python Jupyter Notebook (21,947)

Python Dataset (14,792)

Python Docker (14,113)

Python Machine Learning (14,099)

Python Tensorflow (13,736)

Python Deep Learning (13,092)

Python Natural Language Processing (9,064)

Python Artificial Intelligence (8,580)

Python Pytorch (7,877)

Python Neural (7,444)

1-100 of 502 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.