Awesome Open Source

Programming Languages

Search results for language model

language-model x

921 search results found

Transformers ⭐ 127,491

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Gpt4free ⭐ 52,083

The official gpt4free repository | various collection of powerful language models

Prompt Engineering Guide ⭐ 45,478

🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

Open Assistant ⭐ 36,197

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

Stanford_alpaca ⭐ 24,846

Code and documentation to train Stanford's Alpaca models, and generate the data.

Generative Ai For Beginners ⭐ 23,219

12 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-begi

Unilm ⭐ 16,971

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Mlc Llm ⭐ 15,290

Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

Haystack ⭐ 12,474

🔍 LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

Llama Factory ⭐ 10,715

Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)

Rwkv Lm ⭐ 10,705

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

NeMo: a toolkit for conversational AI

Chatrwkv ⭐ 8,991

ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

Nlp_chinese_corpus ⭐ 8,344

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

Web Llm ⭐ 8,290

Bringing large-language models and chat to web browsers. Everything runs inside the browser with no server support.

Gpt Neo ⭐ 8,115

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

Tokenizers ⭐ 8,056

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Petals ⭐ 8,040

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Lmflow ⭐ 7,589

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

Open_clip ⭐ 7,355

An open source implementation of CLIP.

Speechbrain ⭐ 7,166

A PyTorch-based Speech Toolkit

Introduction_to_ml_with_python ⭐ 6,626

Notebooks and code for the book "Introduction to Machine Learning with Python"

Opennmt Py ⭐ 6,449

Open Source Neural Machine Translation and (Large) Language Models in PyTorch

Gpt Neox ⭐ 6,366

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

Txtai ⭐ 6,143

💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

Build AI-powered applications with React, Svelte, Vue, and Solid

Bert Pytorch ⭐ 5,605

Google AI 2018 BERT pytorch implementation

Freegpt Webui ⭐ 5,302

GPT 3.5/4 with a Chat Web UI. No API key required.

Codegen ⭐ 4,554

CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.

Agents ⭐ 4,056

An Open-source Framework for Autonomous Language Agents

Turbopilot ⭐ 3,841

Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU

Lm Evaluation Harness ⭐ 3,768

A framework for few-shot evaluation of language models.

Cogvlm ⭐ 3,690

a state-of-the-art-level open visual language model | 多模态预训练模型

Spark Nlp ⭐ 3,578

State of the Art Natural Language Processing

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

Chatgpt Clone ⭐ 3,175

ChatGPT interface with better UI

Lmops ⭐ 3,145

General technology for enabling AI capabilities w/ LLMs and MLLMs

Chatglm Efficient Tuning ⭐ 3,130

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

Open_flamingo ⭐ 3,115

An open-source framework for training large multimodal models.

Openagents ⭐ 3,044

OpenAgents: An Open Platform for Language Agents in the Wild

Linly ⭐ 2,964

Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集

Argos Translate ⭐ 2,929

Open-source offline translation library written in Python

A language for constraint-guided and efficient LLM programming.

Awesome Speech Recognition Speech Synthesis Papers ⭐ 2,869

Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)

Lingvo ⭐ 2,776

Docta ⭐ 2,472

A Doctor for your data

Codet5 ⭐ 2,456

Home of CodeT5: Open Code LLMs for Code Understanding and Generation

Xturing ⭐ 2,392

Easily build, customize and control your own LLMs

Keras Bert ⭐ 2,281

Implementation of BERT that could load official pre-trained models for feature extraction and prediction

Easylm ⭐ 2,087

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

Ru Gpts ⭐ 2,053

Russian GPT3 models.

Mixtral Offloading ⭐ 1,943

Run Mixtral-8x7B models in Colab or consumer desktops

Lazynlp ⭐ 1,867

Library to scrape and clean web pages to create massive datasets.

Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).

Awd Lstm Lm ⭐ 1,838

LSTM and QRNN Language Model Toolkit for PyTorch

Awesome Sentence Embedding ⭐ 1,831

A curated list of pretrained sentence and word embedding models

Pytorch Cpp ⭐ 1,710

C++ Implementation of PyTorch Tutorials for Everyone

Autodoc ⭐ 1,708

Experimental toolkit for auto-generating codebase documentation using LLMs

🏡 Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

Zep: Fast, scalable building blocks for production LLM apps

Spago ⭐ 1,691

Self-contained Machine Learning and Natural Language Processing library in Go

Deberta ⭐ 1,673

The implementation of DeBERTa

Instructor Embedding ⭐ 1,630

[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings

Openseq2seq ⭐ 1,393

Toolkit for efficient experimentation with Speech Recognition, Text2Speech and NLP

Spacy Transformers ⭐ 1,302

🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy

Basaran ⭐ 1,279

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

Chinese Electra ⭐ 1,253

Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）

Prismer ⭐ 1,245

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

Awesome Llm Kg ⭐ 1,198

Awesome papers about unifying LLMs and KGs

Pytorch Openai Transformer Lm ⭐ 1,182

🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI

Cramming ⭐ 1,167

Cramming the training of a (BERT-type) language model into limited compute.

Self Instruct ⭐ 1,156

Aligning pretrained language models with instruction data generated by themselves.

Macaw Llm ⭐ 1,090

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration

Chineseaidungeonchatgpt ⭐ 1,057

中文版的ai地牢，直接使用的openai的ChatGPT api作为讲故事的模型。

Awesome Transformer Nlp ⭐ 1,039

A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.

Awesome Llm Reasoning ⭐ 1,035

Papers and resources on Reasoning in Language Models (LLMs), including Chain-of-Thought, Instruction-Tuning, Multimodality.

Kobert ⭐ 1,035

Korean BERT pre-trained cased (KoBERT)

Motiongpt ⭐ 1,018

[NeurIPS 2023] MotionGPT: Human Motion as a Foreign Language, a unified motion-language generation model using LLMs

Langroid ⭐ 988

Harness LLMs with Multi-Agent Programming

Transformers4rec ⭐ 974

Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.

Rwkv.cpp ⭐ 956

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

Nlp Library ⭐ 955

curated collection of papers for the nlp practitioner 📖👩‍🔬

Pykaldi ⭐ 954

A Python wrapper for Kaldi

Awesome Instruction Dataset ⭐ 922

A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)

Bert_language_understanding ⭐ 886

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

Paper Reading ⭐ 883

📖 Paper reading list in dialogue systems and natural language generation (constantly updating 🤗).

Quillman ⭐ 880

A chat app that transcribes audio in real-time, streams back a response from a language model, and synthesizes this response as natural-sounding speech.

An Open-sourced Knowledgable Large Language Model Framework.

Dl Nlp Readings ⭐ 847

My Reading Lists of Deep Learning and Natural Language Processing

Large-scale pretrained models for goal-directed dialog

Lm Lstm Crf ⭐ 830

Empower Sequence Labeling with Task-Aware Language Model

Finbert ⭐ 822

Financial Sentiment Analysis with BERT

Lstm Char Cnn ⭐ 812

LSTM language model with CNN over characters

Codes and Model of the paper "Text-to-Audio Generation using Instruction Tuned LLM and Latent Diffusion Model"

Yobulkdev ⭐ 786

🔥 🔥 🔥Open Source & AI driven Data Onboarding Platform:Free flatfile.com alternative

SGPT: GPT Sentence Embeddings for Semantic Search

ToRA is a series of Tool-integrated Reasoning LLM Agents designed to solve challenging mathematical reasoning problems by interacting with tools.

Lightnlp ⭐ 725

基于Pytorch和torchtext的自然语言处理深度学习框架。

Prompt4reasoningpapers ⭐ 717

Repository for the ACL2023 paper "Reasoning with Language Model Prompting: A Survey".

Related Searches

Python Language Model (540)

1-100 of 921 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.