Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Transformer Language Model Open Source Projects

Open source projects categorized as Python Transformer Language Model
Transformers ⭐ 124,049
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
dependent packages 2,484total releases 125most recent commit 15 days agopypi transformers} Downloads
Haystack ⭐ 12,474
🔍 LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
dependent packages 30total releases 100most recent commit 3 months agopypi farm-haystack} Downloads
Llama Factory ⭐ 10,715
Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)
total releases 19most recent commit 3 months ago
Rwkv Lm ⭐ 10,705
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
most recent commit 3 months ago
Petals ⭐ 8,040
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
dependent packages 1total releases 18most recent commit 4 months agopypi petals} Downloads
Lmflow ⭐ 7,589
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
most recent commit 3 months ago
Speechbrain ⭐ 7,166
A PyTorch-based Speech Toolkit
most recent commit 3 months ago
Gpt Neox ⭐ 6,366
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
most recent commit 3 months ago
Txtai ⭐ 6,143
💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
dependent packages 9total releases 35most recent commit 3 months agopypi txtai} Downloads
Bert Pytorch ⭐ 5,605
Google AI 2018 BERT pytorch implementation
total releases 5most recent commit 9 months ago
Lm Evaluation Harness ⭐ 3,768
A framework for few-shot evaluation of language models.
dependent packages 3total releases 3most recent commit 3 months agopypi lm-eval} Downloads
Clue ⭐ 3,345
中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
most recent commit a year ago
Chatglm Efficient Tuning ⭐ 3,130
Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
total releases 6most recent commit 6 months ago
Argos Translate ⭐ 2,929
Open-source offline translation library written in Python
dependent packages 14total releases 30most recent commit 3 months agopypi argostranslate} Downloads
Easylm ⭐ 2,087
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
most recent commit 4 months ago
Spacy Transformers ⭐ 1,302
🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
dependent packages 6total releases 7most recent commit 4 months ago
Basaran ⭐ 1,279
Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
most recent commit 3 months ago
Pytorch Openai Transformer Lm ⭐ 1,182
🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI
most recent commit 5 years ago
Transformers4rec ⭐ 974
Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.
total releases 20most recent commit 3 months ago
Bert_language_understanding ⭐ 886
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
most recent commit 5 years ago
Llama 2 Open Source Llm Cpu Inference ⭐ 712
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
most recent commit 8 months ago
Trankit ⭐ 693
Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
dependent packages 2total releases 20most recent commit 5 months agopypi trankit} Downloads
Phobert ⭐ 593
PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)
most recent commit 4 months ago
The 10 Most Depended On Python Transformer Language Model Open Source Projects
Transformers ⭐ 124,049
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
dependent packages 2,484total releases 125latest release November 15, 2023most recent commit 15 days agopypi transformers} Downloads
Argos Translate ⭐ 2,929
Open-source offline translation library written in Python
dependent packages 14total releases 30latest release October 21, 2023most recent commit 3 months agopypi argostranslate} Downloads
Txtai ⭐ 6,143
💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
dependent packages 9total releases 35latest release November 08, 2023most recent commit 3 months agopypi txtai} Downloads
Spacy Transformers ⭐ 1,302
🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
dependent packages 6total releases 7latest release May 25, 2023most recent commit 4 months ago
Happy Transformer ⭐ 449
Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.
dependent packages 5total releases 23latest release August 05, 2023most recent commit 9 months agopypi happytransformer} Downloads
Lm Evaluation Harness ⭐ 3,768
A framework for few-shot evaluation of language models.
dependent packages 3total releases 3latest release December 08, 2022most recent commit 3 months agopypi lm-eval} Downloads
Trankit ⭐ 693
Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
dependent packages 2total releases 20latest release March 26, 2022most recent commit 5 months agopypi trankit} Downloads
The 10 Latest Releases In Python Transformer Language Model Open Source Projects
Inseq ⭐ 254
Interpretability for sequence generation models 🐛 🔍
total releases 6latest release December 07, 2023most recent commit 3 months ago
Llama Factory ⭐ 10,715
Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)
total releases 19latest release December 03, 2023most recent commit 3 months ago
Petals ⭐ 8,040
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
dependent packages 1total releases 18latest release November 20, 2023most recent commit 4 months agopypi petals} Downloads
Minicons ⭐ 77
Utility for analyzing Transformer based representations of language.
total releases 45latest release November 17, 2023most recent commit 3 months ago
Transformers ⭐ 124,049
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
dependent packages 2,484total releases 125latest release November 15, 2023most recent commit 15 days agopypi transformers} Downloads
Txtai ⭐ 6,143
💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
dependent packages 9total releases 35latest release November 08, 2023most recent commit 3 months agopypi txtai} Downloads
Argos Translate ⭐ 2,929
Open-source offline translation library written in Python
dependent packages 14total releases 30latest release October 21, 2023most recent commit 3 months agopypi argostranslate} Downloads
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.