Pretraining For Language Understanding

Pre-training of Language Models for Language Understanding
Alternatives To Pretraining For Language Understanding
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Transformers122,228642,48412 days ago125November 15, 2023946apache-2.0Python
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Haystack12,474302 months ago100November 09, 2023346apache-2.0Python
:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
Rwkv Lm10,705
2 months ago60apache-2.0Python
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
Chatrwkv8,99113 months ago46November 17, 202342apache-2.0Python
ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
Petals8,04014 months ago18November 20, 202376mitPython
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Lora7,814163 months ago3August 27, 202379mitPython
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
Lmflow7,589
2 months ago29apache-2.0Python
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
Open_clip7,355543 months ago42October 24, 2023130otherJupyter Notebook
An open source implementation of CLIP.
Speechbrain7,166
2 months ago149apache-2.0Python
A PyTorch-based Speech Toolkit
Opennmt Py6,449282 months ago35November 02, 202336mitPython
Open Source Neural Machine Translation and (Large) Language Models in PyTorch
Alternatives To Pretraining For Language Understanding
Select To Compare


Alternative Project Comparisons
Popular Language Model Projects
Popular Pytorch Projects
Popular Machine Learning Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Pytorch
Language
Natural Language Processing
Lstm
Corpus
Language Model
Pytorch Tutorial