The Top 23 Pytorch Transformer Open Source Projects

Open source projects categorized as Pytorch Transformer

Categories > Machine Learning > Pytorch

Categories > User Interface Components > Transformer

Transformers ⭐ 124,049

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

dependent packages 2,484total releases 125most recent commit 13 days ago

Annotated_deep_learning_paper_implementations ⭐ 41,877

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

dependent packages 2total releases 79most recent commit 3 months ago

Mmdetection ⭐ 26,886

OpenMMLab Detection Toolbox and Benchmark

dependent packages 31total releases 52most recent commit 3 months ago

Vit Pytorch ⭐ 16,298

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

dependent packages 6total releases 184most recent commit 4 months ago

Best Of Ml Python ⭐ 14,990

🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

most recent commit 3 months ago

Awesome Pytorch List ⭐ 14,715

A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.

most recent commit 3 months ago

Vllm ⭐ 13,832

A high-throughput and memory-efficient inference and serving engine for LLMs

dependent packages 14total releases 14most recent commit 3 months ago

Nlp Tutorial ⭐ 13,226

Natural Language Processing Tutorial for Deep Learning Researchers

most recent commit 5 months ago

Sentence Transformers ⭐ 12,951

Multilingual Sentence & Image Embeddings with BERT

dependent packages 593total releases 43most recent commit 3 months ago

Haystack ⭐ 12,474

🔍 LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

dependent packages 30total releases 100most recent commit 3 months ago

Peft ⭐ 12,271

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

dependent packages 101total releases 11most recent commit 3 months ago

Rwkv Lm ⭐ 10,705

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

most recent commit 3 months ago

Latex Ocr ⭐ 8,088

pix2tex: Using a ViT to convert images of equations into LaTeX code.

total releases 31most recent commit 5 months ago

Petals ⭐ 8,040

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

dependent packages 1total releases 18most recent commit 4 months ago

Lmflow ⭐ 7,589

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

most recent commit 3 months ago

Espnet ⭐ 7,563

End-to-End Speech Processing Toolkit

dependent packages 5total releases 33most recent commit 3 months ago

Speechbrain ⭐ 7,166

A PyTorch-based Speech Toolkit

most recent commit 3 months ago

Mmsegmentation ⭐ 6,974

OpenMMLab Semantic Segmentation Toolbox and Benchmark.

dependent packages 7total releases 46most recent commit 3 months ago

Text Generation Inference ⭐ 6,743

Large Language Model Text Generation Inference

dependent packages 5total releases 13most recent commit 3 months ago

Transformers Tutorials ⭐ 6,731

This repository contains demos I made with the Transformers library by HuggingFace.

most recent commit 3 months ago

Ml Engineering ⭐ 6,720

Machine Learning Engineering Open Book

most recent commit 3 months ago

Jukebox ⭐ 6,597

Code for the paper "Jukebox: A Generative Model for Music"

most recent commit a year ago

Bert Pytorch ⭐ 5,605

Google AI 2018 BERT pytorch implementation

total releases 5most recent commit 9 months ago

The 10 Most Depended On Pytorch Transformer Open Source Projects

Transformers ⭐ 124,049

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

dependent packages 2,484total releases 125latest release November 15, 2023most recent commit 13 days ago

Sentence Transformers ⭐ 12,951

Multilingual Sentence & Image Embeddings with BERT

dependent packages 593total releases 43latest release June 26, 2022most recent commit 3 months ago

Peft ⭐ 12,271

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

dependent packages 101total releases 11latest release December 06, 2023most recent commit 3 months ago

Optimum ⭐ 1,908

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

dependent packages 53total releases 53latest release December 06, 2023most recent commit 3 months ago

Mmdetection ⭐ 26,886

OpenMMLab Detection Toolbox and Benchmark

dependent packages 31total releases 52latest release October 12, 2023most recent commit 3 months ago

Haystack ⭐ 12,474

:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

dependent packages 30total releases 100latest release November 09, 2023most recent commit 3 months ago

Vllm ⭐ 13,832

A high-throughput and memory-efficient inference and serving engine for LLMs

dependent packages 14total releases 14latest release December 03, 2023most recent commit 3 months ago

Zeta ⭐ 106

Build high-performance AI models with modular building blocks

dependent packages 13total releases 71latest release November 30, 2023most recent commit 3 months ago

Bigdl ⭐ 4,728

Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using bigdl-llm

dependent packages 10total releases 16latest release April 19, 2021most recent commit 3 months ago

Adapters ⭐ 2,354

A Unified Library for Parameter-Efficient and Modular Transfer Learning

dependent packages 7total releases 18latest release April 06, 2023most recent commit a month ago

The 10 Latest Releases In Pytorch Transformer Open Source Projects

Bert4torch ⭐ 1,035

An elegent pytorch implement of transformers

dependent packages 1total releases 35latest release December 09, 2023most recent commit 3 months ago

Whisper Timestamped ⭐ 1,217

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

dependent packages 3total releases 3latest release December 08, 2023most recent commit 3 months ago

Swissarmytransformer ⭐ 803

SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

dependent packages 1total releases 39latest release December 07, 2023most recent commit 3 months ago

Peft ⭐ 12,271

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

dependent packages 101total releases 11latest release December 06, 2023most recent commit 3 months ago

Optimum ⭐ 1,908

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

dependent packages 53total releases 53latest release December 06, 2023most recent commit 3 months ago

Label Sleuth ⭐ 230

Open source no-code system for text annotation and building of text classifiers

total releases 66latest release December 04, 2023most recent commit 4 months ago

Vllm ⭐ 13,832

A high-throughput and memory-efficient inference and serving engine for LLMs

dependent packages 14total releases 14latest release December 03, 2023most recent commit 3 months ago

Zeta ⭐ 106

Build high-performance AI models with modular building blocks

dependent packages 13total releases 71latest release November 30, 2023most recent commit 3 months ago

Easydel ⭐ 83

EasyDeL is an OpenSource Library to make your training faster and more Optimized With cool Options for training and serving Both in Python And Mojo🔥

dependent packages 1total releases 38latest release November 22, 2023most recent commit 3 months ago

Flash Attention Softmax N ⭐ 41

CUDA and Triton implementations of Flash Attention with SoftmaxN.

total releases 11latest release November 21, 2023most recent commit 5 months ago

Popular Machine Learning Categories

Natural Language Processing

Neural Network

Neural

Computer Vision

Convolutional Neural Networks

Opencv