Project Name	Stars	Most Recent Commit	Open Issues	License	Language
Gpt Neox	6,366	3 months ago	81	apache-2.0	Python
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
Pranet	344	9 months ago	1		Python
PraNet: Parallel Reverse Attention Network for Polyp Segmentation, MICCAI 2020 (Oral). Code using Jittor Framework is available.
Prime	80	9 months ago	1	other	Python
A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.

Alternatives To Gpt Neox

Select To Compare

Gpt Neox ⭐ 6,366

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

most recent commit 3 months ago

Pranet ⭐ 344

PraNet: Parallel Reverse Attention Network for Polyp Segmentation, MICCAI 2020 (Oral). Code using Jittor Framework is available.

most recent commit 9 months ago

Prime ⭐ 80

A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.

most recent commit 9 months ago

Suggest An Alternative To gpt-neox

Alternative Project Comparisons

Gpt Neox vs Pranet

Gpt Neox vs Prime

Popular Parallel Projects

Ray ⭐ 29,596

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

dependent packages 363total releases 95latest release December 04, 2023most recent commit 3 months ago

Tqdm ⭐ 26,694

:zap: A Fast, Extensible Progress Bar for Python and CLI

dependent packages 15,455total releases 135latest release August 10, 2023most recent commit 4 months ago

Lightgbm ⭐ 15,999

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

dependent packages 574total releases 34latest release September 12, 2023most recent commit 20 days ago

Workflow ⭐ 12,038

C++ Parallel Computing and Asynchronous Networking Framework

most recent commit 3 months ago

Razzle ⭐ 11,092

✨ Create server-rendered universal JavaScript applications with no configuration

dependent packages 104total releases 225latest release October 25, 2022most recent commit a year ago

Popular Attention Projects

Annotated_deep_learning_paper_implementations ⭐ 41,877

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

dependent packages 2total releases 79latest release November 05, 2023most recent commit 3 months ago

Vit Pytorch ⭐ 16,298

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

dependent packages 6total releases 184latest release November 15, 2023most recent commit 4 months ago

Numpy Ml ⭐ 14,162

Machine learning, in numpy

total releases 3latest release June 20, 2020most recent commit 6 months ago

Nlp Tutorial ⭐ 13,226

Natural Language Processing Tutorial for Deep Learning Researchers

most recent commit 5 months ago

External Attention Pytorch ⭐ 10,361

🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐

total releases 2latest release September 27, 2022most recent commit 3 months ago

Popular Control Flow Categories