Project Name	Stars	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Colt5 Attention	207	5	5 months ago	69	December 02, 2023	2	mit	Python
Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
Routing Transformer	202		2 years ago	79	November 06, 2021	9	mit	Python
Fully featured implementation of Routing Transformer

Alternatives To Colt5 Attention

Select To Compare

Colt5 Attention ⭐ 207

Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch

dependent packages 5total releases 69most recent commit 5 months ago

Routing Transformer ⭐ 202

Fully featured implementation of Routing Transformer

total releases 79most recent commit 2 years ago

Suggest An Alternative To CoLT5-attention

Alternative Project Comparisons

Colt5 Attention vs Routing Transformer

Popular Routing Projects

Ice ⭐ 17,738

🚀 ice.js: The Progressive App Framework Based On React（基于 React 的渐进式应用框架）

dependent packages 609total releases 24latest release April 21, 2022most recent commit 3 months ago

Httprouter ⭐ 15,983

A high performance HTTP request router that scales well

dependent packages 2,554total releases 12latest release August 14, 2020most recent commit 5 months ago

Umi ⭐ 14,698

A framework in react community ✨

dependent packages 1,966total releases 494latest release December 04, 2023most recent commit 3 months ago

Clash Rules ⭐ 14,107

🦄️ 🎃 👻 Clash Premium 规则集(RULE-SET)，兼容 ClashX Pro、Clash for Windows 客户端。

most recent commit 3 months ago

Ui Router ⭐ 13,640

The de-facto solution to flexible routing with nested views in AngularJS

dependent packages 673total releases 56latest release December 01, 2021most recent commit a year ago

Popular Attention Mechanism Projects

Vit Pytorch ⭐ 16,298

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

dependent packages 6total releases 184latest release November 15, 2023most recent commit 4 months ago

Ml Nlp ⭐ 10,874

此项目是机器学习(Machine Learning)、深度学习(Deep Learning)、NLP面试中常考到的知识点和代码实现，也是作为一个算法工程师必会的理论基础知识。

most recent commit 2 years ago

Rwkv Lm ⭐ 10,705

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

most recent commit 3 months ago

Text_classification ⭐ 7,628

all kinds of text classification models and more with deep learning

most recent commit 7 months ago

Palm Rlhf Pytorch ⭐ 7,496

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

total releases 69latest release January 26, 2023most recent commit 3 months ago

Popular Networking Categories