Awesome Open Source

Programming Languages

Valuezeroing

The official repo for the EACL 2023 paper "Quantifying Context Mixing in Transformers"

Categories > Machine Learning > Attention Mechanism

Suggest Alternative

Stars

8

License

No license specified

Most Recent Commit

a year ago

Programming Language

Python

Categories

Programming Languages > Python

Machine Learning > Attention Mechanism

Alternatives To Valuezeroing

Select To Compare

Vit Pytorch ⭐ 16,298

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

dependent packages 6total releases 184most recent commit 5 months ago

pypi vit-pytorch} Downloads

Ml Nlp ⭐ 10,874

此项目是机器学习(Machine Learning)、深度学习(Deep Learning)、NLP面试中常考到的知识点和代码实现，也是作为一个算法工程师必会的理论基础知识。

most recent commit 2 years ago

Rwkv Lm ⭐ 10,705

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

most recent commit 4 months ago

Text_classification ⭐ 7,628

all kinds of text classification models and more with deep learning

most recent commit 8 months ago

Palm Rlhf Pytorch ⭐ 7,496

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

total releases 69most recent commit 4 months ago

Dalle Pytorch ⭐ 5,477

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

total releases 174most recent commit 3 months ago

Awesome Graph Classification ⭐ 4,703

A collection of important graph embedding, classification and representation learning papers with implementations.

most recent commit a year ago

Awesome Transformer Attention ⭐ 3,895

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

most recent commit 4 months ago

Transformer ⭐ 3,882

A TensorFlow Implementation of the Transformer: Attention Is All You Need

most recent commit a year ago

X Transformers ⭐ 3,840

A simple but complete full-attention transformer with a set of promising experimental features from various papers

dependent packages 10total releases 317most recent commit 4 months ago

pypi x-transformers} Downloads

Suggest An Alternative To ValueZeroing

Popular Machine Learning Categories

Machine Learning

Natural Language Processing

Computer Vision

Convolutional Neural Networks

Related Searches

Python Attention Mechanism

Python Pre Trained Language Models

Python Contextualized Representation

Python Feature Attribution

Attention Mechanism Pre Trained Language Models

Get A Weekly Email With Trending Projects For These Categories

No Spam. Unsubscribe easily at any time.

Python

Attention Mechanism

Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source. All rights reserved.