Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Ml Nlp | 10,874 | 2 years ago | 29 | Jupyter Notebook | ||||||
此项目是机器学习(Machine Learning)、深度学习(Deep Learning)、NLP面试中常考到的知识点和代码实现,也是作为一个算法工程师必会的理论基础知识。 | ||||||||||
Rwkv Lm | 10,705 | 3 months ago | 60 | apache-2.0 | Python | |||||
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding. | ||||||||||
Palm Rlhf Pytorch | 7,496 | 3 months ago | 69 | January 26, 2023 | 14 | mit | Python | |||
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM | ||||||||||
Dalle Pytorch | 5,477 | 2 months ago | 174 | May 30, 2022 | 125 | mit | Python | |||
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch | ||||||||||
Awesome Transformer Attention | 3,895 | 3 months ago | 15 | |||||||
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites | ||||||||||
X Transformers | 3,840 | 10 | 3 months ago | 317 | December 02, 2023 | 55 | mit | Python | ||
A simple but complete full-attention transformer with a set of promising experimental features from various papers | ||||||||||
Keras Attention | 2,794 | 5 months ago | 2 | apache-2.0 | Python | |||||
Keras Attention Layer (Luong and Bahdanau scores). | ||||||||||
Musiclm Pytorch | 2,686 | 8 months ago | 38 | September 06, 2023 | 18 | mit | Python | |||
Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch | ||||||||||
Audiolm Pytorch | 2,112 | 5 | 3 months ago | 311 | December 02, 2023 | 36 | mit | Python | ||
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch | ||||||||||
Pytorch Gat | 1,815 | a year ago | 12 | mit | Jupyter Notebook | |||||
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples! |