Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Artificial Intelligence Attention Mechanism Open Source Projects

Open source projects categorized as Python Artificial Intelligence Attention Mechanism
Categories > Artificial Intelligence > Artificial Intelligence
Categories > Machine Learning > Attention Mechanism
Htm Pytorch ⭐ 27
Implementation of Hierarchical Transformer Memory (HTM) for Pytorch
total releases 4most recent commit 3 years ago
Pause Transformer ⭐ 24
Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount of time on any token
most recent commit 6 months ago
Omninet Pytorch ⭐ 24
Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch
total releases 5most recent commit 3 years ago
Tranception Pytorch ⭐ 24
Implementation of Tranception, an attention network, paired with retrieval, that is SOTA for protein fitness prediction
total releases 6most recent commit 2 years ago
Complex Valued Transformer ⭐ 24
Implementation of the transformer proposed in "Building Blocks for a Complex-Valued Transformer Architecture"
most recent commit 7 months ago
Compositional Attention Pytorch ⭐ 23
Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process with disentangled search and retrieval head aggregation, in Pytorch
total releases 1most recent commit 2 years ago
Mengzi Retrieval Lm ⭐ 23
An experimental implementation of the retrieval-enhanced language model
most recent commit a year ago
Protein Localization Transformer ⭐ 22
Code for CELL-E: Biological Zero-Shot Text-to-Image Synthesis for Protein Localization Prediction
most recent commit 7 months ago
Transframer Pytorch ⭐ 22
Implementation of Transframer, Deepmind's U-net + Transformer architecture for up to 30 seconds video generation, in Pytorch
most recent commit 2 years ago
Sharkticon ⭐ 20
Sharkticon is an anomaly detection system, it analyzes your network using a Transformers model adapted to the anomaly detection.
most recent commit a year ago
Im4mec ⭐ 17
Code for the im4MEC model described in the paper 'Interpretable deep learning model to predict the molecular classification of endometrial cancer from haematoxylin and eosin-stained whole-slide images: a combined analysis of the PORTEC randomised trials and clinical cohorts'.
most recent commit 7 months ago
Autort ⭐ 16
Implementation of AutoRT: "AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents"
most recent commit 4 months ago
Chappie.ai ⭐ 15
Generalized AI to perform a multitude of tasks written in python3
most recent commit a year ago
Ddpm Ipa Protein Generation ⭐ 14
Implementation of the DDPM + IPA (invariant point attention) for protein generation, as outlined in the paper "Protein Structure and Sequence Generation with Equivariant Denoising Diffusion Probabilistic Models"
most recent commit 2 years ago
Magvit Pytorch ⭐ 14
Implementation of MAGVIT, Masked Generative Video Transformer from Carnegie Melon University and Google Research, in Pytorch
most recent commit 10 months ago
Cross Transformers Pytorch ⭐ 13
Implementation of Cross Transformer for spatially-aware few-shot transfer, in Pytorch
total releases 2most recent commit 3 years ago
Sparseattention ⭐ 13
Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"
most recent commit 4 months ago
Pointer_generator_summarizer ⭐ 12
Pointer Generator Network: Seq2Seq with attention, pointing and coverage mechanism for abstractive summarization.
most recent commit 5 years ago
Conformer ⭐ 9
An implementation of Conformer: Convolution-augmented Transformer for Speech Recognition, a Transformer Variant in TensorFlow/Keras
total releases 2most recent commit 2 years ago
Mobilevlm ⭐ 9
Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant for Mobile Devices"
most recent commit 4 months ago
Cyclegan With Self Attention ⭐ 8
In this repository, I have developed a CycleGAN architecture with embedded Self-Attention Layers, that could solve three different complex tasks. Here the same principle Neural Network architecture has been used to solve the three different task. Although truth be told, my model has not exceeded any state of the art performances for the given task, but the architecture was powerful enough to understand the task that has been given to solve and produce considerably good results.
most recent commit 2 years ago
Logicguide ⭐ 8
Plug in and Play implementation of "Certified Reasoning with Language Models" that elevates model reasoning by 40%
most recent commit a year ago
Mmca ⭐ 8
The open source community's implementation of the all-new Multi-Modal Causal Attention from "DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention"
most recent commit 5 months ago
Popular Artificial Intelligence Categories
Artificial Intelligence
Robot
Ros
Discord Bot
Home Assistant
Telegram Bot
Chatbot
Robotics
Object Detection
Home Automation
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.