Awesome Open Source

Programming Languages

Search results for attention mechanism multimodal

attention-mechanism x

10 search results found

Dalle Pytorch ⭐ 5,477

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

Coca Pytorch ⭐ 900

Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch

Build, Deploy, and Scale Reliable Swarms of Autonomous Agents for Workflow Automation. Join our Community: https://discord.gg/DbjBMJTSWD

Democratization of RT-2 "RT-2: New model translates vision and language into action"

Implementation of "PaLM-E: An Embodied Multimodal Language Model"

Fusilli ⭐ 120

A Python package housing a collection of deep-learning multi-modal data fusion method pipelines! From data loading, to training, to evaluation - fusilli's got you covered 🌸

Zorro Pytorch ⭐ 83

Implementation of Zorro, Masked Multimodal Transformer, in Pytorch

Dual Mfa Vqa ⭐ 33

Co-attending Regions and Detections for VQA.

Mambatransformer ⭐ 31

Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling

Protein Localization Transformer ⭐ 22

Code for CELL-E: Biological Zero-Shot Text-to-Image Synthesis for Protein Localization Prediction

Implementation of AutoRT: "AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents"

Dailypaperclub ⭐ 8

The repository for the exclusive Daily Paper Club hosted at Agora every 10pm NYC time at this discord: https://discord.gg/Gnzh6dnzyz

Plug in and play Implementation of "A Generalist Agent" by Deepmind.

The open source community's implementation of the all-new Multi-Modal Causal Attention from "DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention"

My implementation of the model KosmosG from "KOSMOS-G: Generating Images in Context with Multimodal Large Language Models"

Implementation of GATS from the paper: "GATS: Gather-Attend-Scatter" in pytorch and zeta

Image Caption ⭐ 5

PyTorch implementation of image captioning based on attention mechanism

Related Searches

Python Attention Mechanism (555)

Deep Learning Attention Mechanism (274)

Python Multimodal (186)

Jupyter Notebook Attention Mechanism (148)

1-10 of 10 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.