Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Multimodal Deep Learning Open Source Projects

Open source projects categorized as Python Multimodal Deep Learning
Categories > Multimodal Deep Learning
Pytorch Widedeep ⭐ 1,194
A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch
dependent packages 4total releases 22most recent commit 3 months agopypi pytorch-widedeep} Downloads
Deepviewagg ⭐ 195
[CVPR'22 Best Paper Finalist] Official PyTorch implementation of the method presented in "Learning Multi-View Aggregation In the Wild for Large-Scale 3D Semantic Segmentation"
most recent commit 8 months ago
Prophet ⭐ 179
Implementation of CVPR 2023 paper "Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering".
most recent commit a year ago
Mmmu ⭐ 167
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
most recent commit 3 months ago
Capdec ⭐ 155
CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
most recent commit 3 months ago
Fusilli ⭐ 120
A Python package housing a collection of deep-learning multi-modal data fusion method pipelines! From data loading, to training, to evaluation - fusilli's got you covered 🌸
most recent commit 3 months ago
The Compiler ⭐ 119
Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!
total releases 7most recent commit 9 months ago
Pseudo Q ⭐ 116
[CVPR 2022] Pseudo-Q: Generating Pseudo Language Queries for Visual Grounding
most recent commit a year ago
Bitnet ⭐ 115
Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch
most recent commit 4 months ago
Video Captioning ⭐ 102
This repository contains the code for a video captioning system inspired by Sequence to Sequence -- Video to Text. This system takes as input a video and generates a caption in English describing the video.
most recent commit 5 years ago
Pali3 ⭐ 97
Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
most recent commit 4 months ago
Dj Rn ⭐ 93
As a part of HAKE project (HAKE-3D). Code for our CVPR2020 paper "Detailed 2D-3D Joint Representation for Human-Object Interaction".
most recent commit a year ago
Multimodal Infomax ⭐ 82
This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis, accepted at EMNLP 2021.
most recent commit 2 years ago
Swarms Pytorch ⭐ 67
Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊
most recent commit 3 months ago
Awesome Rvos ⭐ 66
Referring Video Object Segmentation / Multi-Object Tracking Repo
most recent commit 9 months ago
Mmsa Fet ⭐ 58
A Tool for extracting multimodal features from videos.
most recent commit a year ago
3dcompat V2 ⭐ 57
3DCoMPaT++: An improved large-scale 3D vision dataset for compositional recognition
most recent commit 6 months ago
Mintrec ⭐ 53
MIntRec: A New Dataset for Multimodal Intent Recognition (ACM MM 2022)
most recent commit 4 months ago
Embracenet ⭐ 50
Robust multimodal integration method implemented in PyTorch and TensorFlow
most recent commit 3 years ago
Cvt2distilgpt2 ⭐ 46
Improving Chest X-Ray Report Generation by Leveraging Warm-Starting
most recent commit 4 months ago
Pali ⭐ 42
Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
total releases 6most recent commit 3 months ago
Bbfn ⭐ 42
This repository contains the implementation of the paper -- Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis
most recent commit a year ago
Clipmh ⭐ 38
CLIPMH:CLIP Multi-modal Hashing
most recent commit 8 months ago
The 5 Latest Releases In Python Multimodal Deep Learning Open Source Projects
Pali ⭐ 42
Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
total releases 6latest release November 03, 2023most recent commit 3 months ago
Pegasus ⭐ 9
PegasusX: The Future of Multimodal Embeddings 🦄 🦄
total releases 23latest release July 17, 2023most recent commit 6 months ago
The Compiler ⭐ 119
Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!
total releases 7latest release July 07, 2023most recent commit 9 months ago
Mmae ⭐ 8
Package for Multimodal Autoencoders in TensorFlow / Keras
total releases 4latest release June 08, 2020most recent commit 4 years ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.