Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Multimodal Deep Learning Open Source Projects

Open source projects categorized as Multimodal Deep Learning
Categories > Multimodal Deep Learning
Lavis ⭐ 7,917
LAVIS - A One-stop Library for Language-Vision Intelligence
dependent packages 5total releases 12most recent commit 4 months agopypi salesforce-lavis} Downloads
Bentoml ⭐ 6,575
The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!
dependent packages 12total releases 119most recent commit 13 days agopypi bentoml} Downloads
Awesome Text To Image ⭐ 1,692
(ෆ`꒳´ෆ) A Survey on Text-to-Image Generation/Synthesis.
most recent commit 4 months ago
Pytorch Widedeep ⭐ 1,194
A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch
dependent packages 4total releases 22most recent commit 4 months agopypi pytorch-widedeep} Downloads
Awesome Vision Language Pretraining Papers ⭐ 724
Recent Advances in Vision and Language PreTrained Models (VL-PTMs)
most recent commit 2 years ago
Awesome Grounding ⭐ 689
awesome grounding: A curated list of research papers in visual grounding
most recent commit a year ago
Nsmusics ⭐ 601
NSMusicS（Nine Songs · Music World：九歌 · 音乐世界），Multi platform Multi mode Super Music Software (Full stack development, audio processing, artificial intelligence, natural language processing)
most recent commit 4 months ago
Advancedliteratemachinery ⭐ 464
A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Alibaba DAMO Academy.
most recent commit 4 months ago
Blended Latent Diffusion ⭐ 458
Official implementation for "Blended Latent Diffusion" [SIGGRAPH 2023]
most recent commit 5 months ago
Multimodal Deep Learning ⭐ 433
This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.
most recent commit a year ago
Scarches ⭐ 294
Reference mapping for single-cell genomics
dependent packages 2total releases 28most recent commit 4 months agopypi scArches} Downloads
Awesome Parameter Efficient Transfer Learning ⭐ 288
A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.
most recent commit 5 months ago
Awesome Emotion Recognition In Conversations ⭐ 216
A comprehensive reading list for Emotion Recognition in Conversations
most recent commit a year ago
Awesome Multimodal In Medical Imaging ⭐ 207
A collection of resources on applications of multi-modal learning in medical imaging.
most recent commit 4 months ago
Eccv2022 Papers With Code Demo ⭐ 207
收集 ECCV 最新的成果，包括论文、代码和demo视频等，欢迎大家推荐！
most recent commit 2 years ago
Awesome Multimodality ⭐ 206
A Survey on multimodal learning research.
most recent commit 9 months ago
Multimodal Ml Music ⭐ 202
List of academic resources on Multimodal ML for Music
most recent commit a year ago
Cav Mae ⭐ 201
Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".
most recent commit 2 months ago
Deepviewagg ⭐ 195
[CVPR'22 Best Paper Finalist] Official PyTorch implementation of the method presented in "Learning Multi-View Aggregation In the Wild for Large-Scale 3D Semantic Segmentation"
most recent commit 9 months ago
Prophet ⭐ 179
Implementation of CVPR 2023 paper "Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering".
most recent commit a year ago
Awesome Vision And Language Pre Training ⭐ 176
Recent Advances in Vision and Language Pre-training (VLP)
most recent commit a year ago
Recommendation Systems Without Explicit Id Features A Literature Review ⭐ 171
Large pre-trained Foundation recommender models
most recent commit 4 months ago
Mmmu ⭐ 167
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
most recent commit 4 months ago
The 4 Most Depended On Multimodal Deep Learning Open Source Projects
Lavis ⭐ 7,917
LAVIS - A One-stop Library for Language-Vision Intelligence
dependent packages 5total releases 12latest release March 06, 2023most recent commit 4 months agopypi salesforce-lavis} Downloads
Scarches ⭐ 294
Reference mapping for single-cell genomics
dependent packages 2total releases 28latest release December 08, 2023most recent commit 4 months agopypi scArches} Downloads
The 8 Latest Releases In Multimodal Deep Learning Open Source Projects
Scarches ⭐ 294
Reference mapping for single-cell genomics
dependent packages 2total releases 28latest release December 08, 2023most recent commit 4 months agopypi scArches} Downloads
Pali ⭐ 42
Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
total releases 6latest release November 03, 2023most recent commit 4 months ago
Pegasus ⭐ 9
PegasusX: The Future of Multimodal Embeddings 🦄 🦄
total releases 23latest release July 17, 2023most recent commit 7 months ago
The Compiler ⭐ 119
Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!
total releases 7latest release July 07, 2023most recent commit 10 months ago
Lavis ⭐ 7,917
LAVIS - A One-stop Library for Language-Vision Intelligence
dependent packages 5total releases 12latest release March 06, 2023most recent commit 4 months agopypi salesforce-lavis} Downloads
Mmae ⭐ 8
Package for Multimodal Autoencoders in TensorFlow / Keras
total releases 4latest release June 08, 2020most recent commit 4 years ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.