Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Multimodal Learning Open Source Projects

Open source projects categorized as Multimodal Learning
Categories > Multimodal Learning
Awesome Multimodal Ml ⭐ 5,399
Reading list for research topics in multimodal machine learning
most recent commit 3 months ago
Open_flamingo ⭐ 3,115
An open-source framework for training large multimodal models.
most recent commit 7 months ago
Awesome Multimodal Research ⭐ 1,133
A curated list of Multimodal Related Research.
most recent commit a year ago
Iccv 2023 Papers ⭐ 806
ICCV 2023 Papers: Discover cutting-edge research from ICCV 2023, the leading computer vision conference. Stay updated on the latest in computer vision and deep learning, with code included. ⭐ support visual intelligence development!
most recent commit 5 months ago
Cornac ⭐ 782
A Comparative Framework for Multimodal Recommender Systems
total releases 39most recent commit 5 months ago
Clip4clip ⭐ 663
An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"
most recent commit 7 months ago
Multimodal Toolkit ⭐ 533
Multimodal model for text and tabular data with HuggingFace transformers as building block for text data
total releases 8most recent commit 6 months ago
Omml ⭐ 528
Multi-Modal learning toolkit based on PaddlePaddle and PyTorch, supporting multiple applications such as multi-modal classification, cross-modal retrieval and image caption.
most recent commit a year ago
Awsome Deep Learning For Video Analysis ⭐ 507
Papers, code and datasets about deep learning and multi-modal learning for video analysis
most recent commit 3 years ago
Rela ⭐ 477
[CVPR2023 Highlight] GRES: Generalized Referring Expression Segmentation
most recent commit 10 months ago
Unireplknet ⭐ 456
UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio, Video, Point Cloud, Time-Series and Image Recognition
most recent commit 6 months ago
Multimodal Deep Learning ⭐ 433
This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.
most recent commit a year ago
Omninet ⭐ 426
Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain
most recent commit 4 years ago
Pykale ⭐ 415
Knowledge-Aware machine LEarning (KALE): accessible machine learning from multiple sources for interdisciplinary research, part of the 🔥PyTorch ecosystem. ⭐ Star to support our work!
total releases 12most recent commit 5 months ago
Mevis ⭐ 388
[ICCV 2023] MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressions
most recent commit 8 months ago
Xpretrain ⭐ 382
Multi-modality pre-training
most recent commit 6 months ago
Multibench ⭐ 356
[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning
most recent commit 8 months ago
Awesome Vision And Language ⭐ 342
A curated list of awesome vision and language resources (still under construction... stay tuned!)
most recent commit a year ago
Cm3leon ⭐ 288
An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal AI that uses just a decoder to generate both text and images
most recent commit 7 months ago
Awesome Multimodal Llm ⭐ 243
Research Trends in LLM-guided Multimodal Learning.
most recent commit 9 months ago
Mvits_for_class_agnostic_od ⭐ 240
[ECCV'22] Official repository of paper titled "Class-agnostic Object Detection with Multi-modal Transformer".
most recent commit a year ago
Clipa ⭐ 231
[NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"
most recent commit 8 months ago
Awesome Multimodal In Medical Imaging ⭐ 207
A collection of resources on applications of multi-modal learning in medical imaging.
most recent commit 6 months ago
The 7 Latest Releases In Multimodal Learning Open Source Projects
Cornac ⭐ 782
A Comparative Framework for Multimodal Recommender Systems
total releases 39latest release October 03, 2023most recent commit 5 months ago
Gato ⭐ 8
Plug in and play Implementation of "A Generalist Agent" by Deepmind.
total releases 2latest release August 25, 2023most recent commit 8 months ago
Autobot ⭐ 5
An autoML for explainable text classification.
total releases 92latest release May 02, 2022most recent commit 2 years ago
Topicnet ⭐ 129
Interface for easier topic modelling.
total releases 14latest release July 06, 2020most recent commit 2 years ago
Mmae ⭐ 8
Package for Multimodal Autoencoders in TensorFlow / Keras
total releases 4latest release June 08, 2020most recent commit 4 years ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.