Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Multimodal Open Source Projects

Open source projects categorized as Python Multimodal
Categories > Multimodal
Andromeda ⭐ 92
An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast
total releases 3most recent commit 4 months ago
Poda ⭐ 86
[ICCV 2023] Official implementation of "PØDA: Prompt-driven Zero-shot Domain Adaptation"
most recent commit 5 months ago
Mammut Pytorch ⭐ 85
Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch
total releases 6most recent commit 7 months ago
Hyperrim ⭐ 83
most recent commit 2 years ago
Zorro Pytorch ⭐ 83
Implementation of Zorro, Masked Multimodal Transformer, in Pytorch
total releases 7most recent commit 6 months ago
Vip Llava ⭐ 81
ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
most recent commit 3 months ago
Rt X ⭐ 77
Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"
most recent commit 3 months ago
Visualrwkv ⭐ 75
VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle various visual tasks.
most recent commit 3 months ago
Minklocmultimodal ⭐ 73
MinkLoc++: Lidar and Monocular Image Fusion for Place Recognition
most recent commit a year ago
Diverse Structure Inpainting ⭐ 72
CVPR 2021: "Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAE"
most recent commit 3 years ago
Tempus ⭐ 72
C++ framework to develop multimodal path planning requests
most recent commit 6 years ago
Kopa ⭐ 67
[Paper][Preprint 2023] Making Large Language Models Perform Better in Knowledge Graph Completion
most recent commit 4 months ago
Swarms Pytorch ⭐ 67
Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊
most recent commit 3 months ago
Hvpnet ⭐ 66
Code for the NAACL2022 paper "Good Visual Guidance Makes A Better Extractor: Hierarchical Visual Prefix for Multimodal Entity and Relation Extraction"
most recent commit 9 months ago
Awesome Rvos ⭐ 66
Referring Video Object Segmentation / Multi-Object Tracking Repo
most recent commit 9 months ago
Ll3da ⭐ 65
"LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning"; an interactive Large Language 3D Assistant.
most recent commit 4 months ago
Obelics ⭐ 63
Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M documents, 115B text tokens and 353M images.
most recent commit 9 months ago
Audiotoken ⭐ 61
This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image Generation
most recent commit 4 months ago
Gemini Pro Bot ⭐ 59
A Python Telegram bot powered by Google's gemini-pro LLM API
most recent commit 3 months ago
Bdm Db1 ⭐ 58
A large-scale multi-modal pre-trained model
most recent commit a year ago
Yuren Baichuan 7b ⭐ 58
基于baichuan-7b的开源多模态大语言模型
most recent commit 5 months ago
Adviser ⭐ 56
ADvISER is a flexible framework to encourage task-oriented dialog system research & development
most recent commit a year ago
Mkg_analogy ⭐ 56
Code and datasets for the ICLR2023 paper "Multimodal Analogical Reasoning over Knowledge Graphs."
most recent commit 8 months ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.