Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Multimodality Open Source Projects

Open source projects categorized as Python Multimodality
Categories > Multimodality
Llava ⭐ 12,514
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
most recent commit 3 months ago
Deep Daze ⭐ 4,104
Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
total releases 64most recent commit 2 years ago
Otter ⭐ 3,322
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
total releases 8most recent commit 3 months ago
Big Sleep ⭐ 1,726
A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun
total releases 54most recent commit 2 years ago
Multimodal Maestro ⭐ 871
Effective prompting for Large Multimodal Models like GPT-4 Vision, LLaVA or CogVLM. 🔥
most recent commit 3 months ago
Internlm Xcomposer ⭐ 820
most recent commit 3 months ago
Cornac ⭐ 782
A Comparative Framework for Multimodal Recommender Systems
total releases 39most recent commit 3 months ago
Clip4clip ⭐ 663
An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"
most recent commit 5 months ago
Fedot ⭐ 582
Automated modeling and machine learning framework FEDOT
dependent packages 1total releases 19most recent commit 3 months agopypi fedot} Downloads
Woodpecker ⭐ 473
✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models. The first work to correct hallucinations in MLLMs.
most recent commit 3 months ago
Swarms ⭐ 376
Build, Deploy, and Scale Reliable Swarms of Autonomous Agents for Workflow Automation. Join our Community: https://discord.gg/DbjBMJTSWD
dependent packages 9total releases 208most recent commit 3 months agopypi swarms} Downloads
Gpt4roi ⭐ 330
GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest
most recent commit 7 months ago
Sophia ⭐ 324
Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.
total releases 8most recent commit 5 months ago
Collaborative Diffusion ⭐ 320
Collaborative Diffusion (CVPR 2023)
most recent commit 5 months ago
Multi Modality Arena ⭐ 308
Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inputs. Supports MiniGPT-4, LLaMA-Adapter V2, LLaVA, BLIP-2, and many more!
most recent commit 4 months ago
Cm3leon ⭐ 288
An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal AI that uses just a decoder to generate both text and images
most recent commit 4 months ago
Mm Diffusion ⭐ 287
[CVPR'23] MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
most recent commit 3 months ago
Dance ⭐ 284
DANCE: A Deep Learning Library and Benchmark Platform for Single-Cell Analysis
total releases 4most recent commit 3 months ago
X Vlm ⭐ 272
X-VLM: Multi-Grained Vision Language Pre-Training (ICML 2022)
most recent commit a year ago
Gemini ⭐ 270
The open source implementation of Gemini, the model that will "eclipse ChatGPT" by Google
total releases 5most recent commit 3 months ago
Clip Guided Diffusion ⭐ 267
A CLI tool/python module for generating images from text using guided diffusion and CLIP from OpenAI.
most recent commit 2 years ago
Univl ⭐ 264
An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"
most recent commit a year ago
Multimodal Sentiment Analysis ⭐ 205
Attention-based multimodal fusion for sentiment analysis
most recent commit 3 years ago
The 3 Most Depended On Python Multimodality Open Source Projects
Swarms ⭐ 376
Build, Deploy, and Scale Reliable Swarms of Autonomous Agents for Workflow Automation. Join our Community: https://discord.gg/DbjBMJTSWD
dependent packages 9total releases 208latest release December 11, 2023most recent commit 3 months agopypi swarms} Downloads
Emmental ⭐ 93
A deep learning framework for building multimodal multi-task learning systems.
dependent packages 2total releases 11latest release January 12, 2022most recent commit 2 years agopypi emmental} Downloads
Fedot ⭐ 582
Automated modeling and machine learning framework FEDOT
dependent packages 1total releases 19latest release July 25, 2023most recent commit 3 months agopypi fedot} Downloads
The 10 Latest Releases In Python Multimodality Open Source Projects
Swarms ⭐ 376
Build, Deploy, and Scale Reliable Swarms of Autonomous Agents for Workflow Automation. Join our Community: https://discord.gg/DbjBMJTSWD
dependent packages 9total releases 208latest release December 11, 2023most recent commit 3 months agopypi swarms} Downloads
Gemini ⭐ 270
The open source implementation of Gemini, the model that will "eclipse ChatGPT" by Google
total releases 5latest release December 07, 2023most recent commit 3 months ago
Dance ⭐ 284
DANCE: A Deep Learning Library and Benchmark Platform for Single-Cell Analysis
total releases 4latest release December 04, 2023most recent commit 3 months ago
Pali ⭐ 42
Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
total releases 6latest release November 03, 2023most recent commit 3 months ago
Cornac ⭐ 782
A Comparative Framework for Multimodal Recommender Systems
total releases 39latest release October 03, 2023most recent commit 3 months ago
Gato ⭐ 8
Plug in and play Implementation of "A Generalist Agent" by Deepmind.
total releases 2latest release August 25, 2023most recent commit 6 months ago
Fedot ⭐ 582
Automated modeling and machine learning framework FEDOT
dependent packages 1total releases 19latest release July 25, 2023most recent commit 3 months agopypi fedot} Downloads
Andromeda ⭐ 92
An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast
total releases 3latest release July 07, 2023most recent commit 3 months ago
The Compiler ⭐ 119
Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!
total releases 7latest release July 07, 2023most recent commit 9 months ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.