Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Multimodal Open Source Projects

Open source projects categorized as Multimodal
Categories > Multimodal
Jina ⭐ 19,573
☁️ Build multimodal AI applications with cloud-native stack
dependent packages 16total releases 2,453most recent commit 4 months agopypi jina} Downloads
Unilm ⭐ 16,971
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
most recent commit 3 months ago
Llava ⭐ 12,514
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
most recent commit 4 months ago
Nemo ⭐ 9,041
NeMo: a toolkit for conversational AI
dependent packages 8total releases 70most recent commit 3 months agopypi nemo-toolkit} Downloads
Modelscope ⭐ 5,517
ModelScope: bring the notion of Model-as-a-Service to life.
dependent packages 13total releases 31most recent commit 3 months agopypi modelscope} Downloads
Dalle Pytorch ⭐ 5,477
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
total releases 174most recent commit 3 months ago
Mmf ⭐ 5,414
A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
most recent commit 2 months ago
Ai Notes ⭐ 4,180
notes for software engineers getting up to speed on new AI developments. Serves as datastore for https://latent.space writing, and product brainstorming, but has cleaned up canonical references under the /Resources folder.
most recent commit 3 months ago
Valhalla ⭐ 4,032
Open Source Routing Engine for OpenStreetMap
dependent packages 2total releases 7most recent commit 3 months agonpm valhalla} Downloads
Courses ⭐ 4,018
This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)
most recent commit 5 months ago
Rerun ⭐ 3,895
Visualize streams of multimodal data. Fast, easy to use, and simple to integrate. Built in Rust using egui.
dependent packages 36total releases 54most recent commit 3 months agocargo re_log} Downloads
Marqo ⭐ 3,893
Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
total releases 11most recent commit 3 months ago
Tree Of Thoughts ⭐ 3,798
Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
dependent packages 1total releases 23most recent commit 3 months agopypi tree-of-thoughts} Downloads
Discoart ⭐ 3,773
🪩 Create Disco Diffusion artworks in one line
total releases 298most recent commit a year ago
Cogvlm ⭐ 3,690
a state-of-the-art-level open visual language model | 多模态预训练模型
most recent commit 4 months ago
Fengshenbang Lm ⭐ 3,670
Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型
most recent commit 4 months ago
Visualglm 6b ⭐ 3,638
Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型
most recent commit 5 months ago
Mmpretrain ⭐ 3,114
OpenMMLab Pre-training Toolbox and Benchmark
dependent packages 10total releases 33most recent commit 2 months agopypi mmcls} Downloads
Img2dataset ⭐ 2,986
Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.
dependent packages 2total releases 83most recent commit 3 months agopypi img2dataset} Downloads
Interngpt ⭐ 2,976
InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)
most recent commit 5 months ago
Awesome Aigc Tutorials ⭐ 2,879
Curated tutorials and resources for Large Language Models, AI Painting, and more.
most recent commit 4 months ago
Chinese Clip ⭐ 2,816
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
dependent packages 1total releases 9most recent commit 5 months agopypi cn-clip} Downloads
Torchscale ⭐ 2,804
Foundation Architecture for (M)LLMs
dependent packages 8total releases 5most recent commit 3 months agopypi torchscale} Downloads
The 10 Most Depended On Multimodal Open Source Projects
Docarray ⭐ 2,721
Represent, send, store and search multimodal data
dependent packages 52total releases 732latest release December 09, 2023most recent commit a month agopypi docarray} Downloads
Rerun ⭐ 3,895
Visualize streams of multimodal data. Fast, easy to use, and simple to integrate. Built in Rust using egui.
dependent packages 36total releases 54latest release October 30, 2023most recent commit 3 months agocargo re_log} Downloads
Psi ⭐ 506
Platform for Situated Intelligence
dependent packages 34total releases 18latest release December 07, 2022most recent commit a month agonuget Microsoft.Psi.Runtime} Downloads
Autodistill ⭐ 1,286
Images to inference with no labeling (use foundation models to train supervised models)
dependent packages 31total releases 24latest release December 01, 2023most recent commit 3 months agopypi autodistill} Downloads
Jina ⭐ 19,573
☁️ Build multimodal AI applications with cloud-native stack
dependent packages 16total releases 2,453latest release December 01, 2023most recent commit 4 months agopypi jina} Downloads
Modelscope ⭐ 5,517
ModelScope: bring the notion of Model-as-a-Service to life.
dependent packages 13total releases 31latest release December 08, 2023most recent commit 3 months agopypi modelscope} Downloads
Zeta ⭐ 106
Build high-performance AI models with modular building blocks
dependent packages 13total releases 71latest release November 30, 2023most recent commit 3 months agopypi zetascale} Downloads
Mmpretrain ⭐ 3,114
OpenMMLab Pre-training Toolbox and Benchmark
dependent packages 10total releases 33latest release April 06, 2023most recent commit 2 months agopypi mmcls} Downloads
Swarms ⭐ 376
Build, Deploy, and Scale Reliable Swarms of Autonomous Agents for Workflow Automation. Join our Community: https://discord.gg/DbjBMJTSWD
dependent packages 9total releases 208latest release December 11, 2023most recent commit 3 months agopypi swarms} Downloads
Nemo ⭐ 9,041
NeMo: a toolkit for conversational AI
dependent packages 8total releases 70latest release October 25, 2023most recent commit 3 months agopypi nemo-toolkit} Downloads
The 10 Latest Releases In Multimodal Open Source Projects
Rt 2 ⭐ 215
Democratization of RT-2 "RT-2: New model translates vision and language into action"
total releases 8latest release December 23, 2023most recent commit 4 months ago
Swarms ⭐ 376
Build, Deploy, and Scale Reliable Swarms of Autonomous Agents for Workflow Automation. Join our Community: https://discord.gg/DbjBMJTSWD
dependent packages 9total releases 208latest release December 11, 2023most recent commit 3 months agopypi swarms} Downloads
Modelfusion ⭐ 712
The TypeScript library for building AI applications.
dependent packages 7total releases 111latest release December 10, 2023most recent commit 3 months agonpm modelfusion} Downloads
Docarray ⭐ 2,721
Represent, send, store and search multimodal data
dependent packages 52total releases 732latest release December 09, 2023most recent commit a month agopypi docarray} Downloads
Modelscope ⭐ 5,517
ModelScope: bring the notion of Model-as-a-Service to life.
dependent packages 13total releases 31latest release December 08, 2023most recent commit 3 months agopypi modelscope} Downloads
Hcaptcha Challenger ⭐ 1,247
🥂 Gracefully face hCaptcha challenge with MoE(ONNX) embedded solution.
dependent packages 2total releases 113latest release December 07, 2023most recent commit 5 months agopypi hcaptcha-challenger} Downloads
Autodistill ⭐ 1,286
Images to inference with no labeling (use foundation models to train supervised models)
dependent packages 31total releases 24latest release December 01, 2023most recent commit 3 months agopypi autodistill} Downloads
Jina ⭐ 19,573
☁️ Build multimodal AI applications with cloud-native stack
dependent packages 16total releases 2,453latest release December 01, 2023most recent commit 4 months agopypi jina} Downloads
Zeta ⭐ 106
Build high-performance AI models with modular building blocks
dependent packages 13total releases 71latest release November 30, 2023most recent commit 3 months agopypi zetascale} Downloads
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.