Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Vision Language Open Source Projects

Open source projects categorized as Vision Language
Categories > Vision Language
Groundingdino ⭐ 4,165
Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
dependent packages 1total releases 1most recent commit 5 months agopypi groundingdino} Downloads
Marqo ⭐ 3,893
Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
total releases 11most recent commit 5 months ago
Blip ⭐ 3,558
PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
most recent commit 8 months ago
Chinese Clip ⭐ 2,816
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
dependent packages 1total releases 9most recent commit 7 months agopypi cn-clip} Downloads
Ofa ⭐ 2,142
Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
most recent commit 8 months ago
One Peace ⭐ 714
A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
most recent commit 6 months ago
Pix2seq ⭐ 706
Pix2Seq codebase: multi-tasks with generative modeling (autoregressive and diffusion)
most recent commit 9 months ago
Video Chatgpt ⭐ 590
"Video-ChatGPT" is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.
most recent commit 7 months ago
Awesome Japanese Llm ⭐ 585
日本語LLMまとめ - Overview of Japanese LLMs
most recent commit 5 months ago
Drivelm ⭐ 493
DriveLM: Driving with Graph Visual Question Answering
most recent commit 5 months ago
Advancedliteratemachinery ⭐ 464
A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Alibaba DAMO Academy.
most recent commit 5 months ago
Daclip Uir ⭐ 441
PyTorch code for "Controlling Vision-Language Models for Universal Image Restoration", ICLR 2024.
most recent commit 5 months ago
Seed ⭐ 326
Empowers LLMs with the ability to see and draw.
most recent commit 7 months ago
Cliport ⭐ 297
CLIPort: What and Where Pathways for Robotic Manipulation
most recent commit a year ago
Alphaclip ⭐ 273
Alpha-CLIP: A CLIP Model Focusing on Wherever You Want
most recent commit 5 months ago
Calvin ⭐ 210
CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks
most recent commit 5 months ago
Kaleido Bert ⭐ 207
(CVPR2021) Kaleido-BERT: Vision-Language Pre-training on Fashion Domain.
most recent commit 2 years ago
Lvit ⭐ 200
[IEEE Transactions on Medical Imaging/TMI] This repo is the official implementation of "LViT: Language meets Vision Transformer in Medical Image Segmentation"
most recent commit 8 months ago
Movienet Tools ⭐ 174
Tools for movie and video research
most recent commit 2 years ago
Open Groundingdino ⭐ 135
This is the third party implementation of the paper Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection.
most recent commit 6 months ago
Vln Bevbert ⭐ 130
[ICCV 2023} Official repo of "BEVBert: Multimodal Map Pre-training for Language-guided Navigation"
most recent commit 8 months ago
Visual Chinese Llama Alpaca ⭐ 129
多模态中文LLaMA&Alpaca大语言模型（VisualCLA）
most recent commit a year ago
Vse_infty ⭐ 110
Code for "Learning the Best Pooling Strategy for Visual Semantic Embedding", CVPR 2021
most recent commit a year ago
The 2 Most Depended On Vision Language Open Source Projects
Chinese Clip ⭐ 2,816
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
dependent packages 1total releases 9latest release January 13, 2023most recent commit 7 months agopypi cn-clip} Downloads
The 4 Latest Releases In Vision Language Open Source Projects
Chinese Clip ⭐ 2,816
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
dependent packages 1total releases 9latest release January 13, 2023most recent commit 7 months agopypi cn-clip} Downloads
Marqo ⭐ 3,893
Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
total releases 11latest release November 17, 2022most recent commit 5 months ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.