Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Vision And Language Open Source Projects

Open source projects categorized as Vision And Language
Categories > Vision And Language
Lavis ⭐ 7,917
LAVIS - A One-stop Library for Language-Vision Intelligence
dependent packages 5total releases 12most recent commit 3 months agopypi salesforce-lavis} Downloads
Vilt ⭐ 1,289
Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"
most recent commit 17 days ago
Prismer ⭐ 1,245
The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".
most recent commit 3 months ago
Oscar ⭐ 995
Oscar and VinVL
most recent commit 8 months ago
Multimodal Gpt ⭐ 971
Multimodal-GPT
most recent commit a year ago
Xmodaler ⭐ 929
X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense reasoning, and cross-modal retrieval).
most recent commit a year ago
Dl Nlp Readings ⭐ 847
My Reading Lists of Deep Learning and Natural Language Processing
most recent commit 2 years ago
Albef ⭐ 804
Code for ALBEF: a new vision-language pre-training method
most recent commit 2 years ago
Awesome Vision Language Pretraining Papers ⭐ 724
Recent Advances in Vision and Language PreTrained Models (VL-PTMs)
most recent commit 2 years ago
One Peace ⭐ 714
A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
most recent commit 4 months ago
Vl Bert ⭐ 680
Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".
most recent commit 2 years ago
Clipbert ⭐ 649
[CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning on image-text and video-text tasks.
most recent commit 8 months ago
Awesome Japanese Llm ⭐ 585
日本語LLMまとめ - Overview of Japanese LLMs
most recent commit 3 months ago
Groundinglmm ⭐ 434
Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.
most recent commit 3 months ago
Uniter ⭐ 418
Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
most recent commit 3 years ago
Matterport3dsimulator ⭐ 414
AI Research Platform for Reinforcement Learning from Real Panoramic Images.
most recent commit 5 months ago
Proctoring Ai ⭐ 397
Creating a software for automatic monitoring in online proctoring
most recent commit a year ago
Awesome Vision And Language ⭐ 342
A curated list of awesome vision and language resources (still under construction... stay tuned!)
most recent commit 8 months ago
Pointllm ⭐ 276
[arXiv 2023] PointLLM: Empowering Large Language Models to Understand Point Clouds
most recent commit 4 months ago
Alphaclip ⭐ 273
Alpha-CLIP: A CLIP Model Focusing on Wherever You Want
most recent commit 3 months ago
X Vlm ⭐ 272
X-VLM: Multi-Grained Vision Language Pre-Training (ICML 2022)
most recent commit a year ago
Vl T5 ⭐ 245
PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
most recent commit 2 years ago
Conceptual 12m ⭐ 235
Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.
most recent commit a year ago
The 6 Latest Releases In Vision And Language Open Source Projects
Factualscenegraph ⭐ 62
FACTUAL benchmark dataset, the pre-trained textual scene graph parser trained on FACTUAL.
total releases 12latest release November 21, 2023most recent commit 5 months ago
Lavis ⭐ 7,917
LAVIS - A One-stop Library for Language-Vision Intelligence
dependent packages 5total releases 12latest release March 06, 2023most recent commit 3 months agopypi salesforce-lavis} Downloads
Mozuma ⭐ 7
Model Zoo for Multimedia Applications
total releases 5latest release October 04, 2022most recent commit 9 months ago
Eccv Caption ⭐ 46
Extended COCO Validation (ECCV) Caption dataset (ECCV 2022)
total releases 1latest release April 08, 2022most recent commit 7 months ago
Visiondetect ⭐ 8
VisionDetect let you track user face gestures like blink, smile etc.
total releases 7latest release October 09, 2017most recent commit 4 years ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.