Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 20 Video Language Open Source Projects

Open source projects categorized as Video Language
Categories > Video Language
Vlog ⭐ 380
Transform Video as a Document with ChatGPT, CLIP, BLIP2, GRIT, Whisper, LangChain.
most recent commit 10 months ago
Referformer ⭐ 281
[CVPR2022] Official Implementation of ReferFormer
most recent commit 8 months ago
Univl ⭐ 264
An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"
most recent commit 2 years ago
Univtg ⭐ 230
[ICCV2023] UniVTG: Towards Unified Video-Language Temporal Grounding
most recent commit 5 months ago
All In One ⭐ 180
[CVPR2023] All in One: Exploring Unified Video-Language Pre-training
most recent commit a year ago
Egovlp ⭐ 176
[NeurIPS2022] Egocentric Video-Language Pretraining
most recent commit 9 months ago
Multi Modal Transformer ⭐ 117
The repository collects many various multi-modal transformer architectures, including image transformer, video transformer, image-language transformer, video-language transformer and self-supervised learning models. Additionally, it also collects many useful tutorials and tools in these related domains.
most recent commit 2 years ago
Alpro ⭐ 109
Align and Prompt: Video-and-Language Pre-training with Entity Prompts
most recent commit 2 years ago
Vidil ⭐ 41
Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
most recent commit 2 years ago
Region_learner ⭐ 31
The Pytorch implementation for "Video-Text Pre-training with Learned Regions"
most recent commit 2 years ago
Perceiver_vl ⭐ 30
PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)
most recent commit a year ago
Mac ⭐ 24
An end-to-end masked contrastive video-and-language pre-training framework
most recent commit a year ago
Vidsitu ⭐ 23
[CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)
most recent commit 3 years ago
Gvl ⭐ 19
Official implementation for paper Learning Grounded Vision-Language Representation for Versatile Understanding in Untrimmed Videos
most recent commit 6 months ago
Decembert ⭐ 15
Pytorch version of DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy Minimization (NAACL 2021)
most recent commit a year ago
Awesome Video Text Datasets ⭐ 13
A curated list of video-text datasets in a variety of languages. These datasets can be used for video captioning (video description) or video retrieval.
most recent commit 6 months ago
Shot2story ⭐ 11
A new multi-shot video understanding benchmark Shot2Story20K with detailed shot-level captions and comprehensive video summaries.
most recent commit 4 months ago
Vlg ⭐ 8
VLG: General Video Recognition with Web Textual Knowledge (https://arxiv.org/abs/2212.01638)
most recent commit 4 months ago
Awesome Video Language Understanding ⭐ 7
A Survey on video and language understanding.
most recent commit a year ago
Guidance Based Video Grounding ⭐ 6
The official PyTorch implementation of the paper: "Localizing Moments in Long Video Via Multimodal Guidance"
most recent commit 10 months ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.