Awesome Open Source
Awesome Open Source
Combined Topics
image-captioning x

The Top 382 Image Captioning Open Source Projects

Categories > Machine Learning > Image Captioning
A Pytorch Tutorial To Image Captioning ⭐ 2,084
Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning
most recent commit 2 months ago
Cameramanager ⭐ 1,204
Simple Swift class to provide all the configurations you need to create custom camera view in your app
total releases 49most recent commit 8 months ago
Ofa ⭐ 1,095
Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
most recent commit a day ago
Bottom Up Attention ⭐ 979
Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome
most recent commit 2 years ago
Blip ⭐ 904
PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
most recent commit 6 days ago
Show Attend And Tell ⭐ 885
TensorFlow Implementation of "Show, Attend and Tell"
most recent commit 4 years ago
Xmodaler ⭐ 876
X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense reasoning, and cross-modal retrieval).
most recent commit 7 hours ago
Awesome Image Captioning ⭐ 828
A curated list of image captioning and related area resources. :-)
most recent commit 4 months ago
Self Critical.pytorch ⭐ 747
Unofficial pytorch implementation for Self-critical Sequence Training for Image Captioning. and others.
most recent commit a year ago
Oscar ⭐ 706
Oscar and VinVL
most recent commit 10 months ago
Lavis ⭐ 582
LAVIS - A One-stop Library for Language-Vision Intelligence
most recent commit a day ago
Virtex ⭐ 506
[CVPR 2021] VirTex: Learning Visual Representations from Textual Annotations
most recent commit 6 months ago
Omninet ⭐ 426
Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain
most recent commit 2 years ago
Paddlemm ⭐ 413
Multi-Modal learning toolkit based on PaddlePaddle and PyTorch, supporting multiple applications such as multi-modal classification, cross-modal retrieval and image caption.
most recent commit 2 months ago
Neuralmonkey ⭐ 385
An open-source tool for sequence learning in NLP built on TensorFlow.
most recent commit 2 years ago
Cv Tricks.com ⭐ 384
Repository for all the tutorials and codes shared at cv-tricks.com
most recent commit 2 years ago
Awesome Visual Captioning ⭐ 330
This repository focus on Image Captioning & Video Captioning & Seq-to-Seq Learning & NLP
most recent commit 10 days ago
Scan ⭐ 308
PyTorch source code for "Stacked Cross Attention for Image-Text Matching" (ECCV 2018)
most recent commit 2 years ago
Im2latex ⭐ 289
Image to LaTeX (Seq2seq + Attention with Beam Search) - Tensorflow
most recent commit 2 years ago
Adaptiveattention ⭐ 288
Implementation of "Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning"
most recent commit 5 years ago
Cs231 ⭐ 276
Complete Assignments for CS231n: Convolutional Neural Networks for Visual Recognition
most recent commit 4 years ago
Image Captioning ⭐ 246
Image Captioning using InceptionV3 and beam search
most recent commit 5 years ago
Image To Image Search ⭐ 242
A reverse image search engine powered by elastic search and tensorflow
most recent commit a year ago
Caption_generator ⭐ 233
A modular library built on top of Keras and TensorFlow to generate a caption in natural language for any input image.
most recent commit 4 years ago
Up Down Captioner ⭐ 218
Automatic image captioning model based on Caffe, using features from bottom-up attention.
most recent commit 3 years ago
Sca Cnn.cvpr17 ⭐ 201
Image Captions Generation with Spatial and Channel-wise Attention
most recent commit 4 years ago
Unsupervised_captioning ⭐ 194
Code for Unsupervised Image Captioning
most recent commit a year ago
Image Captioning ⭐ 188
Implementation of 'X-Linear Attention Networks for Image Captioning' [CVPR 2020]
most recent commit a year ago
Show Control And Tell ⭐ 185
Show, Control and Tell: A Framework for Generating Controllable and Grounded Captions. CVPR 2019
most recent commit 3 years ago
Dataturks ⭐ 165
ML data annotations made super easy for teams. Just upload data, add your team and build training/evaluation dataset in hours.
most recent commit 2 years ago
Video2description ⭐ 153
Video to Text: Natural language description generator for some given video. [Video Captioning]
most recent commit 5 months ago
Aoanet ⭐ 149
Code for paper "Attention on Attention for Image Captioning". ICCV 2019
most recent commit 3 years ago
Show Adapt And Tell ⭐ 142
Code for "Show, Adapt and Tell: Adversarial Training of Cross-domain Image Captioner" in ICCV 2017
most recent commit 4 years ago
Image Captioning Dlct ⭐ 139
Official pytorch implementation of paper "Dual-Level Collaborative Transformer for Image Captioning" (AAAI 2021).
most recent commit 4 months ago
Image Caption Generator ⭐ 136
[DEPRECATED] A Neural Network based generative model for captioning images using Tensorflow
most recent commit 3 years ago
Fairseq Image Captioning ⭐ 134
Transformer-based image captioning extension for pytorch/fairseq
most recent commit 2 years ago
Magic ⭐ 124
Language Models Can See: Plugging Visual Controls in Text Generation
most recent commit 4 months ago
Sightseq ⭐ 109
🔭 Computer vision tools for fairseq, containing PyTorch implementation of text recognition and object detection
most recent commit 3 years ago
Deep_learning_algorithms_from_scratch ⭐ 107
This repository explores the variety of techniques and algorithms commonly used in deep learning and the implementation in MATLAB and PYTHON
most recent commit 3 months ago
Clip Caption Reward ⭐ 104
PyTorch code for "Fine-grained Image Captioning with CLIP Reward" (Findings of NAACL 2022)
most recent commit 2 months ago
Pytorch Polygon Rnn ⭐ 101
Pytorch implementation of Polygon-RNN(http://www.cs.toronto.edu/polyrnn/poly
most recent commit 6 months ago
Keras Image Captioning ⭐ 100
An implementation of image captioning in Keras
most recent commit 4 years ago
Image Captioning ⭐ 98
TensorFlow (TensorLayer) Implementation of Image Captioning
most recent commit 4 years ago
Meshed Memory Transformer ⭐ 95
Meshed-Memory Transformer for Image Captioning. CVPR 2020
most recent commit 3 years ago
Gis ⭐ 94
gis (go image server) go 实现的图片服务，实现基本的上传，下载，存储，按比例裁剪等功能
most recent commit 4 years ago
Dxy Projects ⭐ 91
Some projects from Xuanyi Dong.
most recent commit 7 months ago
Arnet ⭐ 89
CVPR 2018 - Regularizing RNNs for Caption Generation by Reconstructing The Past with The Present
most recent commit 4 years ago
Transformer_image_caption ⭐ 85
Image Captioning based on Bottom-Up and Top-Down Attention model
most recent commit 4 years ago
L Verse ⭐ 85
L-Verse: Bidirectional Generation Between Image and Text
most recent commit 2 months ago
Adaptive ⭐ 84
Pytorch Implementation of Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning
most recent commit 5 years ago
Coco Cn ⭐ 84
Enriching MS-COCO with Chinese sentences and tags for cross-lingual multimedia tasks
most recent commit 8 months ago
Deep_learning_in_python_2018 ⭐ 79
Deep Learning workshop including image classification, face recognition, Object detection, language modelling, image captioning and neural machine translation.
most recent commit 9 months ago
Transform And Tell ⭐ 78
[CVPR 2020] Transform and Tell: Entity-Aware News Image Captioning
most recent commit 5 months ago
Spice ⭐ 78
Semantic Propositional Image Caption Evaluation
most recent commit 4 years ago
Rstnet ⭐ 78
RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words (CVPR 2021)
most recent commit 3 months ago
Image Captions ⭐ 77
BERT + Image Captioning
most recent commit 2 years ago
Image Text Papers ⭐ 71
Image Caption and Text to Image papers.
most recent commit 5 years ago
Image Caption Generator ⭐ 70
A neural network to generate captions for an image using CNN and RNN with BEAM Search.
most recent commit 3 years ago
Image Captioning ⭐ 69
most recent commit 4 years ago
Medical Report Generation ⭐ 69
A pytorch implementation of On the Automatic Generation of Medical Imaging Reports.
most recent commit 4 years ago
Cvpr18 Caption Eval ⭐ 66
Learning to Evaluate Image Captioning. CVPR 2018
most recent commit 4 years ago
Cs224n_project ⭐ 65
Neural Image Captioning in TensorFlow.
most recent commit 4 years ago
Show Attend And Tell ⭐ 61
[Python 3] Tensorflow implementation of "Show, Attend and Tell: Neural Image Caption Generation with Visual Attention"
most recent commit 4 years ago
Catr ⭐ 60
Image Captioning Using Transformer
most recent commit a year ago
Denserelationalcaptioning ⭐ 58
Code of Dense Relational Captioning
most recent commit 7 months ago
Im2txt ⭐ 58
Image captioning ready-to-go inference: show and tell model compatible with Tensorflow r1.9
most recent commit 3 days ago
Awesome Captioning ⭐ 56
A curated list of Multimodal Captioning related research(including image captioning, video captioning, and text captioning)
most recent commit 4 months ago
Stylenet ⭐ 53
A pytorch implemention of "StyleNet: Generating Attractive Visual Captions with Styles"
most recent commit 2 years ago
Cross Lingual Cap ⭐ 50
Cross-lingual image captioning
most recent commit 5 months ago
Grit ⭐ 49
GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)
most recent commit 21 days ago
Updown Baseline ⭐ 48
Baseline model for nocaps benchmark, ICCV 2019 paper "nocaps: novel object captioning at scale".
most recent commit 2 years ago
Knowing When To Look Adaptive Attention ⭐ 48
PyTorch Implementation of Knowing When to Look: Adaptive Attention via a Visual Sentinal for Image Captioning
most recent commit 2 years ago
Cam2caption ⭐ 44
An Android application which converts camera feed to captions in real time
most recent commit 5 years ago
Show_and_tell ⭐ 43
Show and Tell : A Neural Image Caption Generator
most recent commit 3 years ago
Mia ⭐ 42
Code for "Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations" （NeurIPS 2019）
most recent commit 2 years ago
Computer Vision Nd ⭐ 42
Projects and exercises for the Udacity Computer Vision Nanodegree
most recent commit 4 years ago
Cs231n_assignments ⭐ 41
[Assignments] CS231N: Convolutional Neural Networks for Visual Recognition (2016 & 2017)
most recent commit 4 years ago
Image Captioning ⭐ 41
Image Captioning with Keras
most recent commit 2 years ago
Im2p ⭐ 41
Tensorflow implement of paper: A Hierarchical Approach for Generating Descriptive Image Paragraphs
most recent commit 4 years ago
Image_captioning ⭐ 40
generate captions for images using a CNN-RNN model that is trained on the Microsoft Common Objects in COntext (MS COCO) dataset
most recent commit 4 years ago
Neural Image Captioning ⭐ 39
Using scene-specific contexts and region-based attention in neural image captioning
most recent commit 2 years ago
Coco Caption ⭐ 39
Adds SPICE metric to coco-caption evaluation server codes
most recent commit 4 years ago
Image Caption Generator ⭐ 37
The LSTM model generates captions for the input images after extracting features from pre-trained VGG-16 model. (Computer Vision, NLP, Deep Learning, Python)
most recent commit 3 years ago
Image Captioning ⭐ 37
Image Captioning: Implementing the Neural Image Caption Generator with python
most recent commit 5 years ago
Udacity Cvnd Projects ⭐ 34
My solutions to the projects assigned for the Udacity Computer Vision Nanodegree
most recent commit 4 years ago
Clcaption_nips2017 ⭐ 33
Contrastive Learning for Image Captioning
most recent commit 5 years ago
Punny_captions ⭐ 31
An implementation of the NAACL 2018 paper "Punny Captions: Witty Wordplay in Image Descriptions".
most recent commit 4 years ago
Machine Learning ⭐ 31
The projects I do in Machine Learning with PyTorch, keras, Tensorflow, scikit learn and Python.
most recent commit 2 years ago
Cavp ⭐ 30
Code release for Context-Aware Visual Policy Network for Sequence-Level Image Captioning (MM 2018) and Context-Aware Visual Policy Network for Fine-Grained Image Captioning (TPAMI 2019)
most recent commit 3 years ago
Clipcap ⭐ 29
Using pretrained encoder and language models to generate captions from multimedia inputs.
most recent commit 3 months ago
Cos Cvae ⭐ 29
Diverse Image Captioning with Context-Object Split Latent Spaces (NeurIPS 2020)
most recent commit 4 months ago
Optimization_of_image_description_metrics_using_policy_gradient_methods ⭐ 29
Tensorflow implement of paper: Optimization of image description metrics using policy gradient methods
most recent commit 4 years ago
Image Captioning ⭐ 28
图像中文描述
most recent commit 4 years ago
Cs231n ⭐ 28
CS231n Assignments Solutions - Spring 2020
most recent commit a year ago
S2 Transformer ⭐ 27
Repository of IJCAI 2022 paper “S2 Transformer for Image Captioning”
most recent commit 19 days ago
Aat ⭐ 27
Code for paper "Adaptively Aligned Image Captioning via Adaptive Attention Time". NeurIPS 2019
most recent commit 3 years ago
Automatic Image Captioning ⭐ 26
In this project, I have created a neural network architecture to automatically generate captions from images. After using the Microsoft Common Objects in COntext (MS COCO) dataset to train my network, I have tested my network on novel images!
most recent commit 10 months ago
Skeleton Key ⭐ 26
The implementation of the model in paper "Skeleton Key: Image Captioning by Skeleton-Attribute Decomposition"
most recent commit 5 years ago
Im2latex ⭐ 26
Pytorch implemention of Deep CNN Encoder + LSTM Decoder with Attention for Image to Latex
most recent commit 3 years ago
Show Attend And Tell Keras ⭐ 25
Keras implementation of the "Show, Attend and Tell" paper
most recent commit 3 years ago
1-100 of 382 projects
Categories
Advertising 📦 8
All Projects
Application Programming Interfaces 📦 107
Applications 📦 174
Artificial Intelligence 📦 69
Blockchain 📦 66
Build Tools 📦 105
Cloud Computing 📦 68
Code Quality 📦 24
Collaboration 📦 27
Command Line Interface 📦 38
Community 📦 79
Companies 📦 60
Compilers 📦 59
Computer Science 📦 73
Configuration Management 📦 37
Content Management 📦 153
Control Flow 📦 187
Data Formats 📦 72
Data Processing 📦 249
Data Storage 📦 116
Economics 📦 56
Frameworks 📦 178
Games 📦 110
Graphics 📦 92
Hardware 📦 137
Integrated Development Environments 📦 43
Learning Resources 📦 139
Legal 📦 24
Libraries 📦 117
Lists Of Projects 📦 19
Machine Learning 📦 313
Mapping 📦 57
Marketing 📦 15
Mathematics 📦 54
Media 📦 214
Messaging 📦 96
Networking 📦 292
Operating Systems 📦 72
Operations 📦 114
Package Managers 📦 50
Programming Languages 📦 173
Runtime Environments 📦 90
Science 📦 42
Security 📦 342
Social Media 📦 23
Software Architecture 📦 65
Software Development 📦 60
Software Performance 📦 53
Software Quality 📦 116
Text Editors 📦 40
Text Processing 📦 118
User Interface 📦 291
User Interface Components 📦 440
Version Control 📦 26
Virtualization 📦 63
Web Browsers 📦 35
Web Servers 📦 23
Web User Interface 📦 167
Top Programming Languages
Javascript  (1,090,060)
Python  (836,862)
Java  (396,315)
Php  (289,821)
Typescript  (266,127)
C Plus Plus  (245,644)
Ruby  (222,621)
C  (186,064)
Shell  (175,562)
C Sharp  (169,379)
Golang  (163,592)
Swift  (66,730)
Rust  (61,591)
R  (59,598)
Objective C  (57,116)
Dart  (56,061)
Kotlin  (49,101)
Lua  (35,607)
Matlab  (31,776)
Perl  (30,633)
Language  (29,988)
Scala  (28,906)
Haskell  (20,613)
Powershell  (19,524)
Clojure  (19,265)
Bash  (18,860)
Coffeescript  (17,224)
Elixir  (16,943)
Assembly  (15,003)
Processing  (13,286)
Julia  (13,275)
Basic  (10,702)
Emacs Lisp  (10,558)
Flow  (10,532)
Erlang  (9,072)
Solidity  (8,893)
Groovy  (8,490)
Scheme  (8,419)
Ocaml  (6,797)
Pascal  (6,570)
Hack  (6,461)
Lisp  (6,345)
Fortran  (5,644)
Elm  (5,505)
Common Lisp  (5,379)
Dlang  (4,763)
Shell Script  (4,727)
Python Library  (4,474)
Crystal  (4,402)
Scripting  (4,218)
Top Projects
Freecodecamp ⭐ 353,860
996.icu ⭐ 263,876
Free Programming Books ⭐ 249,820
Coding Interview University ⭐ 234,090
Awesome ⭐ 220,672
Developer Roadmap ⭐ 212,635
Public Apis ⭐ 209,615
Vue ⭐ 199,611
System Design Primer ⭐ 197,601
React ⭐ 195,230
Tensorflow ⭐ 167,934
Build Your Own X ⭐ 165,260
Bootstrap ⭐ 159,657
You Dont Know Js ⭐ 159,180
Cs Notes ⭐ 156,901
Javascript Algorithms ⭐ 151,359
Ohmyzsh ⭐ 150,386
Python ⭐ 145,251
Flutter ⭐ 145,242
Awesome Python ⭐ 142,001
Gitignore ⭐ 138,733
Linux ⭐ 138,490
Vscode ⭐ 136,934
Javaguide ⭐ 127,508
Javascript ⭐ 127,377
Computer Science ⭐ 123,917
Python 100 Days ⭐ 123,512
Youtube Dl ⭐ 113,542
Fucking Algorithm ⭐ 110,396
The Art Of Command Line ⭐ 109,914
React Native ⭐ 105,024
Go ⭐ 104,049
Awesome Selfhosted ⭐ 103,828
Electron ⭐ 103,793
30 Seconds Of Code ⭐ 102,805
D3 ⭐ 101,796
Create React App ⭐ 97,104
Axios ⭐ 95,834
Free Programming Books Zh_cn ⭐ 94,901
Next.js ⭐ 93,062
Kubernetes ⭐ 92,328
Node ⭐ 90,542
Awesome Go ⭐ 88,320
Three.js ⭐ 85,553
Deno ⭐ 85,410
Terminal ⭐ 85,389
Typescript ⭐ 84,486
Angular ⭐ 84,020
Ant Design ⭐ 81,977
Nodebestpractices ⭐ 81,676
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2022 Awesome Open Source.  All rights reserved.