🎨 Deep Fusion Network for Image Completion - ACMMM 2019
Alternatives To Dfnet
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
a month agootherPython
:art: Deep Fusion Network for Image Completion - ACMMM 2019
3 years ago1Python
Deep Fusion Network for Image Completion (TensorFlow 2)
Sublime Neos1
6 years agomit
Alternatives To Dfnet
Select To Compare

Alternative Project Comparisons

Deep Fusion Network for Image completion

Official repository for "Deep Fusion Network for Image completion".

Figure: Results from DFNet. Fusion Result = (1 - Alpha) * Input + Alpha * Raw. Both Raw and Alpha are model outputs.

Deep Fusion Network for Image Completion
Xin Hong, Pengfei Xiong, Renhe Ji, Haoqiang Fan
Published on Proceedings of the 27th ACM International Conference on Multimedia (ACMMM 2019)


Deep image completion usually fails to harmonically blend the restored image into existing content, especially in the boundary area. And it often fails to complete complex structures.

We first introduce Fusion Block for generating a flexible alpha composition map to combine known and unknown regions. It builds a bridge for structural and texture information, so that information in known region can be naturally propagated into completion area. With this technology, the completion results will have smooth transition near the boundary of completion area. Furthermore, the architecture of fusion block enable us to apply multi-scale constraints. Multi-scale constrains improves the performance of DFNet a lot on structure consistency.

Moreover, it is easy to apply this fusion block and multi-scale constrains to other existing deep image completion models. A fusion block feed with feature maps and input image, will give you a completion result in the same resolution as given feature maps.

If you find this code useful, please consider to star this repo and cite us:

  title = {Deep {{Fusion Network}} for {{Image Completion}}},
  booktitle = {Proceedings of the 27th {{ACM International Conference}} on {{Multimedia}}},
  author = {Hong, Xin and Xiong, Pengfei and Ji, Renhe and Fan, Haoqiang},
  year = {2019},
  series = {{{MM}} '19},
  pages = {2033--2042},
  keywords = {alpha composition,deep fusion network,fusion block,image completion,inpainting}


  • Python 3
  • PyTorch 1.0
  • OpenCV


We provide an interactive Colab demo for trying DFNet. You can also test our model with the following steps.

Clone this repo:

git clone https://github.com/hughplay/DFNet.git
cd DFNet

Download pre-trained model from Google Drive and put them into model.

Testing with Places2 model

There are already some sample images in the samples/places2 folder.

python test.py --model model/model_places2.pth --img samples/places2/img --mask samples/places2/mask --output output/places2 --merge

Testing with CelebA model

There are already some sample images in the samples/celeba folder.

python test.py --model model/model_celeba.pth --img samples/celeba/img --mask samples/celeba/mask --output output/celeba --merge


Please refer to: deepcodebase/inpaint. It is building in progress but looks good so far.


Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Popular Completion Projects
Popular Fusion Projects
Popular Text Processing Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Deep Learning