A PyTorch implementation of the paper: Specifying Object Attributes and Relations in Interactive Scene Generation
Alternatives To Scene_generation
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
a year ago7otherC#
Automatic LOD generation + scene optimization
Scene Graph Benchmark.pytorch914
2 months ago108mitJupyter Notebook
A new codebase for popular Scene Graph Generation methods (2020). Visualization & Scene Graph Extraction on custom images/datasets are provided. It's also a PyTorch implementation of paper “Unbiased Scene Graph Generation from Biased Training CVPR 2020”
Three.terrain50954a year ago6July 06, 20213mitJavaScript
A procedural terrain generation engine for use with the Three.js 3D graphics library for the web.
Graph Rcnn.pytorch482
4 years ago32Python
Pytorch code for our ECCV 2018 paper "Graph R-CNN for Scene Graph Generation" and other papers
4 years ago6Python
Factorizable Net (Multi-GPU version): An Efficient Subgraph-based Framework for Scene Graph Generation
3 years ago6apache-2.0Python
A PyTorch implementation of the paper: Specifying Object Attributes and Relations in Interactive Scene Generation
a year ago2Python
[CVPR 2019] Text2Scene: Generating Compositional Scenes from Textual Descriptions
5 years agootherC#
2 months ago2bsd-2-clauseC++
The code of SCFusion: Real-time Incremental Scene Reconstruction with Semantic Completion
2 years ago3Python
[NeurIPS'20] Code for the Paper Compositional Visual Generation and Inference with Energy Based Models
Alternatives To Scene_generation
Select To Compare

Alternative Project Comparisons

Specifying Object Attributes and Relations in Interactive Scene Generation

A PyTorch implementation of the paper Specifying Object Attributes and Relations in Interactive Scene Generation


Specifying Object Attributes and Relations in Interactive Scene Generation
Oron Ashual1, Lior Wolf1,2
1 Tel-Aviv University, 2 Facebook AI Research
The IEEE International Conference on Computer Vision (ICCV), 2019, (Oral)

Network Architechture




1. Create a virtual environment (optional)

All code was developed and tested on Ubuntu 18.04 with Python 3.6 (Anaconda) and PyTorch 1.0.

conda create -n scene_generation python=3.7
conda activate scene_generation

2. Clone the repository

cd ~
git clone
cd scene_generation

3. Install dependencies

conda install --file requirements.txt -c conda-forge -c pytorch
  • install a PyTorch version which will fit your CUDA TOOLKIT

4. Install COCO API

Note: we didn't train our models with COCO panoptic dataset, the code is for the sake of the community only.

cd ~
git clone
cd cocoapi/PythonAPI/
python install
cd ~/scene_generation

5. Train

$ python

6. Encode the Appearance attributes

python scripts/encode_features --checkpoint TRAINED_MODEL_CHECKPOINT

7. Sample Images

python scripts/ --checkpoint TRAINED_MODEL_CHECKPOINT --batch_size 32 --output_dir OUTPUT_DIR 

8. or Download trained models

Download these files into models/

9. Play with the GUI

The GUI was built as POC. Use it at your own risk:

python scripts/gui/ --checkpoint YOUR_MODEL_CHECKPOINT --output_dir [DIR_NAME] --draw_scene_graphs 0

10. Results

Results were measured by sample images from the validation set and then running these 3 official scripts:

  1. FID - bioinf-jku/TTUR (Tensorflow implementation)
  2. Inception - (Tensorflow implementation)
  3. Diversity - richzhang/PerceptualSimilarity (Pytorch implementation)
  4. Accuracy - Training code is attached A trained model is provided. Adding the argument --accuracy_model_path MODEL_PATH will output the accuracy of the objects.

Reproduce the comparison figure (Figure 3.)

Run this command

$ python scripts/ --checkpoint TRAINED_MODEL_CHECKPOINT --output_dir OUTPUT_DIR

with these arguments:

  • (c) - Ground truth layout: --use_gt_boxes 1 --use_gt_masks 1
  • (d) - Ground truth location attributes: --use_gt_attr 1
  • (e) - Ground truth appearance attributes: --use_gt_textures 1
  • (f) - Scene Graph only - No extra attributes needed


If you find this code useful in your research then please cite

    author = {Ashual, Oron and Wolf, Lior},
    title = {Specifying Object Attributes and Relations in Interactive Scene Generation},
    booktitle = {The IEEE International Conference on Computer Vision (ICCV)},
    month = {October},
    year = {2019}


Our project borrows some source files from sg2im. We thank the authors.

Popular Generation Projects
Popular Scene Projects
Popular Software Development Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Machine Learning
Deep Learning
Computer Vision
Image Generation