Home

Awesome

Generative Neural Visual Artist (GeNeVA) - Datasets - Generation Code

Scripts to generate the CoDraw and i-CLEVR datasets used for the GeNeVA task proposed in Tell, Draw, and Repeat: Generating and modifying images based on continual linguistic instruction.

Setup

1. Install Miniconda

wget https://repo.continuum.io/miniconda/Miniconda3-latest-Linux-x86_64.sh
bash Miniconda3-latest-Linux-x86_64.sh
rm Miniconda3-latest-Linux-x86_64.sh

You will now have to restart your shell for the path changes to take effect.

2. Clone the repository

git clone git@github.com:Maluuba/GeNeVA_datasets.git  # use https://github.com/Maluuba/GeNeVA_datasets.git for HTTPS
cd GeNeVA_datasets

3. Create a conda environment for this repository

conda env create -f environment.yml

4. Activate the environment

source activate geneva

5. Download external data files

./scripts/download_data.sh

6. Download GeNeVA data files to the repository

Download the GeNeVA zip file and extract it as specified below:

7. Generate dataset HDF5 files

8. (Optional) Downloaded data can now be deleted

rm raw-data/ -rf
rm GeNeVA-v1/ -rf
rm GeNeVA-v1.zip

Reference

If you use this code or the GeNeVA datasets as part of any published research, please cite the following paper:

Alaaeldin El-Nouby, Shikhar Sharma, Hannes Schulz, Devon Hjelm, Layla El Asri, Samira Ebrahimi Kahou, Yoshua Bengio, and Graham W. Taylor. "Tell, Draw, and Repeat: Generating and modifying images based on continual linguistic instruction" arXiv preprint arXiv:1811.09845 (2018).

@article{elnouby2018tell_draw_repeat,
    author  = {El{-}Nouby, Alaaeldin and Sharma, Shikhar and Schulz, Hannes and Hjelm, Devon and El Asri, Layla and Ebrahimi Kahou, Samira and Bengio, Yoshua and Taylor, Graham W.},
    title   = {Tell, Draw, and Repeat: Generating and modifying images based on continual linguistic instruction},
    journal = {CoRR},
    volume  = {abs/1811.09845},
    year    = {2018},
    url     = {http://arxiv.org/abs/1811.09845},
    archivePrefix = {arXiv},
    eprint  = {1811.09845}
}

Microsoft Open Source Code of Conduct

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

License

See LICENSE.txt.