Home

Awesome

Deep Interactive Segmentation

Official repository for the two papers.

Getting to 99% Accuracy in Interactive Segmentation, submitted to Signal Processing: Image Communication the Special Issue on Computational Image Editing.

Interactive Training and Architecture for Deep Object Selection, (Runner-up Best Paper) ICME 2020.
Marco Forte<sup>1</sup>, Brian Price<sup>2</sup>, Scott Cohen<sup>2</sup>, Ning Xu<sup>2</sup>, François Pitié<sup>1</sup>
<sup>1</sup> Trinity College Dublin <sup>2</sup> Adobe Research

Requirements

GPU memory >= 4GB for inference on Berkeley and GrabCut. Optimal performance around 480p resolution.

Packages:

Additional Packages for jupyter notebook

Models

Model NameFile SizeNoC GrabcutNoC Berkeley
SyntheticPretrained+Finetune on SBD144mb1.742.93

Prediction

We provide a script demo.py which evaluates our model in terms of mean IoU and number of clicks to reach 90% accuracy. Links to download: the GrabCut and Berkeley datasets. Results are slightly improved from Table. 8 in the paper, this is due to changes in prediction, the weights are the same as used in the paper.

Training

Training code is not released at this time. It may be released upon acceptance of the paper.

Citation

@misc{forte2020InterSeg,
    title={Getting to 99% Accuracy in Interactive Segmentation},
    author={Marco Forte and Brian Price and Scott Cohen and Ning Xu and François Pitié},
    year={2020},
    eprint={2003.07932},
    archivePrefix={arXiv},
    primaryClass={cs.CV}
}

Related works of ours