Home

Awesome

Python 3.6

Guided Interactive Video Object Segmentation Using Reliability-Based Attention Maps

Yuk Heo, Yeong Jun Koh, Chang-Su Kim

Implementation of CVPR2021 oral paper (best paper candidate), "Guided Interactive Video Object Segmentation Using Reliability-Based Attention Maps"

<img src="etc/Intro.png" width="600" height="300"/>

[Paper] [Project page] [Video-introduction] [Video-comparison]

Codes in this github:

  1. DAVIS2017 evaluation based on the DAVIS framework
  2. Youtube-iVOS evaluation based on the Youtube2019
  3. DAVIS2017 real-world evaluation GUI - linked to GUI-iVOS_and_GIS

Prerequisite

Directory Structure

Instruction

DAVIS2017 evaluation based on the DAVIS framework

  1. Edit config.py to set the directory of your DAVIS2017 dataset and the other configurations.
  2. Download our parameters and place the file as root/checkpoints/GIS-ckpt_standard.pth.
  3. Evaluate with
    • python3 IVOS_main_DAVIS.py.
    • python3 IVOS_main_youtube.py.

DAVIS2017 real-world evaluation GUI

Multi-object GUI (for DAVIS2017) is available at our github page, [GUI-IVOS]

Reference

Please cite our paper if the implementations are useful in your work:

@Inproceedings{
Yuk2021GIS,
title={Guided Interactive Video Object Segmentation Using Reliability-Based Attention Maps},
author={Yuk Heo and Yeong Jun Koh and Chang-Su Kim},
booktitle={CVPR},
year={2021},
url={https://openaccess.thecvf.com/content/CVPR2021/papers/Heo_Guided_Interactive_Video_Object_Segmentation_Using_Reliability-Based_Attention_Maps_CVPR_2021_paper.pdf}
}