Awesome
Introduction
Package containing the Matlab implementation of the code behind: The 2017 DAVIS Video Object Segmentation Challenge.
You can find the Python implementation here.
Code Installation
- Adapt the value of
db_root_dir.m
to point to the root dir where DAVIS is uncompressed in your system (contains foldersAnnotations
andJPEGImages
) - Run the script
startup.m
to add the necessary paths and perform some checks. - [If necessary] Recompile using the script
build.m
in case the startup script detects some files missing.
Code Usage
- The script
demos/demo_eval_multiple.m
contains a demo of how annotations and results are stored in the case of multiple objects. - The script
demos/demo_sweep.m
contains a demo of how the dataset images and annotations are read (all functions indb_util
). - The script
measures/eval_result.m
runs the evaluation for the selected measures on a certain subset of the dataset. - The three measures used in the evaluation are found in the folder
measures
. - The folder
experiments
contains the scripts used to generate all plots and tables in the paper.global_table.m
might be the best point ot start.
Evaluate your technique
- The script
demos/demo_eval_your_method.m
contains a demo of how to evaluate your method (callmeasures/eval_result.m
). - Add your results in the folder
$root_DAVIS\Results\Segmentations\480p
, as the provided precomputed results, in a foldermy_method
- Run
measures/eval_result.m
on your technique:eval_result('my_method',{'J','F','T'})
. (You can select which measures to use - You can skip T for fast computation) - Show your results as in
experiments\global_table.m
Helper functions
Two helper scripts are found in the folder helpers
:
combine_multiple_pngs
: To combine different masks from each object into a single PNG.create_submission_zip
: To check and crate the ZIP file to submit to Codalab for the challenge.
Citation
Please cite DAVIS 2017
and DAVIS 2016
in your publications if it helps your research:
@article{Pont-Tuset_arXiv_2017,
author = {Jordi Pont-Tuset and Federico Perazzi and Sergi Caelles and
Pablo Arbel\'aez and Alexander Sorkine-Hornung and Luc {Van Gool}},
title = {The 2017 DAVIS Challenge on Video Object Segmentation},
journal = {arXiv:1704.00675},
year = {2017}
}
@inproceedings{Perazzi_CVPR_2016,
author = {Federico Perazzi and
Jordi Pont-Tuset and
Brian McWilliams and
Luc {Van Gool} and
Markus Gross and
Alexander Sorkine-Hornung},
title = {A Benchmark Dataset and Evaluation Methodology for Video Object Segmentation},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
year = {2016}
}
Contacts
- Jordi Pont-Tuset - Matlab code
- Federico Perazzi - Python code