Home

Awesome

<div align="center"> <img src="https://github.com/lartpang/PySODMetrics/blob/main/images/logo.png?raw=true" alt="Logo" width="320" height="auto"> </br> <h2>PySODMetrics: A simple and efficient implementation of SOD metrics</h2> <a href="./readme_zh.md"><img src="https://img.shields.io/badge/README-%E4%B8%AD%E6%96%87-blue"></a> <img src="https://img.shields.io/pypi/v/pysodmetrics"> <img src="https://img.shields.io/pypi/dm/pysodmetrics?label=pypi%20downloads&logo=PyPI&logoColor=white"> <img src="https://img.shields.io/github/last-commit/lartpang/PySODMetrics"> <img src="https://img.shields.io/github/last-commit/lartpang/PySODMetrics"> <img src="https://img.shields.io/github/release-date/lartpang/PySODMetrics"> </div>

Introduction

A simple and efficient implementation of SOD metrics.

Your improvements and suggestions are welcome.

Related Projects

Supported Metrics

MetricSample-basedWhole-basedRelated Class
MAEsoftMAE
S-measure $S_{m}$softSmeasure
weighted F-measure ($F^{\omega}_{\beta}$)softWeightedFmeasure
Multi-Scale IoUbinMSIoU
E-measure ($E_{m}$)max,avg,adpEmeasure
F-measure (old) ($F_{beta}$)max,avg,adpFmeasure (Will be removed!)
F-measure (new) ($F_{beta}$, $F_{1}$)max,avg,adp,binbinFmeasureV2+FmeasureHandler
BERmax,avg,adp,binbinFmeasureV2+BERHandler
Dicemax,avg,adp,binbinFmeasureV2+DICEHandler
FPRmax,avg,adp,binbinFmeasureV2+FPRHandler
IoUmax,avg,adp,binbinFmeasureV2+IOUHandler
Kappamax,avg,adp,binbinFmeasureV2+KappaHandler
Overall Accuracymax,avg,adp,binbinFmeasureV2+OverallAccuracyHandler
Precisionmax,avg,adp,binbinFmeasureV2+PrecisionHandler
Recallmax,avg,adp,binbinFmeasureV2+RecallHandler
Sensitivitymax,avg,adp,binbinFmeasureV2+SensitivityHandler
Specificitymax,avg,adp,binbinFmeasureV2+SpecificityHandler
TNRmax,avg,adp,binbinFmeasureV2+TNRHandler
TPRmax,avg,adp,binbinFmeasureV2+TPRHandler

Usage

The core files are in the folder py_sod_metrics.

Examples

Reference

@inproceedings{Fmeasure,
    title={Frequency-tuned salient region detection},
    author={Achanta, Radhakrishna and Hemami, Sheila and Estrada, Francisco and S{\"u}sstrunk, Sabine},
    booktitle=CVPR,
    number={CONF},
    pages={1597--1604},
    year={2009}
}

@inproceedings{MAE,
    title={Saliency filters: Contrast based filtering for salient region detection},
    author={Perazzi, Federico and Kr{\"a}henb{\"u}hl, Philipp and Pritch, Yael and Hornung, Alexander},
    booktitle=CVPR,
    pages={733--740},
    year={2012}
}

@inproceedings{Smeasure,
    title={Structure-measure: A new way to evaluate foreground maps},
    author={Fan, Deng-Ping and Cheng, Ming-Ming and Liu, Yun and Li, Tao and Borji, Ali},
    booktitle=ICCV,
    pages={4548--4557},
    year={2017}
}

@inproceedings{Emeasure,
    title="Enhanced-alignment Measure for Binary Foreground Map Evaluation",
    author="Deng-Ping {Fan} and Cheng {Gong} and Yang {Cao} and Bo {Ren} and Ming-Ming {Cheng} and Ali {Borji}",
    booktitle=IJCAI,
    pages="698--704",
    year={2018}
}

@inproceedings{wFmeasure,
  title={How to evaluate foreground maps?},
  author={Margolin, Ran and Zelnik-Manor, Lihi and Tal, Ayellet},
  booktitle=CVPR,
  pages={248--255},
  year={2014}
}

@inproceedings{MSIoU,
    title = {Multiscale IOU: A Metric for Evaluation of Salient Object Detection with Fine Structures},
    author = {Ahmadzadeh, Azim and Kempton, Dustin J. and Chen, Yang and Angryk, Rafal A.},
    booktitle = ICIP,
    year = {2021},
}