Awesome

GMOT-40 Benchmark

This is the official development project for paper: GMOT-40: A Benchmark for Generic Multiple Object Tracking.

To get the dataset, including sequences and labels, please go to the official website.

Abstract

Multiple Object Tracking (MOT) has witnessed remarkable advances in recent years. However, existing studies dominantly request prior knowledge of the tracking target (eg, pedestrians), and hence may not generalize well to unseen categories. In contrast, Generic Multiple Object Tracking (GMOT), which requires little prior information about the target, is largely under-explored. In this paper, we make contributions to boost the study of GMOT in three aspects. First, we construct the first publicly available dense GMOT dataset, dubbed GMOT-40, which contains 40 carefully annotated sequences evenly distributed among 10 object categories. In addition, two tracking protocols are adopted to evaluate different characteristics of tracking algorithms. Second, by noting the lack of devoted tracking algorithms, we have designed a series of baseline GMOT algorithms. Third, we perform a thorough evaluations on GMOT-40, involving popular MOT algorithms (with necessary modifications) and the proposed baselines.

Baseline

Below are the results of baseline methods with one-shot GMOT protocol. We randomly sample the one target in the 1st frame for the protocol and repeat this procedure for 5 times. Then we report the mean and standard deviation of the results over these 5 experiments.

Methods	MOTA	MOTP	IDF1
MDP	19.92% ± 1.84%	24.16% ± 0.27%	31.84% ± 2.23%
DeepSORT	14.98% ± 1.47%	23.66% ± 0.53%	25.38% ± 2.32%
IOU Tracker	12.36% ± 1.60%	25.34% ± 0.36%	20.90% ± 2.73%
FAMNet	17.60% ± 0.85%	22.56% ± 0.23%	27.76% ± 1.16%

Citation

The proceeding version is shown below. You may check the arXiv version for updates.

@inproceedings{bai2021gmot,
  title={GMOT-40: A Benchmark for Generic Multiple Object Tracking},
  author={Bai, Hexin and Cheng, Wensheng and Chu, Peng and Liu, Juehuan and Zhang, Kai and Ling, Haibin},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  pages={6719--6728},
  year={2021}
}

Notes

Although we tried to make the annotation quality as high as possible, there is still room for improvement, due to personal bias, etc. We would continue to improve the annotation quality since the first release.

If you find any inproper label/have better annotation ideas, please contact Wensheng Cheng by Email: wenscheng at cs.stonybrook.edu.

Your effort would be greatly appreciated, and the person whose improvement is adopted would be added to a contribution list!

License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.