Home

Awesome

Introduction

ARS-DETR: Aspect Ratio Sensitive Oriented Object Detection with Transformer

Abstract

Existing oriented object detection methods commonly use metric AP50 to measure the performance of the model. We argue that AP50 is inherently unsuitable for oriented object detection due to its large tolerance in angle deviation. Therefore, we advocate using high-precision metric, e.g. AP75, to measure the performance of models. In this paper, we propose an Aspect Ratio Sensitive Oriented Object Detector with Transformer, termed ARS-DETR, which exhibits a competitive performance in high-precision oriented object detection. Specifically, a new angle classification method, calling Aspect Ratio aware Circle Smooth Label (AR-CSL), is proposed to smooth the angle label in a more reasonable way and discard the hyperparameter that introduced by previous work (e.g. CSL). Then, a rotated deformable attention module is designed to rotate the sampling points with the corresponding angles and eliminate the misalignment between region features and sampling points. Moreover, a dynamic weight coefficient according to the aspect ratio is adopted to calculate the angle loss. Comprehensive experiments on several challenging datasets show that our method achieves competitive performance on the high-precision oriented object detection task. Source code will be made publicly available.

Results and models

DOTA1.0

BackboneAP50AP75Anglelr schdAugBatch SizeConfigsDownload
ResNet50 (1024,1024,200)63.4226.92le903x-2deformable_detr_r50_dotamodel |model(baidu(rdsp)) |log
ResNet50 (1024,1024,200)72.0843.22le903x-2csl_detr_r50_dotamodel|model(baidu(hd8m)) |log
ResNet50 (1024,1024,200)72.6645.64le903x-2arcsl_detr_r50_dotamodel|model(baidu(0afe)) |log
ResNet50 (1024,1024,200)73.4248.41le903x-2dn_arw_arm_arcsl_rdetr_r50_dotamodel|model(baidu(hlkv)) |log

Installation

Please refer to the official guide of MMRotate 0.x or install.md for installation guide.

Get Started

Please see get_started.md for the basic usage of MMRotate.

Data Preparation

Please refer to data_preparation.md to prepare the data.

Acknowledgement

MMRotate is an open source project that is contributed by researchers and engineers from various colleges and companies. We appreciate all the contributors who implement their methods or add new features, as well as users who give valuable feedbacks. We wish that the toolbox and benchmark could serve the growing research community by providing a flexible toolkit to reimplement existing methods and develop their own new methods.

Citation

@article{zeng2023ars-detr,
  title={ARS-DETR: Aspect Ratio Sensitive Oriented Object Detection with Transformer},
  author={Zeng, Ying and Yang, Xue, Li, Qingyun and Chen, Yushi and Yan, Junchi},
  journal={arXiv preprint arXiv:2303.04989},
  year={2023}
}