Home

Awesome

ABA

We propose the adversarial blur attack (ABA) against visual object tracking. The ICCV link: https://arxiv.org/abs/2107.12085 and, https://openaccess.thecvf.com/content/ICCV2021/papers/Guo_Learning_To_Adversarially_Blur_Visual_Object_Tracking_ICCV_2021_paper.pdf

<img align="center" src="./res/fig1.png" width="500">

Motion Blur Systhensis for Visual Object Tracking

<img align="center" src="./res/fig_blusys.png" width="500">

JAMANet for One-step Adversarial Blur Attack

<img align="center" src="./res/fig_arch.png" width="500">

Results

<table> <tr> <td ><center><img src="./res/case6.gif" > <p align="center">Case1</p> </center></td> <td ><center><img src="./res/case1.gif" > <p align="center">Case2</p> </center></td> </tr> <tr> <td ><center><img src="./res/case2.gif" > <p align="center">Case3</p> </center></td> <td ><center><img src="./res/case3.gif" > <p align="center">Case4</p> </center></td> </tr> <tr> <td ><center><img src="./res/case4.gif" > <p align="center">Case5</p> </center></td> <td ><center><img src="./res/case5.gif" > <p align="center">Case6</p> </center></td> </tr> </table>

Usage

Our implementation is based on PySOT, You need to follow their installation steps for environment setup.

You can enter the target tracker's directory in the experiments folder, run the attack/evaluate experiment with the following command:

# attack
CUDA_VISIBLE_DEVICES=0 python -u ../../tools/attack_test.py --snapshot  model.pth  --dataset OTB100  --config config.yaml
CUDA_VISIBLE_DEVICES=0 python -u ../../tools/attack_dimp.py --snapshot  model.pth  --dataset OTB100  --config config.yaml
CUDA_VISIBLE_DEVICES=0 python -u ../../tools/attack_kys.py --snapshot  model.pth  --dataset OTB100  --config config.yaml

# evaluate
python ../../tools/eval.py  --tracker_path ./results   --dataset OTB100   --num 10 --tracker_prefix 'cl'
python ../../tools/eval.py  --tracker_path ./results   --dataset VOT2018  --num 10 --tracker_prefix 'clean'
python ../../tools/eval.py  --tracker_path ./results   --dataset UAV      --num 10 --tracker_prefix 'guo'
python ../../tools/eval.py  --tracker_path ./results   --dataset VOT2019  --num 10--tracker_prefix 'csa'

Bibtex

@inproceedings{guo2021learning,
      title={Learning to Adversarially Blur Visual Object Tracking},
      author={Qing Guo and Ziyi Cheng and Felix Juefei-Xu and Lei Ma and Xiaofei Xie and Yang Liu and Jianjun Zhao},
      year={2021},
      booktitle={ICCV}
}