Home

Awesome

Video Waterdrop Removal via Spatio-Temporal Fusion in Driving Scenes

Paper

<p align='center'> <img src='visualization/8.gif' width=300> <img src='visualization/5.gif' width=300> </p>

This is the official PyTorch implementation. This works aims at removing various types of waterdrops for driving cars on rainy days. We also provide a large-scale synthetic dataset for the video waterdrop removal task.

Video Waterdrop Removal via Spatio-Temporal Fusion in Driving Scenes

Qiang Wen, Yue Wu, Qifeng Chen <br /> The Hong Kong University of Science and Technology <br /> IEEE International Conference on Robotics and Automation (ICRA), 2023

Requirements

If conda has been installed, you can directly build the running environment via:

conda env create -f environment.yaml

An environment named "th" will be created.

Training

$ bash train.sh

You can also use the command tensorboard --logdir=runs to visually check the training results.

Testing

$ bash test.sh

You can choose the test on the synthetic dataset or real-world dataset by specifying --data_type

Citation

If you find this repository useful for your research, please cite the following work.

@inproceedings{wen2023video,
  title={Video Waterdrop Removal via Spatio-Temporal Fusion in Driving Scenes},
  author={Wen, Qiang and Wu, Yue and Chen, Qifeng},
  booktitle={International Conference on Robotics and Automation (ICRA)},
  year={2023},
  organization={IEEE}
}
<p align='center'> <img src='visualization/HKUST_VIL.png' width=500> </p>