Awesome

Efficient Frequency-Domain Image Deraining with Contrastive Regularization (ECCV2024)

The official implementation of ECCV2024 paper "Efficient Frequency-Domain Image Deraining with Contrastive Regularization"

paper link

2024/09/25 Update：The code is now open, welcome to ask questions in the issue, we will try our best to solve errors and doubts

2024/09/26 Update: Pre-trained weights and visualization images are provided by link.

2024/09/29 Update: You can download our paper here!

2024/11/12 Update: You can now find the official publication of Springer here, including supple materials: https://link.springer.com/chapter/10.1007/978-3-031-72940-9_14

2024/12/04 Update: Now you can cite our work through Google Scholar or BibTeX provided in the readme. If you are interested in our work, please actively cite it, we will be grateful.

Authors

• Ning Gao
• Xingyu Jiang
• Xiuhui Zhang
• Yue Deng *

School of Astronautics, Beihang University, Beijing, China

Abstract

Most current single image-deraining (SID) methods are based on the Transformer with global modeling for high-quality reconstruction. However, their architectures only build long-range features from the spatial domain, which suffers from a significant computational burden to keep effectiveness. Besides, these methods either overlook negative sample information in training or underutilize the rain streak patterns present in the negative ones. To tackle these problems, we propose a Frequency-Aware Deraining Transformer Framework (FADformer) that fully captures frequency domain features for efficient rain removal. Specifically, we construct the FADBlock, including the Fused Fourier Convolution Mixer (FFCM) and Prior-Gated Feed-forward Network (PGFN). Unlike self-attention mechanisms, the FFCM conducts convolution operations in both spatial and frequency domains, endowing it with local-global capturing capabilities and efficiency. Simultaneously, the PGFN introduces residue channel prior in a gating manner to enhance local details and retain feature structure. Furthermore, we introduce a Frequency-domain Contrastive Regularization (FCR) during training. The FCR facilitates contrastive learning in the frequency domain and leverages rain streak patterns in negative samples to improve performance. Extensive experiments show the efficiency and effectiveness of our FADformer.

Keywords

• SID
• Frequency Learning
• Contrastive Regularization

Motivation

Method

Results

Pre-trained Models

Visual Results

Supplementary Material

For more visualizations, see the supplementary material.

References

Here is the BibTeX citation for the paper:

@inproceedings{gao2025efficient,
  title={Efficient Frequency-Domain Image Deraining with Contrastive Regularization},
  author={Gao, Ning and Jiang, Xingyu and Zhang, Xiuhui and Deng, Yue},
  booktitle={European Conference on Computer Vision},
  pages={240--257},
  year={2025},
  organization={Springer}
}

Other Acknowledgment

Part of our code is based on the Dehazeformer and Restormer. Some of the experimental results are based on the results collected by DRSformer, which is very comprehensive. Thanks for their awesome work.

Contact

If your submitted issue has not been noticed or there are further questions, please contact gaoning_ai@buaa.edu.cn.