Home

Awesome

<div align="center">

【CVPR'2024πŸ”₯】Bidirectional Multi-Scale Implicit Neural Representations for Image Deraining

</div>

Bidirectional Multi-Scale Implicit Neural Representations for Image Deraining

Xiang Chen, Jinshan Pan, Jiangxin Dong

Nanjing University of Science and Technology

Primary contact: Xiang Chen (chenxiang@njust.edu.cn)

πŸ“£ News

πŸ“– Research Website: [link] (A Survey on Image Deraining)

πŸ“Œ Overview

avatar

πŸ”‘ Setup

Type the command:

pip install -r requirements.txt

Install warmup scheduler

cd pytorch-gradual-warmup-lr; python setup.py install; cd ..

🧩 Dataset Preparation

DatasetsDownload Link
Rain200LBaidu Netdisk (s2yx)
Rain200HBaidu Netdisk (z9br)
DID-DataBaidu Netdisk (5luo)
DDN-DataBaidu Netdisk (ldzo)
SPA-DataBaidu Netdisk (yjow)

πŸ› οΈ Training and Testing

  1. Please download the corresponding datasets and put them in the folder Datasets/.
  2. Follow the instructions below to begin training our model.
bash train.sh

Run the script then you can find the generated experimental logs in the folder checkpoints.

  1. Follow the instructions below to begin testing our model.
python test.py

Run the script then you can find the output visual results in the folder results/.

πŸ€– Pre-trained Models

ModelsNeRD-Rain-SNeRD-Rain
Rain200LGoogle Drive / Baidu Netdisk (thga)Google Drive / Baidu Netdisk (ub1n)
Rain200HGoogle Drive / Baidu Netdisk (twg1)Google Drive / Baidu Netdisk (x45q)
DID-DataGoogle Drive / Baidu Netdisk (bljv)Google Drive / Baidu Netdisk (n37f)
DDN-DataGoogle Drive / Baidu Netdisk (10ut)Google Drive / Baidu Netdisk (01m0)
SPA-DataGoogle Drive / Baidu Netdisk (p7h9)Google Drive / Baidu Netdisk (mhkn)

🚨 Performance Evaluation

See folder "evaluations"

  1. for Rain200L/H and SPA-Data datasets: PSNR and SSIM results are computed by using this Matlab Code.

  2. for DID-Data and DDN-Data datasets: PSNR and SSIM results are computed by using this Matlab Code.

<img src = "figs/table.png">

πŸš€ Visual Deraining Results

MethodsDualGCNSPDNetUformerRestormer
Rain200LBaidu Netdisk (v8qy)Baidu Netdisk (y39h)Baidu Netdisk (N/A)Baidu Netdisk (6a2z)
Rain200HBaidu Netdisk (jnc9)Baidu Netdisk (mry2)Baidu Netdisk (N/A)Baidu Netdisk (9m1r)
DID-DataBaidu Netdisk (3gdx)Baidu Netdisk (klci)Baidu Netdisk (4uur)Baidu Netdisk (1hql)
DDN-DataBaidu Netdisk (1mdx)Baidu Netdisk (19bm)Baidu Netdisk (39bj)Baidu Netdisk (crj4)
SPA-DataBaidu Netdisk (lkeb)Baidu Netdisk (dd98)Baidu Netdisk (N/A)Baidu Netdisk (b40z)
MethodsIDTDRSformerNeRD-Rain-SNeRD-Rain
Rain200LBaidu Netdisk (v4yd)Baidu Netdisk (hyuv)Baidu Netdisk (tur9)Baidu Netdisk (jdir)
Rain200HBaidu Netdisk (77i4)Baidu Netdisk (px2j)Baidu Netdisk (g05m)Baidu Netdisk (2l0w)
DID-DataBaidu Netdisk (8uxx)Baidu Netdisk (t879)Baidu Netdisk (p2h6)Baidu Netdisk (yerc)
DDN-DataBaidu Netdisk (0ey6)Baidu Netdisk (9vtz)Baidu Netdisk (f10x)Baidu Netdisk (6stc)
SPA-DataBaidu Netdisk (b862)Baidu Netdisk (bl4n)Baidu Netdisk (c6ky)Baidu Netdisk (lhyw)

πŸ”Ž More Results

MethodsModelsDescriptions
model_MPRNet.pyGoogle DriveExtension to CNN-based UNet, see Table 6.

πŸ‘ Acknowledgement

Thanks for their awesome works (DeepRFT and NeRCo).

πŸ“˜ Citation

Please consider citing our work as follows if it is helpful.

@InProceedings{NeRD-Rain,
    author={Chen, Xiang and Pan, Jinshan and Dong, Jiangxin}, 
    title={Bidirectional Multi-Scale Implicit Neural Representations for Image Deraining},
    booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
    month={June},
    year={2024}
}