Home

Awesome

Dif-Fusion

This is Pytorch implementation for “Dif-Fusion: Toward High Color Fidelity in Infrared and Visible Image Fusion with Diffusion Models”

Overview

teaser The overall framework for Dif-Fusion

Fusion examples

teaser

Running the code

Run train_ddpm.py to train a diffusion model for infrared and visible images.

Run train_fusion_head.py to train the fusion model.

Run t_fusion.py to obtain the fused color images.

Please set paths to infrared and visible image folds in train_xxx.py its corresponding json files. If there are trained models, set paths to these files in xxxx.json.

BibTeX

@ARTICLE{Diffusioncolor ,
  author={Yue, Jun and Fang, Leyuan and Xia, Shaobo and Deng, Yue and Ma, Jiayi},
  journal={IEEE Transactions on Image Processing}, 
  title={Dif-Fusion: Toward High Color Fidelity in Infrared and Visible Image Fusion With Diffusion Models}, 
  year={2023},
  volume={32},
  pages={5705-5720},
  doi={10.1109/TIP.2023.3322046}}