Home

Awesome

<p align=center>Awesome Diffusion Models In Low-level Vision Awesome </p>

<p align=center>🔥A curated list of awesome <b>Diffusion Models(DMs)</b> in low-level vision.🔥</p> <p align=center>Please feel free to offer your suggestions in the Issues and pull requests to add links.</p> <p align=center><b>[ Last updated at 2024/10/12 ]</b></p>

Contents

<a id="3.">Latest Works Recommended</a>

Diffusion Models in Low-Level Vision: A Survey<br />Chunming He, Yuqi Shen, Chengyu Fang, Fengyang Xiao, Longxiang Tang, Yulun Zhang, Wangmeng Zuo, Zhenhua Guo, Xiu Li<br />arXiv 2024. [Paper] <br />June 2024<br />

Reti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Model<br />Chunming He, Chengyu Fang, Yulun Zhang, Kai Li, Longxiang Tang, Chenyu You, Fengyang Xiao, Zhenhua Guo, Xiu Li<br /> arXiv 2023. [Paper] [Code]<br /> March 2024<br />

<a id="Papers">Papers</a>

<a id="1.">1. Diffusion Models For Natural Image Restoration</a>

<a id="1.1">1.1 General-purpose Image Restoration</a>

<a id="1.1.1">1.1.1 Zero-shot DM-based IR</a>
ReleaseMethodTitlePub.Link
2024/09DDPGImage Restoration by Denoising Diffusion Models with Iteratively Preconditioned Guidance<br /><sup><sub>Tomer Garber,Tom Tirer</sup></sub>CVPR<br />2024Paper/Code
2024/07DAVIDAVI: Diffusion Prior-Based Amortized Variational Inference for Noisy Inverse Problems<br /><sup><sub>Sojin Lee, Dogyun Park, Inho Kong, Hyunwoo J. Kim</sup></sub>ECCV<br />2024Paper/Code
2024/07-Prototype Clustered Diffusion Models for Versatile Inverse Problems<br /><sup><sub>Jinghao Zhang, Zizheng Yang, Qi Zhu, Feng Zhao</sup></sub>arXiv<br />2024Paper/
2024/07ZAPSZero-Shot Adaptation for Approximate Posterior Sampling of Diffusion Models in Inverse Problems<br /><sup><sub>Yaşar Utku Alçalar, Mehmet Akçakaya</sup></sub>ECCV<br />2024Paper/Code
2024/07DDIP3DDeep Diffusion Image Prior for Efficient OOD Adaptation in 3D Inverse Problems<br /><sup><sub>Hyungjin Chung, Jong Chul Ye</sup></sub>ECCV<br />2024Paper/Code
2024/07MoE-DiffIRMoE-DiffIR: Task-customized Diffusion Priors for Universal Compressed Image Restoration<br /><sup><sub>Yulin Ren, Xin Li, Bingchen Li, Xingrui Wang, Mengxi Guo, Shijie Zhao, Li Zhang, Zhibo Chen</sup></sub>ECCV<br />2024Paper/Code
2024/03OsmosisOsmosis: RGBD Diffusion Prior for Underwater Image Restoration<br /><sup><sub>Opher Bar Nathan, Deborah Levy, Tali Treibitz, Dan Rosenbaum</sup></sub>ECCV<br />2024Paper/Code
2024/03DCDPDecoupled Data Consistency with Diffusion Purification for Image Restoration<br /><sup><sub>Xiang Li, Soo Min Kwon, Ismail R. Alkhouri, Saiprasad Ravishankar, Qing Qu</sup></sub>arXiv<br />2024Paper/Code
2024/03Diff-PluginDiff-Plugin: Revitalizing Details for Diffusion-based Low-level Tasks<br /><sup><sub>Yuhao Liu, Zhanghan Ke, Fang Liu, Nanxuan Zhao, Rynson W.H. Lau</sup></sub>CVPR<br />2024Paper/Code
2023/11DeqIRDeep Equilibrium Diffusion Restoration with Parallel Sampling<br /><sup><sub>Jiezhang Cao, Yue Shi, Kai Zhang, Yulun Zhang, Radu Timofte, Luc Van Gool</sup></sub>CVPR<br />2024Paper/Code
2023/09PGDiffPGDiff: Guiding Diffusion Models for Versatile Face Restoration via Partial Guidance<br /><sup><sub>Peiqing Yang, Shangchen Zhou, Qingyi Tao, Chen Change Loy</sup></sub>NeurIPS<br />2023Paper/Code
2023/05DiffPIRDenoising diffusion models for plug-and-play image restoration<br /><sup><sub>Yuanzhi Zhu, Kai Zhang, Jingyun Liang, Jiezhang Cao, Bihan Wen, Radu Timofte, Luc Van Gool</sup></sub>CVPR<br />2023Paper/Code
2023/05RED-DiffA Variational Perspective on Solving Inverse Problems with Diffusion Models<br /><sup><sub>Morteza Mardani, Jiaming Song, Jan Kautz, Arash Vahdat</sup></sub>arXiv<br />2023Paper/
2023/04GDPGenerative Diffusion Prior for Unified Image Restoration and Enhancement<br /><sup><sub>Ben Fei, Zhaoyang Lyu, Liang Pan, Junzhe Zhang, Weidong Yang, Tianyue Luo, Bo Zhang, Bo Dai</sup></sub>CVPR<br />2023Paper/Code
2023/04-Score-Based Diffusion Models as Principled Priors for Inverse Imaging<br /><sup><sub>Berthy T. Feng, Jamie Smith, Michael Rubinstein, Huiwen Chang, Katherine L. Bouman, William T. Freeman</sup></sub>arXiv<br />2023Paper/
2023/03-Unlimited-Size Diffusion Restoration<br /><sup><sub>Yinhuai Wang, Jiwen Yu, Runyi Yu, Jian Zhang</sup></sub>CVPR<br />2023Paper/Code
2023/02πGDMPseudoinverse-Guided Diffusion Models for Inverse Problems<br /><sup><sub>Jiaming Song, Arash Vahdat, Morteza Mardani, Jan Kautz</sup></sub>ICLR<br />2023Paper/
2022/12ADIRADIR: Adaptive Diffusion for Image Reconstruction<br /><sup><sub>Shady Abu-Hussein, Tom Tirer, Raja Giryes</sup></sub>arXiv<br />2022Paper/
2022/12DDNMZero-Shot Image Restoration Using Denoising Diffusion Null-Space Model<br /><sup><sub>Yinhuai Wang, Jiwen Yu, Jian Zhang</sup></sub>ICLR<br />2023Paper/Code
2022/09DPSDiffusion Posterior Sampling for General Noisy Inverse Problems<br /><sup><sub>Hyungjin Chung, Jeongsol Kim, Michael T. Mccann, Marc L. Klasky, Jong Chul Ye</sup></sub>CVPR<br />2023Paper/Code
2022/01MCGImproving diffusion models for inverse problems using manifold constraints<br /><sup><sub>Hyungjin Chung, Byeongsu Sim, Dohoon Ryu, Jong Chul Ye</sup></sub>NeurIPS<br />2022Paper/Code
2022/01DDRMDenoising Diffusion Restoration Models<br /><sup><sub>Bahjat Kawar, Michael Elad, Stefano Ermon, Jiaming Song</sup></sub>NeurIPS<br />2022Paper/Code
2021/12CCDFCome-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contraction<br /><sup><sub>Hyungjin Chung, Byeongsu Sim, Jong Chul Ye</sup></sub>CVPR<br />2022Paper/
2021/08ILVRILVR: Conditioning Method for Denoising Diffusion Probabilistic Models<br /><sup><sub>Jooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon, Sungroh Yoon</sup></sub>ICCV<br />2021Paper/Code
2021/05SNeurIPSSNeurIPS: Solving Noisy Inverse Problems Stochastically<br /><sup><sub>Bahjat Kawar, Gregory Vaksman, Michael Elad</sup></sub>NeurIPS<br />2021Paper/Code
<a id="1.1.2">1.1.2 Supervised DM-based IR</a>
ReleaseMethodTitlePub.Link
2024/10ResfusionResfusion: Denoising Diffusion Probabilistic Models for Image Restoration Based on Prior Residual Noise<br /><sup><sub>Zhenning Shi, Haoshuai Zheng, Chen Xu, Changsheng Dong, Bin Pan, Xueshuo Xie, Along He, Tao Li, Huazhu Fu</sup></sub>NeurIPS<br /> 2024Paper/Code
2024/09DTPMLearning Diffusion Texture Priors for Image Restoration<br /><sup><sub>Tian Ye, Sixiang Chen, Wenhao Chai, Zhaohu Xing, Jing Qin, Ge Lin, Lei Zhu</sup></sub>CVPR<br />2024Paper/
2024/07DiffaceDifface: Blind face restoration with diffused error contraction<br /><sup><sub>Zongsheng Yue, Chen Change Loy</sup></sub>TPAMI<br />2024Paper/Code
2024/05AutoDIRAutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion<br /><sup><sub>Yitong Jiang, Zhaoyang Zhang, Tianfan Xue, Jinwei Gu</sup></sub>ECCV<br />2024Paper/Code
2024/04SUPIRScaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wild<br /><sup><sub>Fanghua Yu, Jinjin Gu, Zheyuan Li, Jinfan Hu, Xiangtao Kong, Xintao Wang, Jingwen He, Yu Qiao, Chao Dong</sup></sub>CVPR<br />2024Paper/Code
2024/03MPerceiverMultimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image Restoration<br /><sup><sub>Yuang Ai, Huaibo Huang, Xiaoqiang Zhou, Jiexiang Wang, Ran He</sup></sub>CVPR<br />2024Paper/
2024/03DiffUIRSelective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model<br /><sup><sub>Dian Zheng, Xiao-Ming Wu, Shuzhou Yang, Jian Zhang, Jian-Fang Hu, Wei-Shi Zheng</sup></sub>CVPR<br />2024Paper/Code
2024/03-Efficient Diffusion Model for Image Restoration by Residual Shifting<br /><sup><sub>Yuanzhi Zhu, Kai Zhang, Jingyun Liang, Jiezhang Cao, Bihan Wen, Radu Timofte, Luc Van Gool</sup></sub>arXiv<br />2024Paper/Code
2024/02WaveDMWaveDM: Wavelet-Based Diffusion Models for Image Restoration<br /><sup><sub>Yi Huang, Jiancheng Huang, Jianzhuang Liu, Mingfu Yan, Yu Dong, Jiaxi Lv</sup></sub>IEEE Trans Multimedia<br />2024Paper/Code
2023/11WF-DiffWavelet-based Fourier Information Interaction with Frequency Diffusion Adjustment for Underwater Image Restoration<br /><sup><sub>Chen Zhao, Weiling Cai, Chenyu Dong, Chengwei Hu</sup></sub>CVPR<br />2024Paper/Code
2023/10Event-DiffusionEvent-Diffusion: Event-Based Image Reconstruction and Restoration with Diffusion Models<br /><sub>Quanmin Liang, Xiawu Zheng, Kai Huang, Yan Zhang, Jie Chen, Yonghong Tian</sub>MM<br />2023Paper/
2023/10C2F-DFTLearning A Coarse-to-Fine Diffusion Transformer for Image Restoration<br /><sub>Liyan Wang, Qinyu Yang, Cong Wang, Wei Wang, Jinshan Pan, Zhixun Su</sub>arXiv<br />2023Paper/Code
2023/08RDDMResidual Denoising Diffusion Models<br /><sup><sub>Jiawei Liu, Qiang Wang, Huijie Fan, Yinong Wang, Yandong Tang, Liangqiong Qu</sup></sub>CVPR<br />2024Paper/Code
2023/07PiRNPhysics-Driven Turbulence Image Restoration with Stochastic Refinement<br /><sup><sub>Ajay Jaiswal, Xingguang Zhang, Stanley H. Chan, Zhangyang Wang</sup></sub>ICCV<br />2023Paper/Code
2023/08DiffBIRDiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior<br /><sup><sub>Xinqi Lin, Jingwen He, Ziyan Chen, Zhaoyang Lyu, Bo Dai, Fanghua Yu, Wanli Ouyang, Yu Qiao, Chao Dong</sup></sub>arXiv<br />2023Paper/Code
2023/07SinDDMSinDDM: A Single Image Denoising Diffusion Model<br /><sup><sub>Vladimir Kulikov, Shahar Yadin, Matan Kleiner, Tomer Michaeli</sup></sub>ICML<br />2023Paper/Code
2023/07IDMTowards Authentic Face Restoration with Iterative Diffusion Models and Beyond<br /><sup><sub>Yang Zhao, Tingbo Hou, Yu-Chuan Su, Xuhui Jia. Yandong Li, Matthias Grundmann</sup></sub>ICCV<br />2023Paper/
2023/05InDIInversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restoration<br/><sup><sub>Mauricio Delbracio, Peyman Milanfar</sup></sub>arXiv<br />2023Paper/Code
2023/05UCDIRA Unified Conditional Framework for Diffusion-based Image Restoration<br/><sup><sub>Yi Zhang, Xiaoyu Shi, Dasong Li, Xiaogang Wang, Jian Wang, Hongsheng Li</sup></sub>NeurIPS<br />2023Paper/Code
2023/03DiracDiffusionDiracDiffusion: Denoising and Incremental Reconstruction with Assured Data-Consistency<br /><sup><sub>Zalan Fabian, Berk Tinaz, Mahdi Soltanolkotabi</sup></sub>arXiv<br />2023Paper/
2023/04RefusionRefusion: Enabling Large-Size Realistic Image Restoration with Latent-Space Diffusion Models<br /><sup><sub>Ziwei Luo, Fredrik K. Gustafsson, Zheng Zhao, Jens Sjölund, Thomas B. Schön</sup></sub>CVPRW<br />2023Paper/Code
2023/01IR-SDEImage Restoration with Mean-Reverting Stochastic Differential Equations<br /><sup><sub>Ziwei Luo, Fredrik K. Gustafsson, Zheng Zhao, Jens Sjölund, Thomas B. Schön</sup></sub>ICML<br />2023Paper/Code
2021/12LDMHigh-resolution image synthesis with latent diffusion models<br /><sup><sub>Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, Björn Ommer</sup></sub>CVPR<br />2022Paper/Code

<a id="1.2">1.2 Task-specific Image Restoration</a>

<a id="1.2.1">1.2.1 Super Resolution (SR)</a>
ReleaseMethodTitlePub.Link
2024/09SinSRSinSR: Diffusion-Based Image Super-Resolution in a Single Step<br /><sup><sub>Yufei Wang, Wenhan Yang, Xinyuan Chen, Yaohui Wang, Lanqing Guo, Lap-Pui Chau, Ziwei Liu, Yu Qiao, Alex C. Kot, Bihan Wen</sup></sub>CVPR<br />2024Paper/Code
2024/09CCSRImproving the Stability and Efficiency of Diffusion Models for Content Consistent Super-Resolution<br /><sup><sub>Lingchen Sun, Rongyuan Wu, Jie Liang, Zhengqiang Zhang, Hongwei Yong, Lei Zhang</sup></sub>arXiv<br />2024Paper/Code
2024/07DiWaWaving goodbye to low-res: A diffusion-wavelet approach for image super-resolution<br /><sup><sub>Brian B. Moser, Stanislav Frolov, Federico Raue, Sebastian Palacio, Andreas Dengel</sup></sub>IJCNN<br />2024Paper/
2024/05CDFormerCDFormer:When Degradation Prediction Embraces Diffusion Model for Blind Image Super-Resolution<br /><sup><sub>Qingguo Liu, Chenyi Zhuang, Pan Gao, Jie Qin</sup></sub>CVPR<br />2024Paper/Code
2024/4OmniSSROmniSSR: Zero-shot Omnidirectional Image Super-Resolution using Stable Diffusion Model<br /><sup><sub>Runyi Li, Xuhan Sheng, Weiqi Li, Jian Zhang</sup></sub>ECCV<br />2024Paper/Code
2024/04DiffMSRRethinking Diffusion Model for Multi-Contrast MRI Super-Resolution<br /><sup><sub>Guangyuan Li, Chen Rao, Juncheng Mo, Zhanjie Zhang, Wei Xing, Lei Zhao</sup></sub>CVPR<br />2024Paper/Code
2024/04DiSR-NeRFDiSR-NeRF: Diffusion-Guided View-Consistent Super-Resolution NeRF<br /><sup><sub>Jie Long Lee, Chen Li, Gim Hee Lee</sup></sub>CVPR<br />2024Paper/Code
2024/03RefDiffBuilding Bridges across Spatial and Temporal Resolutions: Reference-Based Super-Resolution via Change Priors and Conditional Diffusion Model<br /><sup><sub>Runmin Dong, Shuai Yuan, Bin Luo, Mengxuan Chen, Jinxiao Zhang, Lixian Zhang, Weijia Li, Juepeng Zheng, Haohuan Fu</sup></sub>CVPR<br />2024Paper/Code
2024/03SARGDSelf-Adaptive Reality-Guided Diffusion for Artifact-Free Super-Resolution<br /><sup><sub>--</sup></sub>CVPR<br />2024Paper/Code
2024/03-Arbitrary-Scale Image Generation and Upsampling using Latent Diffusion Model and Implicit Neural Decoder<br /><sup><sub>Jinseok Kim, Tae-Kyun Kim</sup></sub>CVPR<br />2024Paper/Code
2024/03XPSRXPSR: Cross-modal Priors for Diffusion-based Image Super-Resolution<br /><sup><sub>Yunpeng Qu, Kun Yuan, Kai Zhao, Qizhi Xie, Jinhua Hao, Ming Sun, Chao Zhou</sup></sub>ECCV<br />2024Paper/Code
2024/02SAM-DiffSRSAM-DiffSR: Structure-Modulated Diffusion Model for Image Super-Resolution<br /><sub>Chengcheng Wang, Zhiwei Hao, Yehui Tang, Jianyuan Guo, Yujie Yang, Kai Han, Yunhe Wang</sub>arXiv<br />2024Paper/Code
2024/01SeeSRSeeSR: Towards Semantics-Aware Real-World Image Super-Resolution<br /><sup><sub>Rongyuan Wu, Tao Yang, Lingchen Sun, Zhengqiang Zhang, Shuai Li, Lei Zhang</sup></sub>CVPR<br />2024Paper/Code
2023/12DiffTSRDiffusion-based Blind Text Image Super-Resolution<br /><sup><sub>Yuzhe Zhang, Jiawei Zhang, Hao Li, Zhouxia Wang, Luwei Hou, Dongqing Zou, Liheng Bian</sup></sub>CVPR<br />2024Paper/Code
2023/12stisr-tcdmScene Text Image Super-resolution based on Text-conditional Diffusion Models<br /><sub>Chihiro Noguchi, Shun Fukuda, Masao Yamanaka</sub>WACV<br />2024Paper/Code
2023/11CoSeRCoSeR: Bridging Image and Language for Cognitive Super-Resolution<br /><sup><sub>Haoze Sun, Wenbo Li, Jianzhuang Liu, Haoyu Chen, Renjing Pei, Xueyi Zou, Youliang Yan, Yujiu Yang</sup></sub>CVPR<br />2024Paper/Code
2023/10MoESRImage Super-resolution Via Latent Diffusion: A Sampling-space Mixture Of Experts And Frequency-augmented Decoder Approach<br /><sup><sub>Feng Luo, Jinxi Xiang, Jun Zhang, Xiao Han, Wei Yang</sup></sub>arXiv<br />2023Paper/Code
2023/09-License Plate Super-Resolution Using Diffusion Models<br /><sup><sub>Sawsan AlHalawani, Bilel Benjdira, Adel Ammar, Anis Koubaa, Anas M. Ali</sup></sub>arXiv<br />2023Paper/
2023/08PASDPixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization<br /><sup><sub>Tao Yang, Rongyuan Wu, Peiran Ren, Xuansong Xie, Lei Zhang</sup></sub>arXiv<br />2023Paper/Code
2023/07ResShiftResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shifting<br /><sup><sub>Zongsheng Yue, Jianyi Wang, Chen Change Loy</sup></sub>NeurIPS<br />2023Paper/Code
2023/07PartDiffPartDiff: Image Super-resolution with Partial Diffusion Models<br /><sup><sub>Axi Niu, Pham Xuan Trung, Kang Zhang, Jinqiu Sun, Yu Zhu, In So Kweon, Yanning Zhang</sup></sub>arXiv<br />2023Paper/
2023/07ACDMSRACDMSR: Accelerated Conditional Diffusion Models for Single Image Super-Resolution<br /><sup><sub>Axi Niu, Pham Xuan Trung, Kang Zhang, Jinqiu Sun, Yu Zhu, In So Kweon, Yanning Zhang</sup></sub>IEEE Trans. Broadcast.<br />2024Paper/
2023/05StableSRExploiting Diffusion Prior for Real-World Image Super-Resolution<br /><sup><sub>Jianyi Wang, Zongsheng Yue, Shangchen Zhou, Kelvin C.K. Chan, Chen Change Loy</sup></sub>arXiv<br />2023Paper/Code
2023/03DR2DR2: Diffusion-Based Robust Degradation Remover for Blind Face Restoration<br /><sup><sub>Zhixin Wang, Xiaoyun Zhang, Ziying Zhang, Huangjie Zheng, Mingyuan Zhou, Ya Zhang, Yanfeng Wang</sup></sub>CVPR<br />2023Paper/Code
2023/03ResDiffResDiff: Combining CNN and Diffusion Model for Image Super-Resolution<br /><sup><sub>Shuyao Shang, Zhengyang Shan, Guangxing Liu, Jinglin Zhang</sup></sub>AAAI<br />2024Paper/Code
2023/03IDMImplicit Diffusion Models for Continuous Super-Resolution<br /><sup><sub>Sicheng Gao, Xuhui Liu, Bohan Zeng, Sheng Xu, Yanjing Li, Xiaoyan Luo, Jianzhuang Liu, Xiantong Zhen, Baochang Zhang</sup></sub>CVPR<br />2023Paper/Code
2023/02-Denoising Diffusion Probabilistic Models for Robust Image Super-Resolution in the Wild<br /><sup><sub>Hshmat Sahak, Daniel Watson, Chitwan Saharia, David Fleet</sup></sub>arXiv<br />2023Paper/
2023/02CDPMSRCDPMSR: Conditional Diffusion Probabilistic Models for Single Image Super-Resolution<br /><sup><sub>Axi Niu, Kang Zhang, Trung X. Pham, Jinqiu Sun, Yu Zhu, In So Kweon, Yanning Zhang</sup></sub>arXiv<br />2023Paper/
2022/09SUE-SRFace Super-Resolution Using Stochastic Differential Equations<br /><sup><sub>Marcelo dos Santos, Rayson Laroca, Rafael O. Ribeiro, João Neves, Hugo Proença, David Menotti</sup></sub>SIGGRAPH<br />2022Paper/Code
2021/05CDMCascaded Diffusion Models for High Fidelity Image Generation<br /><sup><sub>Jonathan Ho, Chitwan Saharia, William Chan, David J. Fleet, Mohammad Norouzi, Tim Salimans.</sup></sub>JMLR<br />2022Paper/Code
2021/04SR3Image Super-Resolution via Iterative Refinement<br /><sup><sub>Chitwan Saharia, Jonathan Ho, William Chan, Tim Salimans, David J. Fleet, Mohammad Norouzi.</sup></sub>TPAMI<br />2022Paper/Code
2021/04SRDiffSRDiff: Single Image Super-Resolution with Diffusion Probabilistic Models <br/><sup><sub>H. Li, Y. Yang, M. Chang, S. Chen, H. Feng, Z. Xu, Q. Li, and Y. Chen.</sup></sub>Neurocomputing<br />2022Paper/Code
<a id="1.2.2">1.2.2 Inpainting</a>
ReleaseMethodTitlePub.Link
2024/09CAT-DiffusionImproving Text-guided Object Inpainting with Semantic Pre-inpainting<br/><sup><sub>Yifu Chen, Jingwen Chen, Yingwei Pan, Yehao Li, Ting Yao, Zhineng Chen, Tao Mei</sup></sub>ECCV<br />2024Paper/Code
2024/08GSDMText Image Inpainting via Global Structure-Guided Diffusion Models<br/><sup><sub>Shipeng Zhu, Pengfei Fang, Chenjie Zhu, Zuoyan Zhao, Qiang Xu, Hui Xue</sup></sub>AAAI<br />2024Paper/Code
2024/07PILOTCoherent and Multi-modality Image Inpainting via Latent Space Optimization<br/><sub>Lingzhi Pan, Tong Zhang, Bingyuan Chen, Qi Zhou, Wei Ke, Sabine Süsstrunk, Mathieu Salzmann</sub>arXiv<br />2024Paper/Code
2024/07DiffreeDiffree: Text-Guided Shape Free Object Inpainting with Diffusion Model<br/><sup><sub>Lirui Zhao, Tianshuo Yang, Wenqi Shao, Yuxin Zhang, Yu Qiao, Ping Luo, Kaipeng Zhang, Rongrong Ji</sup></sub>arxiv<br />2024Paper/Code
2024/03StrDiffusionStructure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpainting<br/><sup><sub>Haipeng Liu, Yang Wang, Biao Qian, Meng Wang, Yong Rui</sup></sub>CVPR<br />2024Paper/Code
2024/03MMGInpaintingMMGInpainting: Multi-Modality Guided Image Inpainting Based On Diffusion Models<br/><sup><sub>Cong Zhang, Wenxia Yang, Xin Li, Huan Han</sup></sub>IEEE Trans Multimedia<br />2024Paper/Code
2024/03BrushNetBrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusion<br/><sup><sub>Xuan Ju, Xian Liu, Xintao Wang, Yuxuan Bian, Ying Shan, Qiang Xu</sup></sub>arXiv<br />2024Paper/Code
2024/03-Fill in the ____ (a Diffusion-based Image Inpainting Pipeline)<br/><sup><sub>Eyoel Gebre, Krishna Saxena, Timothy Tran</sup></sub>arXiv<br />2024Paper/
2024/01LatentPaintLatentPaint: Image Inpainting in Latent Space With Diffusion Models<br/><sup><sub>Ciprian Corneanu, Raghudeep Gadde, Aleix M. Martinez</sup></sub>WACV<br />2024Paper/
2023/12-Amodal Completion via Progressive Mixed Context Diffusion<br/><sup><sub>Katherine Xu, Lingzhi Zhang, Jianbo Shi</sup></sub>CVPR<br />2024Paper/Code
2023/11TiramisuImage Inpainting via Tractable Steering of Diffusion Models<br/><sup><sub>Anji Liu, Mathias Niepert, Guy Van den Broeck</sup></sub>arXiv<br />2023Paper/Code
2023/10Uni-paintUni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Model<br/><sup><sub>Shiyuan Yang, Xiaodong Chen, Jing Liao</sup></sub>MM<br />2023Paper/Code
2023/09GradpaintGradpaint: Gradient-Guided Inpainting with Diffusion Models<br/><sup><sub>Asya Grechka, Guillaume Couairon, Matthieu Cord</sup></sub>CVIU<br />2024Paper/Code
2022/12SmartBrushSmartBrush: Text and Shape Guided Object Inpainting With Diffusion Model<br/><sup><sub>Shaoan Xie 1, Zhifei Zhang, Zhe Lin, Tobias Hinz, Kun Zhang*</sup></sub>CVPR<br />2023Paper/
2023/04CopaintTowards Coherent Image Inpainting Using Denoising Diffusion Implicit Models<br/><sup><sub>Guanhua Zhang, Jiabao Ji, Yang Zhang, Mo Yu, Tommi Jaakkola, Shiyu Chang</sup></sub>ICML<br />2023Paper/Code
2022/05PalettePalette: Image-to-image diffusion models<br/><sup><sub>C. Saharia, W. Chan, H. Chang, C. Lee, J. Ho, T. Salimans, D. Fleet, and M. Norouzi.</sup></sub>SIGGRAPH<br/>2022Paper/Code
2022/01RePaintRepaint: Inpainting using denoising diffusion probabilistic models<br/><sup><sub>A. Lugmayr, M. Danelljan, A. Romero, F. Yu, R. Timofte, and L. Van Gool.</sup></sub>CVPR<br />2022Paper/Code
<a id="1.2.3">1.2.3 Deblur</a>
ReleaseMethodTitlePub.Link
2024/04DiffeventDiffevent: Event Residual Diffusion for Image Deblurring<br /><sup><sub>Pei Wang, Jiumei He, Qingsen Yan, Yu Zhu, Jinqiu Sun, Yanning Zhang</sup></sub>ICASSP<br />2024Paper/Code
2024/01FastDiffusionEMFast Diffusion EM: a diffusion model for blind inverse problems with application to deconvolution<br /><sup><sub>Charles Laroche, Andrés Almansa, Eva Coupete</sup></sub>WACV<br />2024Paper/Code
2024/01SI-DDPM-FMOSingle-Image Deblurring, Trajectory and Shape Recovery of Fast Moving Objects With Denoising Diffusion Probabilistic Models<br /><sup><sub>Radim Spetlik, Denys Rozumnyi, Jiří Matas</sup></sub>WACV<br />2024Paper/Code
2023/12ID-BlauID-Blau: Image Deblurring by Implicit Diffusion-based reBLurring AUgmentation<br /><sup><sub>Jia-Hao Wu, Fu-Jen Tsai, Yan-Tsung Peng, Chung-Chi Tsai, Chia-Wen Lin, Yen-Yu Lin</sup></sub>CVPR<br />2024Paper/Code
2023/05HI-DiffHierarchical Integration Diffusion Model for Realistic Image Deblurring<br /><sup><sub>Zheng Chen, Yulun Zhang, Ding Liu, Bin Xia, Jinjin Gu, Linghe Kong, Xin Yuan</sup></sub>arXiv<br />2023Paper/
2022/12-Multiscale Structure Guided Diffusion for Image Deblurring<br /><sup><sub>M. Ren, M. Delbracio, H. Talebi, G. Gerig, and P. Milanfar.</sup></sub>ICCV<br />2023Paper/
2021/12DVSRDeblurring via Stochastic Refinement<br /><sup><sub>Jay Whang, Mauricio Delbracio, Hossein Talebi, Chitwan Saharia, Alexandros G. Dimakis, Peyman Milanfar</sup></sub>CVPR<br/>2022Paper/Code
<a id="1.2.4">1.2.4 Dehaze</a>
ReleaseMethodTitlePub.Link
2024/09DiffLI<sup>2</sup>DUnleashing the Potential of the Semantic Latent Space in Diffusion Models for Image Dehazing<br /><sup><sub>Zizheng Yang, Hu Yu, Bing Li, Jinghao Zhang, Jie Huang, Feng Zhao</sup></sub>ECCV<br />2024Paper/
2024/08-Image Dehazing Method Based on Diffusion Model<br /><sup><sub>Fengxu Guan; Haitao Lai; Hanyu Zang; Jinbao Huang</sup></sub>ICMA<br />2024Paper/
2024/08MP-DDPMA Multi-scale Patch Approach with Diffusion Model for Image Dehazing<br /><sup><sub>Yao Guo, Yongliang Wu & Changsheng Wan</sup></sub>ICIC<br />2024Paper/
2024/07FP-DiffFrequency-based and Physics-guiding Diffusion Model for Single Image Dehazing<br /><sup><sub>Siying Xie; Fuping Li; Mingye Ju</sup></sub>CCC<br />2024Paper/
2024/07DehazeDiffDehazeDiff: When Conditional Guidance Meets Diffusion Models for Image Dehazing<br /><sup><sub>Longyu Cheng, Xujin Ba, Yanyun Qu</sup></sub>ISCAS<br />2024Paper/
2024/05-Image Dehazing based on Iterative-Refining Diffusion Model<br /><sup><sub>Jiarong Wang, Hao Hu</sup></sub>ICIGP<br />2024Paper/
2024/04JCDMJoint Conditional Diffusion Model for Image Restoration with Mixed Degradations<br /><sub>Yufeng Yue, Meng Yu, Luojie Yang, Yi Yang</sub>arXiv<br />2024Paper/Code
2024/04DehazeDDPMHigh-quality Image Dehazing with Diffusion Model<br /><sub>Hu Yu, Jie Huang, Kaiwen Zheng, Feng Zhao</sub>arXiv<br />2024Paper/Code
2023/10DehazeDMDehazeDM: Image Dehazing via Patch Autoencoder Based on Diffusion Models<br /><sub>Yuming Yang; Dongsheng Zou; Xinyi Song; Xiaotong Zhang</sub>SMC<br />2023Paper
2023/08HazeAugFrequency Compensated Diffusion Model for Real-scene Dehazing<br /><sup><sub>Jing Wang, Songtao Wu, Kuanhong Xu, Zhiqiang Yuan</sup></sub>Neural Networks<br />2024Paper/Code
2022/11WeatherDiffRestoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Models<br /><sup><sub>Ozan Özdenizci, Robert Legenstein</sup></sub>TPAMI<br />2023Paper/Code
<a id="1.2.5">1.2.5 Low-light Enhancement</a>
ReleaseMethodTitlePub.Link
2024/10-Super-resolving Real-world Image Illumination Enhancement: A New Dataset and A Conditional Diffusion Model<br /><sup><sub>Yang Liu, Yaofang Liu, Jinshan Pan, Yuxiang Hui, Fan Jia, Raymond H. Chan, Tieyong Zeng</sup></sub>arXiv<br />2024Paper/Code
2024/09FourierDiffFourier Priors-Guided Diffusion for Zero-Shot Joint Low-Light Enhancement and Deblurring<br /><sup><sub>Xiaoqian Lv, Shengping Zhang, Chenyang Wang, Yichen Zheng, Bineng Zhong, Chongyi Li</sup></sub>CVPR<br />2024Paper/Code
2024/09DiffLightDiffLight: Integrating Content and Detail for Low-light Image Enhancement<br /><sup><sub>Yixu Feng, Shuo Hou, Haotian Lin, Yu Zhu, Peng Wu, Wei Dong, Jinqiu Sun, Qingsen Yan, Yanning Zhang</sup></sub>CVPR<br />2024Paper/
2024/09DLDiffDLDiff: Image Detail-guided Latent Diffusion Model for Low-Light Image Enhancement<br /><sup><sub>Minglong Xue; Yanyi He; Jinhong He; Senming Zhong</sup></sub>LSP<br />2024Paper/Code
2024/09-Low Light Image Enhancement Based on a Pyramid Diffusion Model<br /><sup><sub>Xiang Li; Chunling Liu; Hui Cheng</sup></sub>ISPDS<br />2024Paper/
2024/08-Image Intrinsic Components Guided Conditional Diffusion Model for Low-light Image Enhancement<br /><sup><sub>Sicong Kang; Shuaibo Gao; Wenhui Wu; Xu Wang; Shuoyao Wang; Guoping Qiu</sup></sub>TCSVT<br />2024Paper/
2024/08MDDELow Light Image Enhancement Based on Retinex Theory and Diffusion Model<br /><sup><sub>Tao Chen, Dongmei Liu</sup></sub>ICDSP<br />2024Paper/
2024/07PSC diffusionPSC diffusion: patch-based simplified conditional diffusion model for low-light image enhancement<br /><sup><sub>Fei Wan, Bingxin Xu, Weiguo Pan, Hongzhe Liu</sup></sub>Multimed. Syst.<br />2024Paper/
2024/07JoReS-DiffJoReS-Diff: Joint Retinex and Semantic Priors in Diffusion Model for Low-light Image Enhancement<br /><sup><sub>Yuhui Wu, Guoqing Wang, Zhiwen Wang, Yang Yang, Tianyu Li, Malu Zhang, Chongyi Li, Heng Tao Shen</sup></sub>MM<br />2024Paper/
2024/07AGLLDiffAGLLDiff: Guiding Diffusion Models Towards Unsupervised Training-free Real-world Low-light Image Enhancement<br /><sup><sub>Yunlong Lin, Tian Ye, Sixiang Chen, Zhenqi Fu, Yingying Wang, Wenhao Chai, Zhaohu Xing, Lei Zhu, Xinghao Ding</sup></sub>arXiv<br />2024Paper/Code
2024/07LightenDiffusionLightenDiffusion: Unsupervised Low-Light Image Enhancement with Latent-Retinex Diffusion Models<br /><sup><sub>Hai Jiang, Ao Luo, Xiaohong Liu, Songchen Han, Shuaicheng Liu</sup></sub>ECCV<br />2024Paper/Code
2024/07Zero-LEDZero-LED: Zero-Reference Lighting Estimation Diffusion Model for Low-Light Image Enhancement<br /><sup><sub>Jinhong He, Minglong Xue, Aoxiang Ning, Chengyun Song</sup></sub>arXiv<br />2024Paper/
2024/07-Enhancing Low-Light Images: A Novel Approach Combining Anisotropic Diffusion and Retinex<br /><sup><sub>Mingyang Sun; Ru Yi; Xinxin Wang; Ningtao Ma</sup></sub>CSCWD<br />2024Paper/
2024/07SVBoostLow Light Enhancement in Street Scenes Based on Diffusion Model<br /><sub>Rui Xia; Lisong Wang; Taili Li; Pingping Shi</sub>CSCWD<br />2024Paper/
2024/04LightDiffLight the Night: A Multi-Condition Diffusion Framework for Unpaired Low-Light Enhancement in Autonomous Driving<br /><sup><sub>Jinlong Li, Baolu Li, Zhengzhong Tu, Xinyu Liu, Qing Guo, Felix Juefei-Xu, Runsheng Xu, Hongkai Yu</sup></sub>CVPR<br />2024Paper/Code
2024/04-A ground-based dataset and a diffusion model for on-orbit low-light image enhancement<br /><sup><sub>Yiman Zhu, Lu Wang, Jingyi Yuan, Yu Guo</sup></sub>arXiv<br />2024Paper/
2024/04SG-DDPMSG-DDPM: Semantic-Guided Diffusion Model for Low-Light Image Enhancement<br /><sup><sub>Shize Wang</sup></sub>ICCECE<br />2024Paper/
2024/03MDMSMulti-Domain Multi-Scale Diffusion Model for Low-Light Image Enhancement<br /><sup><sub>Kai Shang, Mingwen Shao, Chao Wang, Yuanshuo Cheng, Shuigen Wang</sup></sub>AAAI<br />2024Paper/Code
2024/02TDSTDS: Two Diffusion Streams for Low-Light Image Enhancement<br /><sup><sub>Jieming Wang; Xianqin Liu; Yijun Zhang; Jianfang Hu</sup></sub>CSECS<br />2024Paper/
2024/01CFWDLow-light Image Enhancement via CLIP-Fourier Guided Wavelet Diffusion<br /><sup><sub>Minglong Xue, Jinhong He, Yanyi He, Zhipu Liu, Wenhai Wang, Mingliang Zhou</sup></sub>arXiv<br />2024Paper/Code/
2023/12L<sup>2</sup>DML<sup>2</sup>DM: A Diffusion Model for Low-Light Image Enhancement<br /><sup><sub>Lv, Xingguo and Dong, Xingbo and Jin, Zhe and Zhang, Hui and Song, Siyi and Li, Xuejun</sup></sub>PRCV<br />2023Paper/Code
2023/11Reti-DiffReti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Model<br /><sup><sub>Chunming He, Chengyu Fang, Yulun Zhang, Kai Li, Longxiang Tang, Chenyu You, Fengyang Xiao, Zhenhua Guo, Xiu Li</sup></sub>arXiv<br />2023Paper/Code
2023/10GASDGlobal Structure-Aware Diffusion Process for Low-Light Image Enhancement<br /><sup><sub>Jinhui Hou, Zhiyu Zhu, Junhui Hou, Hui Liu, Huanqiang Zeng, Hui Yuan</sup></sub>NeurIPS<br />2023Paper/Code
2023/10CLEDiffusionCLE Diffusion: Controllable Light Enhancement Diffusion Model<br /><sup><sub>Yuyang Yin, Dejia Xu, Chuangchuang Tan, Ping Liu, Yao Zhao, Yunchao Wei</sup></sub>MM<br />2023Paper/Code
2023/10LLDELLDE: Enhancing Low-Light Images with Diffusion Model<br /><sup><sub>Xin Peng Oo, Chee Seng Chan</sup></sub>ICIP<br />2023Paper/Code
2023/09-Bootstrap Diffusion Model Curve Estimation for High Resolution Low-Light Image Enhancement<br /><sup><sub>Jiancheng Huang, Yifan Liu, Shifeng Chen</sup></sub>PRICAI<br /> 2023Paper/
2023/08DiffLLEDiffLLE: Diffusion-guided Domain Calibration for Unsupervised Low-light Image Enhancement<br /><sup><sub>Shuzhou Yang, Xuanyu Zhang, Yinhuai Wang, Jiwen Yu, Yuhan Wang, Jian Zhang</sup></sub>arXiv<br />2023Paper/
2023/08ExposureDiffusionExposureDiffusion: Learning to Expose for Low-light Image Enhancement<br /><sup><sub>Yufei Wang, Yi Yu, Wenhan Yang, Lanqing Guo, Lap-Pui Chau, Alex C. Kot, Bihan Wen</sup></sub>ICCV<br />2023Paper/Code
2023/08Diff-RetinexDiff-Retinex: Rethinking Low-light Image Enhancement with A Generative Diffusion Model<br /><sup><sub>Xunpeng Yi, Han Xu, Hao Zhang, Linfeng Tang, Jiayi Ma</sup></sub>ICCV<br />2023Paper/Code
2023/08CLE DiffusionCLE Diffusion: Controllable Light Enhancement Diffusion Model<br /><sup><sub>Yuyang Yin, Dejia Xu, Chuangchuang Tan, Ping Liu, Yao Zhao, Yunchao Wei</sup></sub>MM<br />23Paper/Code
2023/07LLDiffusionLLDiffusion: Learning Degradation Representations in Diffusion Models for Low-Light Image Enhancement<br /><sup><sub>Tao Wang, Kaihao Zhang, Ziqian Shao, Wenhan Luo, Bjorn Stenger, Tae-Kyun Kim, Wei Liu, Hongdong Li</sup></sub>arXiv<br />2023Paper/Code
2023/07DiffLIEDiffLIE: Low-Light Image Enhancment based on Deep Diffusion Model<br /><sup><sub>Guanyu Wu; Cheng. Jin</sup></sub>ISCTIS<br />2023Paper/
2023/06-Diffusion Model Based Low-Light Image Enhancement for Space Satellite<br /><sup><sub>Yiman Zhu, Lu Wang, Jingyi Yuan, Yu Guo</sup></sub>arXiv<br />2023Paper/
2023/05PyDiffPyramid Diffusion Models For Low-light Image Enhancement<br /><sup><sub>Dewei Zhou, Zongxin Yang, Yi Yang</sup></sub>IJCAI<br />2023Paper/Code
2023/03LPDMDenoising Diffusion Post-Processing for Low-Light Image Enhancement<br /><sup><sub>Savvas Panagiotou, Anna S. Bosman</sup></sub>arXiv<br />2023Paper/Code
2023/03DiDDiffusion in the Dark: A Diffusion Model for Low-Light Text Recognition<br /><sup><sub>Cindy M. Nguyen, Eric R. Chan, Alexander W. Bergman, Gordon Wetzstein</sup></sub>WACV<br />2024Paper/Code
2023/01DiffLLLow-Light Image Enhancement with Wavelet-based Diffusion Models<br /><sup><sub>Hai Jiang, Ao Luo, Songchen Han, Haoqiang Fan, Shuaicheng Liu</sup></sub>TOG<br />2023Paper/Code
<a id="1.2.6">1.2.6 Image Fusion</a>
ReleaseMethodTitlePub.Link
2024/12MADMFuseMADMFuse: A multi-attribute diffusion model to fuse infrared and visible images<br /><sup><sub>Hang Xu, Rencan Nie, Jinde Cao, Mingchuan Tan, Zhengze Ding</sup></sub>DSP<br />2024Paper/
2024/10Diff-IFDiff-IF: Multi-modality image fusion via diffusion model with fusion knowledge prior<br /><sup><sub>Xunpeng Yi, Linfeng Tang, Hao Zhang, Han Xu, Jiayi Ma</sup></sub>Inf. Fusion 2024Paper/Code
2024/08LFDT-FusionLFDT-Fusion: A latent feature-guided diffusion Transformer model for general image fusion<br /><sub>Bo Yang, Zhaohui Jiang, Dong Pan, Haoyang Yu, Gui Gui, Weihua Gui</sub>Inf. Fusion 2025Paper/Code
2024/07FusionDiffFusionDiff: A unified image fusion network based on diffusion probabilistic models<br /><sub>Zefeng Huang, Shen Yang , Jin Wu, Lei Zhu, Jin Liu</sub>CVIU<br />2024Paper/
2024/07GLADGLAD: A Global-Attention-Based Diffusion Model for Infrared and Visible Image Fusion<br /><sub>Haozhe Guo, Mengjie Chen, Kaijiang Li, Hao Su, and Pei Lv</sub>ICIC<br />2024Paper/
2024/04Dif-PANDiffusion model with disentangled modulations for sharpening multispectral and hyperspectral images<br /><sub>Zihan Cao, Shiqi Cao, Liang-Jian Deng, Xiao Wu, Junming Hou, Gemine Vivone</sub>Inf. Fusion<br />2024Paper/Code
2023/06FusionDiffFusionDiff: Multi-focus image fusion using denoising diffusion probabilistic models<br /><sup><sub>Mining Li, Ronghao Pei, Tianyou Zheng, Yang Zhang, Weiwei Fu</sup></sub>ESWA<br />2024Paper/Code
2023/04DDRFDDRF: Denoising Diffusion Model for Remote Sensing Image Fusion<br /><sup><sub>ZiHan Cao, ShiQi Cao, Xiao Wu, JunMing Hou, Ran Ran, Liang-Jian Deng</sup></sub>arXiv<br />2023Paper/
2023/03DDFMDDFM: Denoising Diffusion Model for Multi-Modality Image Fusion<br /><sup><sub>Zixiang Zhao, Haowen Bai, Yuanzhi Zhu, Jiangshe Zhang, Shuang Xu, Yulun Zhang, Kai Zhang, Deyu Meng, Radu Timofte, Luc Van Gool</sup></sub>ICCV<br />2023Paper/Code
2023/01Dif-FusionDif-Fusion: Towards High Color Fidelity in Infrared and Visible Image Fusion with Diffusion Models<br /><sup><sub>Jun Yue, Leyuan Fang, Shaobo Xia, Yue Deng, Jiayi Ma</sup></sub>TIP<br />2023Paper/Code

<a id="2.">2. Extended Diffusion Models In Low-level Vision</a>

<a id="2.1">2.1 Diffusion Models In Low-level Medical Image Analysis</a>

<a id="2.1.1">2.1.1 MRI</a>
ReleaseMethodTitlePub.Link
2024/08DiMODiffusion Modeling with Domain-conditioned Prior Guidance for Accelerated MRI and qMRI Reconstruction<br /><sup><sub>Wanyu Bian, Albert Jang, Liping Zhang, Xiaonan Yang, Zachary Stewart, Fang Liu</sup></sub>TMI<br />2024Paper/
2024/04DiffMSRRethinking Diffusion Model for Multi-Contrast MRI Super-Resolution<br /><sup><sub>Guangyuan Li, Chen Rao, Juncheng Mo, Zhanjie Zhang, Wei Xing, Lei Zhao</sup></sub>CVPR<br />2024Paper/Code
2024/05PPNFast Controllable Diffusion Models for Undersampled MRI Reconstruction<br /><sup><sub>Wei Jiang, Zhuang Xiong, Feng Liu, Nan Ye, Hongfu Sun</sup></sub>ISIB<br />2024Paper/
2024/02MRPDMRPD: Undersampled MRI reconstruction by prompting a large latent diffusion model<br /><sup><sub>Ziqi Gao, S. Kevin Zhou</sup></sub>arxiv<br />2024Paper/Code
2024/01HFS-SDEHigh-Frequency Space Diffusion Model for Accelerated MRI<br /><sup><sub>Chentao Cao, Zhuo-Xu Cui, Yue Wang, Shaonan Liu, Taiin Chen, Hairong Zheng</sup></sub>TMI<br />2024Paper/Code
2023/10SMRDSMRD: SURE-Based Robust MRI Reconstruction with Diffusion Models<br /><sup><sub>Batu Ozturkler, Chao Liu, Benjamin Eckart, Morteza Mardani, Jiaming Song, Jan Kautz</sup></sub>MICCAI<br />2023Paper/Code
2023/10InverseSRInverseSR: 3D Brain MRI Super-Resolution Using a Latent Diffusion Model<br /><sup><sub>Jueqi Wang, Jacob Levman, Walter Hugo Lopez Pinaya, Petru-Daniel Tudosiu, M. Jorge Cardoso & Razvan Marinescu</sup></sub>MICCAI<br />2023Paper/Code
2023/10DisC-DiffDisC-Diff: Disentangled Conditional Diffusion Model for Multi-contrast MRI Super-Resolution<br /><sup><sub>Ye Mao, Lan Jiang, Xi Chen, Chao Li</sup></sub>MICCAI<br />2023Paper/Code
2023/10CDiffMRCDiffMR: Can We Replace the Gaussian Noise with K-Space Undersampling for Fast MRI?<br /><sup><sub>Jiahao Huang, Angelica I. Aviles-Rivero, Carola-Bibiane Schönlieb, Guang Yang</sup></sub>MICCAI<br />2023Paper/Code
2023/10SSDiffReconSelf-supervised MRI Reconstruction with Unrolled Diffusion Models<br /><sup><sub>Yilmaz Korkmaz, Tolga Cukur, Vishal M. Patel</sup></sub>MICCAI<br />2023Paper/Code
2023/08-Super-resolution of brain MRI images based on denoising diffusion probabilistic model<br /><sup><sub>Zhanxiong Wu, Xuanheng Chen, Sangma Xie, Jian Shen, Yu Zeng</sup></sub>BSPC<br />2023Paper/
2023/03-Bayesian MRI reconstruction with joint uncertainty estimation using diffusion models<br /><sup><sub>Guanxiong Luo, Moritz Blumenthal, Martin Heide, Martin Uecker</sup></sub>MRM<br />2023Paper/
2022/09MC-DDPMMeasurement-Conditioned Denoising Diffusion Probabilistic Model for Under-Sampled Medical Image Reconstruction<br /><sup><sub>Yutong Xie, Quanzheng Li</sup></sub>MICCAI<br />2022Paper/Code
2022/09DiffuseReconTowards Performant and Reliable Undersampled MR Reconstruction via Diffusion Model Sampling<br /><sup><sub>Cheng Peng, Pengfei Guo, S. Kevin Zhou, Vishal M. Patel & Rama Chellappa</sup></sub>MICCAI<br />2022Paper/Code
2022/07AdaDiffAdaptive Diffusion Priors for Accelerated MRI Reconstruction<br /><sup><sub>Alper Güngör, Salman UH Dar, Şaban Öztürk, Yilmaz Korkmaz, Gokberk Elmas, Muzaffer Özbey, Tolga Çukur</sup></sub>MedIA<br />2023Paper/Code
2021/10Score-MRIScore-based diffusion models for accelerated MRI<br /><sup><sub>Hyungjin Chung, Jong Chul Ye</sup></sub>MedIA<br />2022Paper/Code
2021/08CSGMRobust Compressed Sensing MRI with Deep Generative Priors<br /><sup><sub>Alper Güngör, Salman UH Dar, Şaban Öztürk, Yilmaz Korkmaz, Gokberk Elmas, Muzaffer Özbey, Tolga Çukur</sup></sub>NeurIPS<br />2021Paper/Code
<a id="2.1.2">2.1.2 X-ray-based</a>
ReleaseMethodTitlePub.Link
2024/10-Diffusion-Based Generative Image Outpainting for Recovery of FOV-Truncated CT Images<br /><sup><sub>Michelle Espranita Liman, Daniel Rueckert, Florian J. Fintelmann, Philip Müller</sup></sub>MICCAI<br />2024Paper/Code
2024/10PrideDiffPrideDiff: Physics-Regularized Generalized Diffusion Model for CT Reconstruction<br /><sup><sub>Zexin Lu; Qi Gao; Tao Wang; Ziyuan Yang; Zhiwen Wang; Hui Yu</sup></sub>TRPMS<br />2024Paper/Code
2024/10-Ultrafast Short-Arc Diffusion-Based Cone Beam CT Image Reconstruction<br /><sup><sub>Y. FU, H. Zhang, W. Cai, L. Kuo, H. Xie, J.J. Cuaron, L.I. Cervino, J.M. Moran, X. Li1, T. Li</sup></sub>IJROBP<br />2024Paper/
2024/09RN-SDEsRN-SDEs: Limited-Angle CT Reconstruction with Residual Null-Space Diffusion Stochastic Differential Equations<br /><sup><sub>Jiaqi Guo, Santiago Lopez-Tapia, Wing Shun Li, Yunnan Wu, Marcelo Carignano, Vadim Backman, Vinayak P. Dravid, Aggelos K. Katsaggelos</sup></sub>arXiv<br />2024Paper/
2024/09CT-SDMCT-SDM: A Sampling Diffusion Model for Sparse-View CT Reconstruction across All Sampling Rates<br /><sup><sub>Liutao Yang, Jiahao Huang, Guang Yang, Daoqiang Zhang</sup></sub>arXiv<br />2024Paper/
2024/08-CT reconstruction using diffusion posterior sampling conditioned on a nonlinear measurement model<br /><sup><sub>Shudong Li, Xiao Jiang, Matthew Tivnan, Grace J. Gang, Yuan Shen, J. Webster Stayman</sup></sub>SPIE<br />2024Paper/
2024/08DIFR3CTDIFR3CT: Latent Diffusion for Probabilistic 3D CT Reconstruction from Few Planar X-Rays<br /><sup><sub>Yiran Sun, Hana Baroudi, Tucker Netherton, Laurence Court, Osama Mawlawi, Ashok Veeraraghavan, Guha Balakrishnan</sup></sub>arXiv<br />2024Paper/Code
2024/08FCDMFCDM: Sparse-view Sinogram Inpainting with Frequency Domain Convolution Enhanced Diffusion Models<br /><sup><sub>Jiaze E, Srutarshi Banerjee, Tekin Bicer, Guannan Wang, Bin Ren</sup></sub>arXiv<br />2024Paper/
2024/08-Iterative CT Reconstruction via Latent Variable Optimization of Shallow Diffusion Models<br /><sup><sub>Sho Ozaki, Shizuo Kaji, Toshikazu Imae, Kanabu Nawa, Hideomi Yamashita, Keiichi Nakagawa</sup></sub>arXiv<br />2024Paper/
2024/08-Four-Dimensional Cone-Beam CT Reconstruction via Diffusion Model and Motion Compensation<br /><sup><sub>Xianghong Wang, Zhengwei Ou, Peng Jin, Jiayi Xie, Ze Teng, Lei Xu</sup></sub>TRPMS<br />2024Paper/
2024/08-Linear diffusion noise boosted deep image prior for unsupervised sparse-view CT reconstruction<br /><sup><sub>Jia Wu, Xiaoming Jiang, Lisha Zhong, Wei Zheng, Xinwei Li, Jinzhao Lin, Zhangyong Li</sup></sub>IOP<br />2024Paper/
2024/07DiffReconDiffRecon: Diffusion-based CT reconstruction with cross-modal deformable fusion for DR-guided non-coplanar radiotherapy<br /><sup><sub>Jiawei Sun, Nannan Cao, Hui Bi, Liugang Gao, Kai Xie, Tao Lin, Jianfeng Sui, Xinye Ni</sup></sub>COMPUT. BIOL. MED.<br />2024Paper/
2024/07SADStructure-aware diffusion for low-dose CT imaging<br /><sup><sub>Wenchao Du, HuanHuan Cui, LinChao He, Hu Chen, Yi Zhang, Hongyu Yang</sup></sub>IOP<br />2024Paper/
2024/06PFGDMPrior frequency guided diffusion model for limited angle (LA)-CBCT reconstruction<br /><sup><sub>Jiacheng Xie, Hua-Chieh Shao, Yunxiang Li, You Zhang</sup></sub>IOP<br />2024Paper/
2024/06TIFATime-reversion Fast-sampling Score-based Model for Limited-angle CT Reconstruction<br /><sup><sub>Yanyang Wang, Zirong Li, Weiwen Wu</sup></sub>TMI<br />2024Paper/Code
2024/06DiffusionBlendDiffusionBlend: Learning 3D Image Prior through Position-aware Diffusion Score Blending for 3D Computed Tomography Reconstruction<br /><sup><sub>Bowen Song, Jason Hu, Zhaoxu Luo, Jeffrey A. Fessler, Liyue Shen</sup></sub>arXiv<br />2024Paper/
2024/05Blaze3DMBlaze3DM: Marry Triplane Representation with Diffusion for 3D Medical Inverse Problem Solving<br /><sup><sub>Jia He, Bonan Li, Ge Yang, Ziwen Liu</sup></sub>arXiv<br />2024Paper/
2024/05PDHGPhysics-informed Score-based Diffusion Model for Limited-angle Reconstruction of Cardiac Computed Tomography<br /><sup><sub>Shuo Han, Yongshun Xu, Dayang Wang, Bahareh Morovati, Li Zhou, Jonathan S. Maltz, Ge Wang, Hengyong Yu</sup></sub>arXiv<br />2024Paper/
2024/05-Score-based generative model-assisted information compensation for high-quality limited-view reconstruction in photoacoustic tomography<br /><sup><sub>Kangjun Guo, Zhiyuan Zheng, Wenhua Zhong, Zilong Li, Guijun Wang,Jiang Li, Yubin Cao,Yiguang Wang,Jiabin Lin, Qiegen Liu, XianLin Song</sup></sub>Photoacoustics<br />2024Paper/
2024/05CDDMMitigating Data Consistency Induced Discrepancy in Cascaded Diffusion Models for Sparse-view CT Reconstruction<br /><sup><sub>Hanyu Chen, Zhixiu Hao, Lin Guo, Liying Xiao</sup></sub>arXiv<br />2024Paper/
2024/05MSDiffMSDiff: Multi-Scale Diffusion Model for Ultra-Sparse View CT Reconstruction<br /><sup><sub>Pinhuang Tan, Mengxiao Geng, Jingya Lu, Liu Shi, Bin Huang, Qiegen Liu</sup></sub>arXiv<br />2024Paper/
2024/04-Iterative reconstruction for limited-angle CT using implicit neural representation<br /><sup><sub>Jooho Lee, Jongduk Baek</sup></sub>IOP<br />2024Paper/
2024/04DPERDPER: Diffusion Prior Driven Neural Representation for Limited Angle and Sparse View CT Reconstruction<br /><sup><sub>Chenhe Du, Xiyue Lin, Qing Wu, Xuanyu Tian, Ying Su, Zhe Luo, Rui Zheng, Yang Chen, Hongjiang Wei, S. Kevin Zhou, Jingyi Yu, Yuyao Zhang</sup></sub>arXiv<br />2024Paper/
2024/04-An interactive method based on multi-objective optimization for limited-angle CT reconstruction<br /><sup><sub>Chengxiang Wang, Yuanmei Xia, Jiaxi Wang, Kequan Zhao, Wei Peng, Wei Yu</sup></sub>IOP<br />2024Paper/
2024/04-Fourier diffusion for sparse CT reconstruction<br /><sup><sub>Anqi Liu, Grace J. Gang, J. Webster Stayman</sup></sub>SPIE<br />2024Paper/
2024/03DE-CBCTDual-Energy Cone-Beam CT Using Two Complementary Limited-Angle Scans with A Projection-Consistent Diffusion Model<br /><sup><sub>Junbo Peng, Chih-Wei Chang, Richard L.J. Qiu, Tonghe Wang, Justin Roper, Beth Ghavidel, Xiangyang Tang, Xiaofeng Yang</sup></sub>arXiv<br />2024Paper/
2024/03cDDPMUsing denoising diffusion probabilistic models to enhance quality of limited-view photoacoustic tomography<br /><sup><sub>Bruno De Santi, Navchetan Awasthi, Srirang Manohar</sup></sub>SPIE<br />2024Paper/
2024/03-Image reconstruction based on nonlinear diffusion model for limited-angle computed tomography<br /><sup><sub>Xuying Zhao1, Wenjin Jiang, Xinting Zhang, Wenxiu Guo, Yunsong Zhao, Xing Zhao</sup></sub>IOP<br />2024Paper/
2024/02-Image Domain Ultra-Sparse View CT Artifact Removal Via Conditional Denoising Diffusion Probability Model<br /><sup><sub>Feixiang Zhao, Jianchao Zhao, Mingzhe Liu</sup></sub>ICCPR<br />2024Paper/
2024/02WISMWavelet-Inspired Multi-channel Score-based Model for Limited-angle CT Reconstruction<br /><sup><sub>Jianjia Zhang, Haiyang Mao, Xinran Wang, Yuan Guo, Weiwen Wu</sup></sub>TMI<br />2024Paper/
2024/01SWORDStage-by-stage Wavelet Optimization Refinement Diffusion Model for Sparse-View CT Reconstruction<br /><sup><sub>Kai Xu, Shiyu Lu, Bin Huang, Weiwen Wu, Qiegen Liu</sup></sub>TMI<br />2024Paper/
2023/12HD-DCDMHD-DCDM: Hybrid-domain network for limited-angle computed tomography with deconvolution and conditional diffusion model<br /><sup><sub>Jianyu Wang, Rongqian Wang1, Lide Cai, Xintong Liu1, Guochang Lin1, Fukai Chen1, Lingyun Qiu</sup></sub>AMMC<br />2023Paper/
2023/10-Enhancing the Resolution of Micro-CT Images of Rock Samples via Unsupervised Machine Learning based on a Diffusion Model<br /><sup><sub>Zhaoyang Ma, Shuyu Sun, Bicheng Yan, Hyung Kwak, Jun Gao</sup></sub>SPEATCE<br />2023Paper/
2023/08-Generative Modeling in Sinogram Domain for Sparse-View CT Reconstruction<br /><sup><sub>Bing Guan, Cailian Yang, Liu Zhang, Shanzhou Niu, Minghui Zhang, Yuhao Wang</sup></sub>TRPMS<br />2023Paper/
2023/07HGUFast and Stable Diffusion Inverse Solver with History Gradient Update<br /><sup><sub>Linchao He, Hongyu Yan, Mengting Luo, Hongjie Wu, Kunming Luo, Wang Wang, Wenchao Du, Hu Chen, Hongyu Yang, Yi Zhang, Jiancheng Lv</sup></sub>arXiv<br />2023Paper/
2022/11DOLCEDOLCE: A Model-Based Probabilistic Diffusion Framework for Limited-Angle CT Reconstruction<br /><sup><sub>Jiaming Liu, Rushil Anirudh, Jayaraman J. Thiagarajan, Stewart He, K. Aditya Mohan, Ulugbek S. Kamilov, Hyojin Kim</sup></sub>ICCV<br />2023Paper/Code
2022/11DiffusionMBIRSolving 3D Inverse Problems using Pre-trained 2D Diffusion Models<br /><sup><sub>Hyungjin Chung, Dohoon Ryu, Michael T. McCann, Marc L. Klasky, Jong Chul Ye</sup></sub>CVPR<br />2023Paper/Code
2022/01MCGImproving diffusion models for inverse problems using manifold constraints<br /><sup><sub>Hyungjin Chung, Byeongsu Sim, Dohoon Ryu, Jong Chul Ye</sup></sub>NeurIPS<br />2022Paper/Code
<a id="2.1.3">2.1.3 Multi-modal</a>
ReleaseMethodTitlePub.Link
2024/10PASTAPASTA: Pathology-Aware MRI to PET CroSs-modal TrAnslation with Diffusion Models<br /><sub>Yitong Li, Igor Yakushev, Dennis M. Hedderich, Christian Wachinger</sub>MICCAI<br />2024Paper/Code
2024/07Joint diffusionJoint diffusion: mutual consistency-driven diffusion model for PET-MRI co-reconstruction<br /><sub>Taofeng Xie, Zhuo-Xu Cui, Chen Lu, Huayu Wang, Congcong Liu, Yuanzhi Zhang, Xuemei Wang, Yanjie Zhu, Guoqing Chen, Dong Liang</sub>IOP<br />2024Paper/
2024/05FICDFunctional Imaging Constrained Diffusion for Brain PET Synthesis from Structural MRI<br /><sub>Minhui Yu, Mengqi Wu, Ling Yue, Andrea Bozoki, Mingxia Liu</sub>arXiv<br />2024Paper/
2023/06SynDiffUnsupervised Medical Image Translation With Adversarial Diffusion Models<br /><sub>Muzaffer Özbey; Onat Dalmaz; Salman U. H. Dar; Hasan A. Bedel; Şaban Özturk; Alper Güngör</sub>TMI<br />2023Paper/Code
2023/04FGDMZero-shot Medical Image Translation via Frequency-Guided Diffusion Models<br /><sup><sub>Yunxiang Li, Hua-Chieh Shao, Xiao Liang, Liyuan Chen, Ruiqi Li, Steve Jiang, Jing Wang, You Zhang</sup></sub>TMI<br />2023Paper/
2022/09-Conversion Between CT and MRI Images Using Diffusion and Score-Matching Models<br /><sup><sub>Qing Lyu, Ge Wang</sup></sub>arXiv<br />2022Paper/
2022/07UMM-CSGMA Novel Unified Conditional Score-based Generative Framework for Multi-modal Medical Image Completion<br /><sup><sub>Xiangxi Meng, Yuning Gu, Yongsheng Pan, Nizhuan Wang, Peng Xue, Mengkang Lu, Xuming He, Yiqiang Zhan, Dinggang Shen</sup></sub>arXiv<br />2022Paper/
<a id="2.1.4">2.1.4 Other Modalities</a>
ReleaseMethodTitlePub.Link
2024/10MCADMCAD: Multi-modal Conditioned Adversarial Diffusion Model for High-Quality PET Image Reconstruction<br /><sup><sub>Jiaqi Cui, Xinyi Zeng, Pinxian Zeng, Bo Liu, Xi Wu, Jiliu Zhou, Yan Wang</sup></sub>MICCAI <br />2024Paper/
2024/08PET-CMFull-dose whole-body PET synthesis from low-dose PET using high-efficiency denoising diffusion probabilistic model: PET consistency model<br /><sup><sub>Shaoyan Pan, Elham Abouei, Junbo Peng, Joshua Qian, Jacob F Wynne, Tonghe Wang, Chih-Wei Chang, Justin Roper, Jonathon A Nye, Hui Mao, Xiaofeng Yang</sup></sub>Medical Physics<br />2024Paper/Code
2024/04Entropy-SDEEquipping Diffusion Models with Differentiable Spatial Entropy for Low-Light Image Enhancement<br /><sup><sub>Wenyi Lian, Wenjing Lian, Ziwei Luo</sup></sub>CVPRW<br />2024Paper/Code
2024/02-Dehazing Ultrasound using Diffusion Models<br /><sup><sub>Tristan S.W. Stevens, Faik C. Meral, Jason Yu, Iason Z. Apostolakis, Jean-Luc Robert, Ruud J.G. Van Sloun</sup></sub>TMI<br />2024Paper/
2023/10LLCapsLLCaps: Learning to Illuminate Low-Light Capsule Endoscopy with Curved Wavelet Attention and Reverse Diffusion<br /><sup><sub>Tristan S.W. Stevens, Faik C. Meral, Jason Yu, Iason Z. Apostolakis, Jean-Luc Robert, Ruud J.G. Van Sloun</sup></sub>MICCAI <br />2023Paper/Code
2023/10CPDMContent-Preserving Diffusion Model for Unsupervised AS-OCT Image Despeckling<br /><sup><sub>Sanqian Li, Risa Higashita, Huazhu Fu, Heng Li, Jingxuan Niu, Jiang Liu</sup></sub>MICCAI <br />2023Paper/
2023/10PET-DiffusionPET-Diffusion: Unsupervised PET Enhancement Based on the Latent Diffusion Model<br /><sup><sub>Caiwen Jiang, Yongsheng Pan, Mianxin Liu, Lei Ma, Xiao Zhang, Jiameng Liu, Xiaosong Xiong, Dinggang Shen</sup></sub>MICCAI <br />2023Paper/Code
2023/10-PET image denoising based on denoising diffusion probabilistic model<br /><sup><sub>Kuang Gong, Keith Johnson, Georges El Fakhri, Quanzheng Li, Tinsu Pan</sup></sub>EJNMMI<br />2024Paper/
2023/10PET-ReconstructionContrastive Diffusion Model with Auxiliary Guidance for Coarse-to-Fine PET Reconstruction<br /><sup><sub>Zeyu Han, Yuhan Wang, Luping Zhou, Peng Wang, Binyu Yan, Jiliu Zhou, Yan Wang, Dinggang Shen</sup></sub>MICCAI <br />2023Paper/Code
2022/09PET-DDMPET image denoising based on denoising diffusion probabilistic models<br /><sup><sub>Kuang Gong, Keith A. Johnson, Georges El Fakhri, Quanzheng Li, Tinsu Pan</sup></sub>Eur. J. Nucl. Med. Mol. Imaging<br />2023Paper/
2022/04OCT-DDPMUnsupervised denoising of retinal OCT with diffusion probabilistic model<br /><sup><sub>Dewei Hu, Yuankai K. Tao, Ipek Oguz</sup></sub>SPIE<br />2022Paper/Code
2022/01DenoOCT-DDPMUnsupervised Denoising of Retinal OCT with Diffusion Probabilistic Model<br /><sup><sub>Dewei Hu, Yuankai K. Tao, Ipek Oguz</sup></sub>SPIE<br />2022Paper/Code

<a id="2.2">2.2 Diffusion Models In Remote Sensing For Low-level Vision Tasks</a>

<a id="2.2.1">2.2.1 Visible-light Remote Sensing Image</a>
ReleaseMethodTitlePub.Link
2024/12EVADMEffective variance attention-enhanced diffusion model for crop field aerial image super resolution<br /><sup><sub>Xiangyu Lu, Jianlin Zhang, Rui Yang , Qina Yang , Mengyuan Chen , Hongxing Xu, Pinjun Wan, Jiawen Guo , Fei Liu</sup></sub>ISPRS<br />2024Paper/Code
2024/09FastDiffSRA Conditional Diffusion Model With Fast Sampling Strategy for Remote Sensing Image Super-Resolution<br /><sup><sub>Fanen Meng; Yijun Chen; Haoyu Jing; Laifu Zhang; Yiming Yan; Yingchao Ren</sup></sub>TGRS<br />2024Paper/Code
2024/09-Clouds and Haze Co-Removal Based on Weight-Tuned Overlap Refinement Diffusion Model for Remote Sensing Images<br /><sup><sub>Jingxuan Zhang; Libao Zhang</sup></sub>ICIP<br />2024Paper/
2024/07RSSRDiffRSSRDiff: An Effective Diffusion Probability Model with Attention for Single Remote Sensing Image Super-Resolution<br /><sup><sub>Tian Wei, Hanyi Zhang, Jin Xu, Jing Zhao, Fei Shen</sup></sub>ICIC<br />2024Paper/
2024/06-Diffusion Enhancement for Cloud Removal in Ultra-Resolution Remote Sensing Imagery<br /><sup><sub>Jialu Sui; Yiyang Ma; Wenhan Yang; Xiaokang Zhang; Man-On Pun; Jiaying Liu</sup></sub>TGRS<br />2024Paper/Code
2024/06CLDiffCLDiff: Weakly Supervised Cloud Detection With Denoising Diffusion Probabilistic ModelsTGRS<br />2024Paper/Code
2024/05SGDMSemantic Guided Large Scale Factor Remote Sensing Image Super-resolution with Generative Diffusion Prior<br /><sup><sub>Ce Wang, Wanjie Sun</sup></sub>arXiv<br />2024Paper/Code
2024/05ShipinSightShip in Sight: Diffusion Models for Ship-Image Super Resolution<br /><sup><sub>Luigi Sigillo, Riccardo Fosco Gramaccioni, Alessandro Nicolosi, Danilo Comminiello</sup></sub>WCCI<br />2024Paper/Code
2024/05RSHazeDiffRSHazeDiff: A Unified Fourier-aware Diffusion Model for Remote Sensing Image Dehazing<br /><sup><sub>Jiamei Xiong, Xuefeng Yan, Yongzhen Wang, Wei Zhao, Xiao-Ping Zhang, Mingqiang Wei</sup></sub>arXiv<br />2024Paper/Code
2024/03ASDDPMAdaptive Semantic-Enhanced Denoising Diffusion Probabilistic Model for Remote Sensing Image Super-Resolution<br /><sup><sub>Jialu Sui, Xianping Ma, Xiaokang Zhang, Man-On Pun</sup></sub>arXiv<br />2024Paper/Code
2024/03IDF-CRIDF-CR: Iterative Diffusion Process for Divide-and-Conquer Cloud Removal in Remote-Sensing Images<br /><sup><sub>Meilin Wang; Yexing Song; Pengxu Wei; Xiaoyu Xian; Yukai Shi; Liang Lin</sup></sub>TGRS<br />2024Paper/Code
2024/03DiffALSDenoising Diffusion Probabilistic Model with Adversarial Learning for Remote Sensing Super-Resolution<br /><sup><sub>Jialu Sui,Qianqian Wu, Man-On Pun</sup></sub>Remote Sensing<br />2024Paper/
2024/02ADND-NetDiffusion Models Based Null-Space Learning for Remote Sensing Image Dehazing<br /><sup><sub>Yufeng Huang; Zhiyu Lin; Shuai Xiong; Tongtong Sun</sup></sub>LGRS<br />2024Paper
2024/02DiffCRDiffCR: A Fast Conditional Diffusion Framework for Cloud Removal From Optical Satellite Images<br /><sup><sub>Xuechao Zou; Kai Li; Junliang Xing; Yu Zhang; Shiying Wang; Lei Jin</sup></sub>TGRS<br />2024Paper/Code
2024/02TCDMTCDM: Effective Large-Factor Image Super-Resolution via Texture Consistency Diffusion<br /><sup><sub>Yan Zhang; Hanqi Liu; Zhenghao Li; Xinbo Gao; Guangyao Shi; Jianan Jiang</sup></sub>TGRS<br />2024Paper/
2023/11LWTDMEfficient Remote Sensing Image Super-Resolution via Lightweight Diffusion Models<br /><sup><sub>Tai An; Bin Xue; Chunlei Huo; Shiming Xiang</sup></sub>LGRS<br />2023Paper/Code
2023/10EDiffSREDiffSR: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-Resolution<br /><sup><sub>Yi Xiao, Qiangqiang Yuan, Kui Jiang, Jiang He, Xianyu Jin, Liangpei Zhang</sup></sub>TGRS<br />2024Paper/Code
2023/08DDSRDual-Diffusion: Dual Conditional Denoising Diffusion Probabilistic Models for Blind Super-Resolution Reconstruction in RSIs<br /><sup><sub>Mengze Xu, Jie Ma, Yuanyuan Zhu</sup></sub>LGRS<br />2024Paper/Code
2023/07EHC-DMSREnhancing Remote Sensing Image Super-Resolution with Efficient Hybrid Conditional Diffusion Model<br /><sup><sub>Lintao Han,Yuchen Zhao, Hengyi Lv, Yisa Zhang, Hailong Liu, Guoling Bi, Qing Han</sup></sub>Remote Sensing<br />2023Paper/
2023/09RSDiffRSDiff: Remote Sensing Image Generation from Text Using Diffusion Model<br /><sup><sub>Ahmad Sebaq, Mohamed ElHelw</sup></sub>arXiv<br />2023Paper/
2023/08ARDD-NetRemote Sensing Image Dehazing Using Adaptive Region-Based Diffusion Models<br /><sup><sub>Y Huang, S Xiong</sup></sub>LGRS<br />2023Paper/
2023/02TESRTESR: Two-Stage Approach for Enhancement and Super-Resolution of Remote Sensing Images<br /><sup><sub>Anas M. Ali, Bilel Benjdira, Anis Koubaa, Wadii Boulila, Walid El-Shafai</sup></sub>Remote Sensing<br />2023Paper/Code
2022/09PSSRDiffusion Model with Detail Complement for Super-Resolution of Remote Sensing<br /><sup><sub>Liu, Jinzhe and Yuan, Zhiqiang and Pan, Zhaoying and Fu, Yiqun and Liu, Li and Lu, Bin</sup></sub>Remote Sensing<br />2022Paper/
<a id="2.2.2">2.2.2 HSI</a>
ReleaseMethodTitlePub.Link
2024/11STFDiffSTFDiff: Remote sensing image spatiotemporal fusion with diffusion models<br /><sub>He Huang, Wei He, Hongyan Zhang, Yu Xia, Liangpei Zhang</sub>Inf. Fusion<br />2024Paper/Code
2024/11MTLSC-DiffMTLSC-Diff: Multitask learning with diffusion models for hyperspectral image super-resolution and classification<br /><sub>Jiahui Qu, Liusheng Xiao, Wenqian Dong, Yunsong Li</sub>Knowledge-Based Systems<br />2024Paper
2024/09Diff-UnmixUnmixing Diffusion for Self-Supervised Hyperspectral Image Denoising<br /><sup><sub>Haijin Zeng; Jiezhang Cao; Kai Zhang; Yongyong Chen; Hiep Luong; Wilfried Philips</sup></sub>CVPR<br />2024Paper/Code
2024/08SCDMSpectral-Cascaded Diffusion Model for Remote Sensing Image Spectral Super-Resolution<br /><sup><sub>Bowen Chen; Liqin Liu; Chenyang Liu; Zhengxia Zou; Zhenwei Shi</sup></sub>TGRS<br />2024Paper/Code
2024/08SDPA Spectral Diffusion Prior for Unsupervised Hyperspectral Image Super-Resolution<br /><sup><sub>Jianjun Liu; Zebin Wu; Liang Xiao</sup></sub>TGRS<br />2024Paper/Code
2024/07PLRDiffUnsupervised hyperspectral pansharpening via low-rank diffusion model<br /><sup><sub>Xiangyu Rui, Xiangyong Cao, Li Pang, Zeyu Zhu, Zongsheng Yue, Deyu Meng</sup></sub>Information Fusion 2024Paper/Code
2024/05ISPDiffISPDiff: Interpretable Scale-Propelled Diffusion Model for Hyperspectral Image Super-Resolution<br /><sup><sub>Wenqian Dong; Sen Liu; Song Xiao; Jiahui Qu; Yunsong Li</sup></sub>TGRS<br />2024Paper/Code
2024/04DMSANetA Diffusion Model-Assisted Multiscale Spectral Attention Network for Hyperspectral Image Super-Resolution <br /><sup><sub>Kaiqi He; Yiheng Cai; Shengjun Peng; Meiling Tan</sup></sub>JSTARS<br />2024Paper
2024/03DMGASREnhancing Hyperspectral Images via Diffusion Model and Group-Autoencoder Super-resolution Network<br /><sup><sub>Zhaoyang Wang, Dongyang Li, Mingyang Zhang†, Hao Luo, Maoguo Gong</sup></sub>AAAI<br />2024Paper/Code
2024/02HIR-DiffHIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Models<br /><sup><sub>Li Pang, Xiangyu Rui, Long Cui, Hongzhong Wang, Deyu Meng, Xiangyong Cao</sup></sub>CVPR<br />2024Paper/Code
2024/02CFMDMCFMDM: Coarse-to-Fine Meta-Diffusion Model for Scale-Arbitrary Hyperspectral Super-Resolution<br /><sup><sub>Jizhou Cui; Wenqian Dong; Jiahui Qu; Xiaoyang Wu; Song Xiao; Yunsong Li</sup></sub>LGRS<br />2024Paper/
2024/01SatDiffMoESatDiffMoE: A Mixture of Estimation Method for Satellite Image Super-resolution with Latent Diffusion Models<br /><sub>Zhaoxu Luo, Bowen Song, Liyue Shen</sub>arXiv<br />2024Paper/
2023/11TDiffDeTDiffDe: A Truncated Diffusion Model for Remote Sensing Hyperspectral Image Denoising<br /><sub>Jiang He, Yajie Li, Jie L, Qiangqiang Yuan</sub>arXiv<br />2024Paper/
2023/07DDPM-FusHyperspectral and Multispectral Image Fusion Using the Conditional Denoising Diffusion Probabilistic Model<br /><sup><sub>Shuaikai Shi, Lijun Zhang, Jie Chen</sup></sub>arXiv<br />2023Paper/Code
2023/07-A Noise-Model-Free Hyperspectral Image Denoising Method Based on Diffusion Model<br /><sup><sub>Deng, Keli and Jiang, Zhongshun and Qian, Qipeng and Qiu, Yi and Qian, Yuntao</sup></sub>IGASS<br />2023Paper/
2023/07R2H-CCDR2H-CCD: Hyperspectral Imagery Generation from RGB Images Based on Conditional Cascade Diffusion Probabilistic Models<br /><sup><sub>Zhang, Lei and Luo, Xiaoyan and Li, Sen and Shi, Xiaofeng</sup></sub>IGASS<br />2023Paper/
2023/03DDS2MDDS2M: Self-Supervised Denoising Diffusion Spatio-Spectral Model for Hyperspectral Image Restoration<br /><sup><sub>Yuchun Miao, Lefei Zhang, Liangpei Zhang, Dacheng Tao</sup></sub>ICCV<br />2023Paper/Code
2023/01HSR-DiffHSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Models<br /><sup><sub>Chanyue Wu, Dong Wang, Hanyu Mao, Ying Li</sup></sub>ICCV<br />2023Paper/
<a id="2.2.3">2.2.3 SAR</a>
ReleaseMethodTitlePub.Link
2024/01Ship-GoShip-Go: SAR Ship Images Inpainting via instance-to-image Generative Diffusion Models<br /><sub>Xin Zhang, Yang Li, Feng Li , Hangzhi Jiang, Yanhua Wang , Liang Zhang , Le Zheng, Zegang Ding</sub>ISPRS<br />2024Paper/Code
2024/09R-DDPMSAR Despeckling Via Regional Denoising Diffusion Probabilistic Model<br /><sub>Xuran Hu; Ziqiang Xu; Zhihan Chen; Zhenpeng Feng; Mingzhe Zhu; Ljubiša Stanković</sub>IGASS<br />2024Paper/
2024/06-Despeckling SAR Images With Log-Yeo–Johnson Transformation and Conditional Diffusion Models<br /><sub>Yaobin Ma; Peng Ke; Hossein Aghababaei; Ling Chang; Jingbo Wei</sub>TGRS<br />2024Paper/
2023/07-Unsupervised SAR Despeckling Based on Diffusion Model<br /><sup><sub>Xiao, Siyao and Huang, Libing and Zhang, Shunsheng</sup></sub>IGASS<br />2023Paper/
2023/08-Diffusion Models for Interferometric Satellite Aperture Radar<br /><sup><sub>Alexandre Tuel, Thomas Kerdreux, Claudia Hulbert, Bertrand Rouet-Leduc</sup></sub>arXiv<br />2023Paper/Code
2023/06-SAR Despeckling using a Denoising Diffusion Probabilistic Model<br /><sup><sub>Malsha V. Perera, Nithin Gopalakrishnan Nair, Wele Gedara Chaminda Bandara, Vishal M. Patel</sup></sub>LGRS<br />2023Paper/Code
<a id="2.2.4">2.2.4 Multi-modal</a>
ReleaseMethodTitlePub.Link
2024/10-Binary Diffusion Method for Image Fusion with Despeckling<br /><sup><sub>Chenlin Zhang; Yajun Chang; Yuhang Wu; Zelong Wang</sup></sub>AIPMV<br />2024Paper/
2024/09-SAR to Optical Image Translation with Color Supervised Diffusion Model<br /><sup><sub>Xinyu Bai; Feng Xu</sup></sub>IGARSS<br />2024Paper/
2024/08-Learning SAR-to-Optical Image Translation via Diffusion Models With Color Memory<br /><sup><sub>Zhe Guo; Jiayi Liu; Qinglin Cai; Zhibo Zhang; Shaohui Mei</sup></sub>JSTARS<br />2024Paper/
2024/07DDSRDDSR: Degradation-Aware Diffusion Model for Spectral Reconstruction from RGB Images<br /><sup><sub>Yunlai Chen, Xiaoyan Zhang</sup></sub>Remote Sensing<br />2024Paper/
2024/04-Variational Diffusion Method for Remote Sensing Image Fusion<br /><sup><sub>Chenlin Zhang; Jialing Han; Jubo Zhu; Zelong Wang</sup></sub>LGRS<br />2024Paper/
2024/01-A brain-inspired approach for SAR-to-optical image translation based on diffusion models<br /><sup><sub>Hao Shi, Zihan Cui, Liang Chen, ingfei He, Jingyi Yang</sup></sub>FRONT NEUROSCI-SWITZ<br />2024Paper/
2023/11-Conditional Diffusion for SAR to Optical Image Translation<br /><sub>Xinyu Bai; Xinyang Pu; Feng Xu</sub>LGRS<br />2024Paper/
2023/10DCDMFHyperspectral and Panchromatic Images Fusion Based on the Dual Conditional Diffusion Models<br /><sup><sub>Shuangliang Li; Siwei Li; Lihao Zhang</sup></sub>TGRS<br />2024Paper/Code
2023/07-Improved Flood Insights: Diffusion-Based SAR to EO Image Translation<br /><sup><sub>Minseok Seo, Youngtack Oh, Doyi Kim, Dongmin Kang, Yeji Choi</sup></sub>arXiv<br />2023Paper/
2023/04-Cloud Removal in Remote Sensing Using Sequential-Based Diffusion Models<br /><sup><sub>Zhao, Xiaohu and Jia, Kebin</sup></sub>Remote Sensing<br />2023Paper/
2023/04DDRFDDRF: Denoising Diffusion Model for Remote Sensing Image Fusion<br /><sup><sub>ZiHan Cao, ShiQi Cao, Xiao Wu, JunMing Hou, Ran Ran, Liang-Jian Deng</sup></sub>arXiv<br />2023Paper/
2023/03DDPM-CRDenoising Diffusion Probabilistic Feature-Based Network for Cloud Removal in Sentinel-2 Imagery<br /><sup><sub>Jing, Ran and Duan, Fuzhou and Lu, Fengxian and Zhang, Miao and Zhao, Wenji</sup></sub>Remote Sensing<br />2023Paper/

<a id="2.3">2.3 Varied Low-level Vision Tasks In Video Through Diffusion Models</a>

<a id="2.3.1">2.3.1 Video Frame Prediction and Interpolation</a>
ReleaseMethodTitlePub.Link
2024/09ExtDMExtDM: Distribution Extrapolation Diffusion Model for Video Prediction<br /><sup><sub>Zhicheng Zhang, Junyao Hu, Wentao Cheng, Danda Paudel, Jufeng Yang</sup></sub>CVPR<br />2024Paper/
2024/08EasyControlEasyControl: Transfer ControlNet to Video Diffusion for Controllable Generation and Interpolation<br /><sup><sub>Cong Wang, Jiaxi Gu, Panwen Hu, Haoyu Zhao, Yuanfan Guo, Jianhua Han, Hang Xu, Xiaodan Liang</sup></sub>arXiv<br />2024Paper/
2024/04MADiffMotion-aware Latent Diffusion Models for Video Frame Interpolation<br /><sup><sub>Zhilin Huang, Yijie Yu, Ling Yang, Chujun Qin, Bing Zheng, Xiawu Zheng, Zikun Zhou, Yaowei Wang, Wenming Yang</sup></sub>arXiv<br />2024Paper/
2024/04VIDIMVideo Interpolation with Diffusion Models<br /><sup><sub>Siddhant Jain, Daniel Watson, Eric Tabellion, Aleksander Hołyński, Ben Poole, Janne Kontkanen</sup></sub>CVPR<br />2023Paper/
2024/03STDiffSTDiff: Spatio-Temporal Diffusion for Continuous Stochastic Video Prediction<br /><sup><sub>Xi Ye, Guillaume-Alexandre Bilodeau</sup></sub>AAAI<br />2024Paper/Code
2024/01AIDAID: Adapting Image2Video Diffusion Models for Instruction-guided Video Prediction<br /><sup><sub>Zhen Xing, Qi Dai, Zejia Weng, Zuxuan Wu, Yu-Gang Jiang</sup></sub>arXiv<br />2024Paper/
2023/05SeerSeer: Language Instructed Video Prediction with Latent Diffusion Models<br /><sup><sub>Xianfan Gu, Chuan Wen, Weirui Ye, Jiaming Song, Yang Gao</sup></sub>arXiv<br />2023Paper/
2023/10SEINESEINE: Short-to-Long Video Diffusion Model for Generative Transition and Prediction<br /><sup><sub>Xinyuan Chen, Yaohui Wang, Lingjun Zhang, Shaobin Zhuang, Xin Ma, Jiashuo Yu, Yali Wang, Dahua Lin, Yu Qiao, Ziwei Liu</sup></sub>ICLR<br />2024Paper/Project
2023/03LDMVFILDMVFI: Video Frame Interpolation with Latent Diffusion Models<br /><sup><sub>Duolikun Danier, Fan Zhang, David Bull</sup></sub>arXiv<br />2023Paper/Code
2022/06RaMViDDiffusion Models for Video Prediction and Infilling<br /><sup><sub>Tobias Höppe, Arash Mehrjou, Stefan Bauer, Didrik Nielsen, Andrea Dittadi</sup></sub>TMLR<br />2022Paper/
2022/05MCVDMCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation<br /><sup><sub>Vikram Voleti, Alexia Jolicoeur-Martineau, Christopher Pal</sup></sub>NeurIPS<br />2022Paper/Code
2022/03RVDDiffusion Probabilistic Modeling for Video Generation<br /><sup><sub>Ruihan Yang, Prakhar Srivastava, Stephan Mandt</sup></sub>Entropy<br />2023Paper/Code
<a id="2.3.2">2.3.2 Super Resolution For Video Generation</a>
ReleaseMethodTitlePub.Link
2024/06HPDMHierarchical Patch Diffusion Models for High-Resolution Video Generation<br /><sup><sub>Ivan Skorokhodov, Willi Menapace, Aliaksandr Siarohin, Sergey Tulyakov</sup></sub>CVPR<br />2024Paper/Project
2024/03SATeCoLearning Spatial Adaptation and Temporal Coherence in Diffusion Models for Video Super-Resolution<br /><sup><sub>Zhikai Chen, Fuchen Long, Zhaofan Qiu, Ting Yao, Wengang Zhou, Jiebo Luo, Tao Mei</sup></sub>CVPR<br />2024Paper/
2024/01-Inflation with Diffusion: Efficient Temporal Adaptation for Text-to-Video Super-Resolution<br /><sup><sub>Xin Yuan, Jinoo Baek, Keyang Xu, Omer Tov, Hongliang Fei</sup></sub>WACV<br />2024Paper/
2023/12Upscale-A-VideoUpscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution<br /><sup><sub>Shangchen Zhou, Peiqing Yang, Jianyi Wang, Yihang Luo, Chen Change Loy</sup></sub>CVPR<br />2024Paper/Code
2023/12MGLD-VSRMotion-Guided Latent Diffusion for Temporally Consistent Real-world Video Super-resolution<br /><sup><sub>Xi Yang, Chenhang He, Jianqi Ma, Lei Zhang</sup></sub>ECCV<br />2024Paper/Code
2023/11StableVSREnhancing Perceptual Quality in Video Super-Resolution through Temporally-Consistent Detail Synthesis using Diffusion Models<br /><sup><sub>Claudio Rota, Marco Buzzelli, Joost van de Weijer</sup></sub>ECCV<br />2024Paper/Code
2023/09LAVIELAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Models<br /><sup><sub>Yaohui Wang, Xinyuan Chen, Xin Ma, Shangchen Zhou, Ziqi Huang, Yi Wang, Ceyuan Yang, Yinan He, Jiashuo Yu, Peiqing Yang, Yuwei Guo, Tianxing Wu, Chenyang Si, Yuming Jiang, Cunjian Chen, Chen Change Loy, Bo Dai, Dahua Lin, Yu Qiao, Ziwei Liu</sup></sub>arXiv<br />2023Paper/Code
2023/05PYoCoPreserve Your Own Correlation: A Noise Prior for Video Diffusion Models<br /><sup><sub>Songwei Ge, Seungjun Nah, Guilin Liu, Tyler Poon, Andrew Tao, Bryan Catanzaro, David Jacobs, Jia-Bin Huang, Ming-Yu Liu, Yogesh Balaji</sup></sub>ICCV<br />2023Paper/Demo
2023/05VideoFusionVideoFusion: Decomposed Diffusion Models for High-Quality Video Generation<br /><sup><sub>Zhengxiong Luo, Dayou Chen, Yingya Zhang, Yan Huang, Liang Wang, Yujun Shen, Deli Zhao, Jingren Zhou, Tieniu Tan</sup></sub>CVPR<br />2023Paper/
2023/04-Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models<br /><sup><sub>Andreas Blattmann, Robin Rombach, Huan Ling, Tim Dockhorn, Seung Wook Kim, Sanja Fidler, Karsten Kreis</sup></sub>CVPR<br />2023Paper/Demo
<a id="2.3.3">2.3.3 Video Restoration</a>
ReleaseMethodTitlePub.Link
2024/08VD-DiffRethinking Video Deblurring with Wavelet-Aware Dynamic Transformer and Diffusion Model<br /><sup><sub>Chen Rao, Guangyuan Li, Zehua Lan, Jiakai Sun, Junsheng Luan, Wei Xing, Lei Zhao, Huaizhong Lin, Jianfeng Dong, Dalong Zhang</sup></sub>ECCV<br />2024Paper/Code
2024/08-Nonlinear Reaction-Diffusion Based Video Restoration Technique for Noise Mixtures<br /><sup><sub>Tudor Barbu, Costică Moroşanu</sup></sub>ICIEA<br />2024Paper/
2024/07DiffIR2VR-ZeroDiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Models<br /><sup><sub>Chang-Han Yeh, Chin-Yang Lin, Zhixiang Wang, Chi-Wei Hsiao, Ting-Hsuan Chen, Yu-Lun Liu</sup></sub>arXiv<br />2024Paper/Code
2024/07-Zero-shot Video Restoration and Enhancement Using Pre-Trained Image Diffusion Model<br /><sup><sub>Cong Cao, Huanjing Yue, Xin Liu, Jingyu Yang</sup></sub>arXiv<br />2024Paper/
2024/03DiffTTAGenuine Knowledge from Practice: Diffusion Test-Time Adaptation for Video Adverse Weather Removal<br /><sup><sub>Yijun Yang, Hongtao Wu, Angelica I. Aviles-Rivero, Yulun Zhang, Jing Qin, Lei Zhu</sup></sub>CVPR<br />2024Paper/Code
2023/12AVIDAVID: Any-Length Video Inpainting with Diffusion Model<br /><sup><sub>Zhixing Zhang, Bichen Wu, Xiaoyan Wang, Yaqiao Luo, Luxin Zhang, Yinan Zhao, Peter Vajda, Dimitris Metaxas, Licheng Yu</sup></sub>CVPR<br />2024Paper/Code
2023/11FLAIRFLAIR: A Conditional Diffusion Framework with Applications to Face Video Restoration<br /><sup><sub>Zihao Zou, Jiaming Liu, Shirin Shoushtari, Yubo Wang, Weijie Gan, Ulugbek S. Kamilov</sup></sub>arXiv<br />2024Paper/

<a id="4.">Related Surveys Recommended</a>

Diffusion Models in Low-Level Vision: A Survey<br /> arXiv 2024. [Paper] <br />Jun. 2024<br />

Taming Diffusion Models for Image Restoration: A Review<br /> arXiv 2024. [Paper] <br />Sept. 2024<br />

Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectives<br /> arXiv 2024. [Paper] <br />Apr. 2024<br />

Diffusion Models, Image Super-Resolution And Everything: A Survey<br /> arXiv 2024. [Paper] <br /> Jan. 2024<br />

State of the Art on Diffusion Models for Visual Computing<br /> arXiv 2023. [Paper]<br /> Oct. 2023<br />

Diffusion Models for Image Restoration and Enhancement -- A Comprehensive Survey.<br /> arXiv 2023. [Paper] <br /> Aug. 2023<br />

Survey on Diverse Image Inpainting using Diffusion Models<br /> PCEMS 2023. [Paper]<br /> Jun. 2023<br />

Diffusion Models for Medical Image Analysis: A Comprehensive Survey<br /> Medical Image Analysis 2023. [Paper]<br /> Nov. 2022<br />

Diffusion Models in Vision: A Survey<br /> TPAMI 2023. [Paper]<br /> Sep. 2022<br />

Diffusion Models: A Comprehensive Survey of Methods and Applications<br /> ACM Computing Surveys 2023. [Paper]<br /> Sep. 2022<br />

<a id="7.">Large-scale datasets for model pre-training</a>

Here, we provide a more comprehensive overview of the commonly used Large-scale datasets for model pre-training in low-level vision tasks.

<a id="5.">Datasets for low-level vision tasks</a>

Due to space limitations, we provide a summary of commonly used datasets for several classical natural low-level vision tasks here, including their scales, sources, modalities, and remarks. Clicking on the dataset will redirect you to its download link.

TasksDatasetsScalesSourcesModalitiesRemarks
SRBSD500500TPAMI 2010SynA synthetic benchmark that is initially designed for object contour detection.
SRSet1414TPAMI 2015SynCommonly utilized for testing performance of super-resolution algorithms.
SRManga109109MTAP 2015SynCompiled mainly for academic research on Japanese manga media processing.
SRGeneral100100ECCV 2016SynSynthesized images in uncompressed BMP format covering various scales.
SRDIV2K900/100NTIRE 2018RealA commonly-used dataset with diverse scenarios and realistic degradations.
SRFlickr10241024ICCVW 2019SynA large-scale stereo image dataset with high-quality pairs and diverse scenarios.
SRUrban100100CVPR 2019SynSourced from urban environments: city streets, buildings, and urban landscapes.
SRDRealSR31970ECCV 2020RealBenchmarks captured by DSLR cameras, circumventing simulated degradation.
DeblurGoPro2103/1111CVPR 2017SynAcquired by high-speed cameras for video quality assessment and restoration.
DeblurHIDE8422ICCV 2019SynCover long-distance and short-distance scenarios degraded by motion blur.
DeblurREDS270/30NTIRE 2019RealContain 300 video sequences with dynamic duration and varied resolutions.
DeblurBSD80/20ECCV 2020RealComprise more scenes and use the proposed beam-splitter acquisition system.
DeblurRealBlur3758/980ECCV 2020RealCover common instances of motion blur, captured in raw and JPEG formats.
DehazeI-Haze35NTIRE 2018RealIndoor dataset with real haze for objective image dehazing and evaluation.
DehazeO-Haze45NTIRE 2018RealOutdoor dataset with real haze for objective image dehazing and evaluation.
DehazeDense-Haze33ICIP 2019RealReal-world dataset with dense haze for robust single image dehazing methods.
DehazeRESIDE13000/990TIP 2019Syn+RealDivided into five subsets to highlight diverse sources and heterogeneous contents.
DehazeNH-Haze55CVRPW 2020RealThe first non-homogeneous dehazing dataset with realistic haze distribution.
DehazeHaze-4K4000MM 2021SynA large-scale synthetic dataset for image dehazing with varing distributions.
LLIEMIT-Fivek4500/500CVPR 2011SynA curated dataset of RAW photos adjusted by skilled retouchers for visual appeal.
LLIELOLv1485/15BMVC 2018RealThe first dataset with image pairs from real scenarios for low-light enhancement.
LLIESID5094CVPR 2018RealA dataset of raw short-exposure images with their long-exposure reference images.
LLIESICE589TIP 2018SynA large-scale multi-exposure image dataset with complex illumination conditions.
LLIEExDark7363CVIU 2019RealCollected in low-light scenarios with 12 classes and instance-level annotations.
LLIELOLv2-Real689/100TIP 2021RealA three-step shooting strategy is used to eliminate intra-pair image misalignments.
LLIELOLv2-Syn900/100TIP 2021SynSynthetic dark images mimic real low-light photography via histogram analysis.
LLIESDSD-Indoor62/6ICCV 2021RealIndoor dataset collected from dynamic scenes under varying lighting conditions.
LLIESDSD-Outdoor116/10ICCV 2021RealOutdoor dataset collected from dynamic scenes under varying lighting conditions.
DerainRain100H1800/100CVPR 2017SynComprise synthetic datasets with five types of rain streaks for rain removal.
DerainRainDrop861/239CVPR 2018SynImage pairs with raindrop degradation, captured using the setup of dual glasses.
DerainSPA-Data638492/1000CVPR 2019RealDesign a semi-automatic method to generate clean images from real rain streaks.
DerainMPID3961/419CVPR 2019Syn+RealA large-scale benchmark that focuses on driving and surveillance scenarios.
DerainRainCityscapes9432/1188CVPR 2019SynA famous rain removal dataset with paired depth maps for outdoor scenarios.
DerainRainDS3450/900CVPR 2021Syn+RealA hybrid dataset with both real and synthesized data under diverse scenarios.
DerainRainDirection2920/430ICCV 2021SynA large-scale synthetic rainy dataset with directional labels in the training phase.
DerainGT-RAIN28217/2100ECCV 2022RealThe first paired derain dataset with real data by controlling non-rain variations.
DesnowSnow100k100000TIP 2018Syn+RealA large-scale dataset with over 1k real-world images degraded by heavy snow.
DesnowSRRS16000ECCV 2020Syn+RealA hybrid snow dataset with 15k synthesized images and 1k real-world images.
DesnowCSD10000ICCV 2021SynA large-scale desnowing dataset to comprehensively simulate snow scenarios.

<a id="6.">Evaluation metrics</a>

Due to space limitations, we only introduced the evaluation metrics involved in the comparative experiments in the survey. Here, we provide a more comprehensive overview of the commonly used metrics in low-level vision tasks.

<a id="6.1"> Distortion-based metrics</a>

<a id="6.2"> Inception-based metrics</a>

<a id="Reference">Reference</a>

Awesome-diffusion-low-level-vision-by-yulunzhang

Awesome-low-level-vision-resources

Awesome-Diffusion-Models-in-Medical-Imaging: Diffusion Models in Medical Imaging

Star History

Star History Chart