Home

Awesome

<p align="center"> <img src="./figures/framework.png" alt="image" style="width:1000px;"> </p>

Purpose: We aim to provide a summary of diffusion model-based image processing, including restoration, enhancement, coding, and quality assessment. More papers will be summarized.

Xin Li, Yulin Ren, Xin Jin, Cuiling Lan, Xingrui Wang, Wenjun Zeng, Xinchao Wang, Zhibo Chen

University of Science and Technology of China (USTC), National University of Singapore (NUS), Microsoft Research Asia (MSRA), Eastern Institute of Technology (EIT)

Brief intro: The survey for diffusion model-based IR has been released.

arXiv visitors

:bookmark: News!!!

📌 About new works. If you want to incorporate your studies (e.g., the link of paper or project) on diffusion model-based image processing in this repository. Welcome to raise an issue or email us. We will incorporate it into this repository and our survey report as soon as possible.

🌟 Features

Diffusion model-based Image Restoration/Enhancement

Table of contents

<!-- - [Survey paper](#survey-paper) - [Table of contents](#table-of-contents) -->

Image Super-Resolution

ModelsPaperFirst AuthorTraining WayVenueTopicProject
SR3Image super-resolution via iterative refinementChitwan SahariaSupervisedTPAMI2022Super-resolutionStars
SRDiffSRDiff: Single Image Super-Resolution with Diffusion Probabilistic ModelsHaoying LiSupervisedNeurocomputing 2022Super-resolutionStars
SDE-SRFace super-resolution using stochastic differential equationsMarcelo dos SantosSupervisedSIBGRAPI 2022Super-resolutionStars
IDMImplicit diffusion models for continuous super-resolutionSicheng GaoSupervisedCVPR2023Super-resolutionStars
PromptSRImage Super-Resolution with Text Prompt DiffusionZheng ChenSupervisedPreprint'23Super-resolutionStars
DiffIRDiffIR: Efficient diffusion model for image restorationBin XiaSupervisedICCV 2023Super-resolutionStars
CDMCascaded Diffusion Models for High Fidelity Image GenerationJonathan HoSupervisedJ.Mach.Learn.Res 2022Super-resolution
StableSRExploiting diffusion prior for real-world image super-resolutionJianyi WangSupervisedPreprint'23Real-World Super-resolutionStars
ResShiftResShift: Efficient Diffusion Model for Image Super-resolution by Residual ShiftingZongsheng YueSupervisedNeurIPS 2023Real-World Super-resolutionStars
DFOSDDistillation-Free One-Step Diffusion for Real-World Image Super-ResolutionJianze LiSupervisedPreprint'24Real-World Super-resolutionStars
ECDPEfficient Conditional Diffusion Model with Probability Flow Sampling for Image Super-resolutionYutao YuanSupervisedAAAI 2024Super-resolutionStars
SinSRSinSR: Diffusion-Based Image Super-Resolution in a Single StepYufei WangSupervisedCVPR 2024Real-World Super-resolutionStars
TextDiffTextDiff: Mask-Guided Residual Diffusion Models for Scene Text Image Super-ResolutionBaolin LiuSupervisedPreprint'23Super-resolutionStars
PASDPixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized StylizationTao YangSupervisedPreprint'23Super-resolutionStars
CCSRImproving the Stability of Diffusion Models for Content Consistent Super-ResolutionLingchen SunSupervisedPreprint'23Super-resolutionStars
EDiffSREDiffSR: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-ResolutionYi XiaoSupervisedIEEE TGRSSuper-resolutionStars
SeeSRSeeSR: Towards Semantics-Aware Real-World Image Super-ResolutionRongyuan WuSupervisedPreprint'23Super-resolutionStars
CoSeRCoSeR: Bridging Image and Language for Cognitive Super-ResolutionHaoze SunSupervisedCVPR 2024Super-resolutionStars
BI-DiffSRBinarized Diffusion Model for Image Super-ResolutionZheng ChenSupervisedNeurIPS 2024Super-resolutionStars
DoSSRTaming Diffusion Prior for Image Super-Resolution with Domain Shift SDEsQinpeng CuiSupervisedNeurIPS 2024Super-resolutionStars
DaLPSRDaLPSR: Leverage Degradation-Aligned Language Prompt for Real-World Image Super-ResolutionAiwen JiangSupervisedPreprint'24Super-resolution
FDDiffFrequency-Domain Refinement with Multiscale Diffusion for Super ResolutionXingjian WangSupervisedPreprint'24Super-resolution
PartDiffPartDiff: Image Super-resolution with Partial Diffusion ModelsKai ZhaoSupervisedPreprint'23Super-resolution
DeeDSRDeeDSR: Towards Real-World Image Super-Resolution via Degradation-Aware Stable DiffusionChunyang BiSupervisedPreprint'24(Real-World) Super-resolution
TDDSRTDDSR: SINGLE-STEP DIFFUSION WITH TWO DISCRIMINATORS FOR SUPER RESOLUTIONSohwi KimSupervisedPreprint'24Super-resolution
DiT-SREffective Diffusion Transformer Architecture for Image Super-ResolutionKun ChengSupervisedPreprint'24Super-resolution
SR3+Denoising diffusion probabilistic models for robust image super-resolution in the wildHshmat SahakSupervisedPreprint'23(Real-World) Super-resolution
DKPA Dynamic Kernel Prior Model for Unsupervised Blind Image Super-ResolutionZhixiong YangSupervisedCVPR 2024(Real-World) Super-resolutionStars
DiwaWaving Goodbye to Low-Res: A Diffusion-Wavelet Approach for Image Super-ResolutionBrian MoserSupervisedPreprint'23Super-resolutionStars
YODAYODA: You Only Diffuse Areas. An Area-Masked Diffusion Approach For Image Super-ResolutionBrian B. MoserSupervisedPreprint'23Super-resolution
CDPMSRCDPMSR: Conditional Diffusion Probabilistic Models for Single Image Super-ResolutionAxi NiuSupervisedPreprint'23Super-resolution
ACDPMSRACDMSR: Accelerated Conditional Diffusion Models for Single Image Super-ResolutionAxi NiuSupervisedPreprint'23Super-resolution
ResDiffResDiff: Combining cnn and diffusion model for image superresolutionShuyao ShangSupervisedPreprint'23Super-resolution
OSEDiffOne-Step Effective Diffusion Network for Real-World Image Super-ResolutionRongyuan WuSupervisedPreprint'24Super-resolution
DiffTSRDiffusion-based Blind Text Image Super-ResolutionYuzhe ZhangSupervisedCVPR 2024Super-resolution
SAM-DiffSRSAM-DiffSR: Structure-Modulated Diffusion Model for Image Super-ResolutionChengcheng WangSupervisedPreprint'24Super-resolutionStars
BlindDiffBlindDiff: Empowering Degradation Modelling in Diffusion Models for Blind Image Super-ResolutionFeng LiSupervisedPreprint'24Super-resolutionStars
XPSRXPSR: Cross-modal Priors for Diffusion-based Image Super-ResolutionYunpeng QuSupervisedPreprint'24Super-resolutionStars
--Text-guided Explorable Image Super-resolutionKanchana Vaishnavi GandikotaZero-ShotPreprint'24Super-resolution
--Image Super-resolution Via Latent Diffusion: A Sampling-space Mixture Of Experts And Frequency-augmented Decoder ApproachFeng LuoSupervisedPreprint'23Super-resolutionStars
--Solving Diffusion ODEs with Optimal Boundary Conditions for Better Image Super-ResolutionYiyang MaSupervisedPreprint'23Super-resolution

Image Restoration

ModelPaperFirst AuthorTraining WayVenueTopicProject
PalettePalette: Image-toimage diffusion modelsChitwan SahariaSupervisedSIGGRAPH 2022Multi-task RestorationStars
RefusionRefusion: Enabling large-size realistic image restoration with latent-space diffusion modelsZiwei LuoSupervisedCVPRW 2023Multi-task RestorationStars
SUPIRScaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the WildFanghua YuSupervisedCVPR 2024Image RestorationStars
Weather-DiffRestoring vision in adverse weather conditions with patch-based denoising diffusion modelsOzan ÖzdenizciSupervisedTPAMI2022Multi-task RestorationStars
IR-SDEImage Restoration with Mean-Reverting Stochastic Differential EquationsZiwei LuoSupervisedICML 2023Multi-task RestorationStars
DAVIDiffusion Prior-Based Amortized Variational Inference for Noisy Inverse ProblemsSojin LeeSupervisedECCV 2024Multi-task RestorationStars
SUD^2SUD ˆ2: Supervision by denoising diffusion models for image reconstructionMatthew A. ChanSupervisedPreprint'23Multi-task Restoration
InDIInversion by direct iteration: An alternative to denoising diffusion for image restorationMauricio DelbracioSupervisedPreprint'22Multi-task Restoration
AdaptBIRAdaptBIR: Adaptive Blind Image Restoration with latent diffusion prior for higher fidelityYingqi LiuSupervisedPattern Recognition 24Image Restoration
ILVRILVR: Conditioning method for denoising diffusion probabilistic modelsJooyoung ChoiZero-ShotICCV2021Image RestorationStars
CCDFCome-closer-diffusefaster: Accelerating conditional diffusion models for inverse problems through stochastic contractionHyungjin ChungZero-ShotCVPR2022Multi-task Restoration
SNIPSSNIPS: Solving noisy inverse problems stochasticallyBahjat KawaZero-ShotNeurIPS 2021Multi-task RestorationStars
DDRMDenoising diffusion restoration modelsBahjat KawarZero-ShotICLR2022Multi-task RestorationStars
DDNMZero-Shot image restoration using denoising diffusion null-space modelYinhuai WangZero-ShotICLR2023Multi-task RestorationStars
DPSDiffusion Posterior Sampling for General Noisy Inverse ProblemsHyungjin ChungZero-ShotICLR 2023Multi-task RestorationStars
DiffPIRDenoising diffusion models for plug-and-play image restorationYuanzhi ZhuZero-ShotCVPR 2023Multi-task RestorationStars
DPPSDiffusion Posterior Proximal Sampling for Image RestorationHongjie WuZero-ShotACMM 2024 OralMulti-task RestorationStars
DiracDiffusionDiracDiffusion: Denoising and incremental reconstruction with assured data-consistencyZalan FabianZero-ShotPreprint' 23Multi-task Restoration
IIGDMPseudoinverse-guided diffusion models for inverse problemsJiaming SongZero-ShotICLR 2023Multi-task Restoration
GDPGenerative diffusion prior for unified image restoration and enhancementBen FeiZero-ShotCVPR2023Multi-task RestorationStars
RED-DiffA variational perspective on solving inverse problems with diffusion modelsMorteza MardaniZero-ShotPrePrint'23Multi-task RestorationStars
DeqIRDeep Equilibrium Diffusion Restoration with Parallel SamplingJiezhang CaoZero-ShotCVPR 2024Multi-task RestorationStars
SaFaRISpatial-and-Frequency-aware Restoration method for Images based on Diffusion ModelsKyungsung LeeZero-ShotPrePrint'24Multi-task Restoration
OmniSSROmniSSR: Zero-Shot Omnidirectional Image Super-Resolution using Stable Diffusion ModelRunyi LiZero-ShotPreprint'24Blind Restoration
DriftRecDriftRec: Adapting diffusion models to blind image restoration tasksSimon WelkerSupervisedPreprint'22Blind Restoration
DR2DR2: Diffusion-based robust degradation remover for blind face restorationZhixin WangZero-ShotCVPR2023Blind Face RestorationStars
PFStorerPFStorer: Personalized Face Restoration and Super-ResolutionTuomas VarankaSupervisedPreprint'24Blind Face Restoration
DiffBFRDiffBFR: Bootstrapping diffusion model towards blind face restorationXinmin QiuSupervisedPreprint'23Blind Face Restoration
DifFaceDifFace: Blind face restoration with diffused error contractionZongsheng YuZero-ShotPrePrint'23Blind RestorationStars
--Towards Unsupervised Blind Face Restoration using Diffusion PriorTianshu KuaiSupervisedPrePrint'24Blind Restoration
GibbsDDRMGibbsDDRM: A partially collapsed gibbs sampler for solving blind inverse problems with denoising diffusion restorationNaoki MurataZero-ShotICML 2023Blind RestorationStars
ADIRADIR: Adaptive diffusion for image reconstructionShady Abu-HusseinZero-ShotPrePrint'22Blind Restoration
PSLDSolving Linear Inverse Problems Provably via Posterior Sampling with Latent Diffusion ModelsLitu RoutZero-ShotPrePrint'23Image RestorationStars
IDMTowards Authentic Face Restoration with Iterative Diffusion Models and BeyondYang ZhaoSupervisedICCV 2023Face Restoration
DiffBIRDiffBIR: Towards Blind Image Restoration with Generative Diffusion PriorXinqi LinSupervisedPreprint' 2023Image RestorationStars
RDDMResidual Denoising Diffusion ModelsJiawei LiuSupervisedPreprint' 2023Image RestorationStars
C2F-DFTLearning A Coarse-to-Fine Diffusion Transformer for Image RestorationLiyan WangSupervisedPreprint' 2023Image RestorationStars
Diff-PluginDiff-Plugin: Revitalizing Details for Diffusion-based Low-level tasksYuhao LiuSupervisedCVPR 2024All-in-one RestorationStars
DDPGImage Restoration by Denoising Diffusion Models with Iteratively Preconditioned GuidanceTomer GarberZero-ShotCVPR 2024Image RestorationStars
DiffUIRSelective Hourglass Mapping for Universal Image Restoration Based on Diffusion ModelDian ZhengSupervisedCVPR 2024Image RestorationStars
DMPlugDMPlug: A Plug-in Method for Solving Inverse Problems with Diffusion ModelsHengkang WangSupervisedNeurIPS 2024Image RestorationStars
MPerceiverMultimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image RestorationYuang AiSupervisedCVPR 2024All-in-one Restoration
MCGdiffMonte Carlo guided Diffusion for Bayesian linear inverse problemsGabriel CardosoZero-ShotPreprint' 2023Image Restoration
PromptFixPromptFix: You Prompt and We Fix the PhotoYongsheng YuSupervisedPreprint' 2024Image RestorationStars
AutoDIRAutoDIR: Automatic All-in-One Image Restoration with Latent DiffusionYitong JiangSupervisedPreprint' 2023Image Restoration
DiffLossUsing diffusion model as constraint: Empower Image Restoration Network Training with Diffusion ModelJiangtong TanSupervisedPreprint' 2024Image Restoration
ZeroAIRExploiting Diffusion Priors for All-in-One Image RestorationYuanbiao GouSupervisedPreprint' 2023Image Restoration
FastDiffusionEMFast Diffusion EM: a diffusion model for blind inverse problems with application to deconvolutionCharles LarocheSupervisedWACV 2024Blind Image Restoration
P2LPROMPT-TUNING LATENT DIFFUSION MODELS FOR INVERSE PROBLEMSHyungjin ChungSupervisedPreprint' 2023Image Restoration
JCDMJoint Conditional Diffusion Model for Image Restoration with Mixed DegradationsYufeng YueSupervisedPreprint' 2024Image Restoration
DACLIP-IRPhoto-Realistic Image Restoration in the Wild with Controlled Vision-Language ModelsZiwei LuoSupervisedPreprint' 2024Image RestorationStars
MoE-DiffIRMoE-DiffIR: Task-customized Diffusion Priors for Universal Compressed Image RestorationYulin RenSupervisedECCV 2024Image RestorationStars
Noise-DADenoising as Adaptation: Noise-Space Domain Adaptation for Image RestorationKang LiaoSupervisedPreprint' 2024Image RestorationStars
T^3^-DiffWeatherTeaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything ConstraintSixiang ChenSupervisedECCV 2024Adverse Weather RestorationStars
ReviveDiffReviveDiff: A Universal Diffusion Model for Restoring Images in Adverse Weather ConditionsWenfeng HuangSupervisedPreprint' 24Adverse Weather Restoration
Diff-RestorerDiff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image RestorationYuhong ZhangSupervisedPreprint' 2024Image Restoration
--Diffusion Posterior Proximal Sampling for Image RestorationHongjie WuZero-ShotPreprint'24Multi-task Restoration
--Multiscale Structure Guided Diffusion for Image DeblurringMengwei RenSupervisedPreprint'22Blind Restoration
--Synthesizing realistic image restoration training pairs: A diffusion approachTao YangSupervisedPreprint'22Blind Restoration

Image Inpainting

ModelPaperFirst AuthorTraining WayVenueTopicProject
RePaintRePaint: Inpainting using denoising diffusion probabilistic modelsAndreas LugmayrZero-ShotCVPR2022Image InpaintingStars
CoPaintTowards coherent image inpainting using denoising diffusion implicit modelsGuanhua ZhangZero-ShotPrePrint'23Image InpaintingStars
PVAPersonalized Face Inpainting with Diffusion Models by Parallel Visual AttentionJianjin XuZero-ShotPrePrint'23Image Inpainting

Image Shadow Removal

ModelPaperFirst AuthorTraining WayVenueTopicProject
BCDiffBoundary-Aware Divide and Conquer: A Diffusion-based Solution for Unsupervised Shadow RemovalLanqing GuoUnsupervisedICCV 2023Image Shadow Removal
ShadowDiffusionShadowdiffusion: When degradation prior meets diffusion model for shadow removalLanqing GuoSupervisedCVPR2023Image Shadow RemovalStars
DeS3DeS3: Attention-driven Self and Soft Shadow Removal using ViT Similarity and Color ConvergenceYeying JinSupervisedAAAI'24Image Shadow RemovalStars
Diff-ShadowDiff-Shadow: Global-guided Diffusion Model for Shadow RemovalJinting LuoSupervisedPreprint'24Image Shadow Removal
LFG-DiffusionLatent Feature-Guided Diffusion Models for Shadow RemovalKangfu MeiSupervisedWACV 2024Image Shadow Removal
Deshadow-AnythingDeshadow-Anything: When Segment Anything Model Meets Zero-Shot shadow removalXiao Feng ZhangSupervisedPreprint'23Image Shadow Removal

Image Denoising

PaperFirst AuthorTraining WayVenueTopicProject
Diffusion model for generative image denoisingYutong XieSupervisedPreprint'23Image Denoising
Score-Based Diffusion Models as Principled Priors for Inverse ImagingBerthy T. FengZero-ShotICCV 2023Image Denoising, Image DeblurringStars
Real-World Denoising via Diffusion ModelCheng YangSupervisedPrePrint'23Image Denoising

Image Dehazing

ModelPaperFirst AuthorTraining WayVenueTopicProject
HazeDDPMHigh-quality Image Dehazing with Diffusion ModelHu YuSupervisedPreprint'23Image Dehazing
--Frequency Compensated Diffusion Model for Real-scene DehazingJing WangSupervisedPreprint'23Image Dehazing

Image Deblurring

PaperFirst AuthorTraining WayVenueTopicProject
Deblurring via stochastic refinementJay WhangSupervisedCVPR2022Image Deblurring
Score-Based Diffusion Models as Principled Priors for Inverse ImagingBerthy T. FengZero-ShotICCV 2023Image Denoising, Image DeblurringStars
BlindDPS:Parallel diffusion models of operator and image for blind inverse problemsHyungjin ChungZero-ShotCVPR2023Blind DeblurringStars
HI-Diff:Hierarchical Integration Diffusion Model for Realistic Image DeblurringZheng ChenSupervisedPrepreint'23Image DeblurringStars
Swintormer:Efficient Image Deblurring Networks based on Diffusion ModelsKang ChenSupervisedPrepreint'24Image DeblurringStars

Medical Restoration (MRI,CT)

ModelPaperFirst AuthorTraining WayVenueTopicProject
MCGImproving diffusion models for inverse problems using manifold constraintsHyungjin ChungZero-ShotNeurIPS 2022CT ReconstructionStars
--Solving inverse problems in medical imaging with score-based generative modelsYang SongZero-ShotICLR 2022CT Reconstruction
AdaDiffAdaptive diffusion priors for accelerated mri reconstructionAlper GüngörSupervisedPreprint'23MRI ReconstructionStars
HFS-SDEHigh-Frequency Space Diffusion Models for Accelerated MRIChentao CaoSupervisedPreprint'22MRI Reconstruction
SWORDStage-by-stage Wavelet Optimization Refinement Diffusion Model for Sparse-View CT ReconstructionKai XuSupervisedPreprint'23MRI ReconstructionStars
FDBLearning Fourier-Constrained Diffusion Bridges for MRI ReconstructionMuhammad U. MirzaSupervisedPreprint'23MRI ReconstructionStars

Low-Light Enchancement

ModelPaperFirst AuthorTraining WayVenueTopicProject
PyDiffPyramid Diffusion Models For Low-light Image EnhancementDewei ZhouSupervisedPreprint'23Low-light EnhancemnentStars
LightenDiffusionLightenDiffusion: Unsupervised Low-Light Image Enhancement with Latent-Retinex Diffusion ModelsHai JiangSupervisedECCV 2024Low-light EnhancemnentStars
DiffLLLowlight image enhancement with wavelet-based diffusion modelsHai JiangSupervisedPreprint'23Low-light EnhancemnentStars
ExploreDiffusionExposureDiffusion: Learning to Expose for Low-light Image EnhancementYufei WangSupervisedICCV 2023Low-light EnhancemnentStars
Diff-RetinexRethinking Low-light Image Enhancement with A Generative Diffusion ModelXunpeng YiSupervisedICCV 2023Low-light Enhancemnent
CLE DiffusionCLE Diffusion: Controllable Light Enhancement Diffusion ModelYuyang YinSupervisedPreprint'23Low-light EnhancemnentStars
DiffLLEDiffLLE: Diffusion-guided Domain Calibration for Unsupervised Low-light Image EnhancementShuzhou YangSupervisedPreprint'23Low-light Enhancemnent
LLDiffusionLLDiffusion: Learning Degradation Representations in Diffusion Models for Low-Light Image EnhancementTao WangSupervisedPreprint'23Low-light EnhancemnentStars
Entropy-SDEEquipping Diffusion Models with Differentiable Spatial Entropy for Low-Light Image EnhancementWenyi LianSupervisedCVPRW 2024Low-light EnhancemnentStars

Other tasks

ModelPaperFirst AuthorTraining WayVenueTopicProject
RainDiffusionRainDiffusion: When Unsupervised Learning Meets Diffusion Models for Real-world Image DerainingMingqiang WeiSupervisedPreprint'23Image Deraining
GaussianSRGaussianSR: 3D Gaussian Super-Resolution with 2D Diffusion PriorsXiqian YuSupervisedPreprint'243D Gaussian Super-resolution
DIffSteISRDIffSteISR: Harnessing Diffusion Prior for Superior Real-world Stereo Image Super-ResolutionYuanbo ZhouSupervisedPreprint'24Stereo Image Super-Resolution
DiffGARDiffGAR: Model-agnostic restoration from generative artifacts using image-to-image diffusion modelsYueqin YinSupervisedPreprint'22Generative Artifacts Removal
HSR-DiffHSR-Diff: Hyperspectral Image Super-Resolution via Conditional Diffusion ModelsChanyue WuSupervisedPreprint'23hyperspectral images super-resolution
DMGASREnhancing Hyperspectral Images via Diffusion Model and Group-Autoencoder Super-resolution NetworkZhaoyang WangSupervisedPreprint'24hyperspectral images super-resolution
DRUSUltrasound Image Reconstruction with Denoising Diffusion Restoration ModelsYuxin ZhangZero-ShotPreprint'23Ultrasound Image ReconstructionStars
PromptRRPromptRR: Diffusion Models as Prompt Generators for Single Image Reflection RemovalTao WangSupervisedPreprint'24Image Reflection Removal
--Jpeg artifact correction using denoising diffusion restoration modelsBahjat KawarZero-ShotNeurIPS 2022JPEG Artifacts RemovalStars
--Improved Diffusion-based Image Colorization via Piggybacked ModelsHanyuan LiuZero-ShotPrePrint'23Image ColorizationStars

Benchmark Datasets

DatasetTaskUsageYear
DIV2KImage Super-resolutionTraining,Testing2017
Flickr2KImage Super-resolutionTraining2017
Set5Image Super-resolutionTesting2012
Set14Image Super-resolutionTesting2012
BSD100Image Super-resolutionTesting2012
Manga109Image Super-resolutionTesting2015
Urban100Image Super-resolutionTesting2015
OST300Image Super-resolutionTesting2018
DIV8KImage Super-resolutionTraining,Testing2019
RealSRImage Super-resolutionTraining,Testing2019
DRealSRImage Super-resolutionTraining,Testing2020
GoProImage DeblurringTraining,Testing2017
HIDEImage DeblurringTraining,Testing2019
RealBlurImage DeblurringTraining,Testing2020
KodakImage DenoisingTesting1999
CBSD68Image DenoisingTesting2001
McMasterImage DenoisingTesting2011
ImageNetImage ClassificationTraining,Testing2010
ImageNet1kImage ClassificationTesting2020
LSUNImage ClassificationTraining,Testing2015
Places365Image ClassificationTraining,Testing2019
LFWFace GenerationTraining2008
FFHQFace GenerationTraining2019
Celeba-HQFace GenerationTraining2018
AFHQFace GenerationTraining2020
CelebAFace GenerationTraining2015
ISTDImage Shadow RemovalTraining,Testing2018
SRDImage Shadow RemovalTraining,Testing2017
CSDImage DesnowingTraining,Testing2021
Snow100kImage DesnowingTraining,Testing2017
SRRSImage DesnowingTraining,Testing2020
RainDropImage DerainingTraining2018
RainDropClarityImage DerainingTraining,Testing2024
Outdoor-RainImage DerainingTraining,Testing2019
DDN-dataImage DerainingTraining,Testing2017
SPA-dataImage DerainingTraining,Testing2019
Rain100HImage DerainingTraining,Testing2017
Rain100LImage DerainingTraining,Testing2017
Haze-4KImage DehazingTraining2021
Dense-HazeImage DehazingTraining2019
RESIDEImage DehazingTraining2019

Diffusion model-based Image/Video Compression

<a id="compression"></a>

ModelPaperFirst AuthorVenueTopicProject
DiffCLossy Compression with Gaussian DiffusionLucas TheislPreprint'22Lossy Image Compression
CDCLossy Image Compression with Conditional Diffusion ModelsRuihan YangNeurIPS 2023Lossy Image CompressionStars
CorrDiffCorrecting Diffusion-Based Perceptual Image Compression with Privileged End-to-End DecoderYiyang MaICML 2024Image Compression
I<sup>2</sup>VCI2VC: A Unified Framework for Intra- & Inter-frame Video CompressionMeiqin LiuNeurIPS2024 submissionVideo CompressionStars
DiffEICTowards Extreme Image Compression with Latent Feature Guidance and Diffusion PriorZhiyuan LiIEEE TCSVTLossy Image Compression
PSCZero-Shot Image Compression with Diffusion-Based Posterior SamplingNoam ElataPreprint'24Lossy Image Compression
DIRACA Residual Diffusion Model for High Perceptual Quality Codec AugmentationNoor Fathima GhousePreprint'23Image Compression
HFDHigh-Fidelity Image Compression with Score-based Generative ModelsEmiel HoogeboomPreprint'23Lossy Image Compression
PerCoTowards image compression with perfect realism at ultra-low bitratesMarl` ene CareilICLR 2024Lossy Image Compression
PICText + Sketch: Image Compression at Ultra Low RatesEric LeiICML 2023 workshop Lossy Image Compression
Idempotence and Perceptual Image CompressionTongda XuICLR2024Lossy Image CompressionStars
--Lossy Image Compression with Foundation Diffusion ModelsLucas RelicPreprint'24Image Compression
--Extreme Generative Image Compression by Learning Text Embedding from Diffusion ModelsZhihong PanPreprint'22Image Compression

Diffusion model-based Image/Video quality assessment

<a id="IQA"></a>

ModelPaperFirst AuthorVenueTopicProject
DifFIQADifFIQA: Face Image Quality Assessment Using Denoising Diffusion Probabilistic ModelsŽiga BabnikPreprint'23Image quality assessmentStars
PFD-IQAFeature Denoising Diffusion Model for Blind Image Quality AssessmentXudong LiPreprint'24Image quality assessment
DP-IQADP-IQA: Utilizing Diffusion Prior for Blind Image Quality Assessment in the WildHonghao FuPreprint'24Image quality assessmentStars
GenzIQAGenzIQA: Generalized Image Quality Assessment using Prompt-Guided Latent Diffusion ModelsDiptanu DePreprint'24Image quality assessment
DiffV<sup>2</sup>IQA</span>Diffusion Model Based Visual Compensation Guidance and Visual Difference Analysis for No-Reference Image Quality AssessmentZhaoyang WangPreprint'24Image quality assessment

Cite US

If this work is helpful to you, we expect you can cite this work and star this repo. Thanks.

@article{li2023diffusion,
  title={Diffusion Models for Image Restoration and Enhancement--A Comprehensive Survey},
  author={Li, Xin and Ren, Yulin and Jin, Xin and Lan, Cuiling and Wang, Xingrui and Zeng, Wenjun and Wang, Xinchao and Chen, Zhibo},
  journal={arXiv preprint arXiv:2308.09388},
  year={2023}
}
<p align="center"> <a href="https://star-history.com/#lixinustc/Awesome-diffusion-model-for-image-processing&Date"> <img src="https://api.star-history.com/svg?repos=lixinustc/Awesome-diffusion-model-for-image-processing&type=Date" alt="Star History Chart"> </a> </p>