Home

Awesome

Effective Variance Attention-enhanced Diffusion Model (EVADM) for Crop Field Aerial Image Super Resolution

Overview 💥

This is the repository includes the models, methods and data developed in paper:

Effective variance attention-enhanced diffusion model for crop field aerial image super resolution that published in ISPRS Journal of Photogrammetry and Remote Sensing.

ResearchGate: ResearchGate Article

中文简介:基于方差注意力和隐扩散模型的无人机图像超分辨率

The Effective Variance Attention-enhanced Diffusion Model (EVADM) is designed to enhance the resolution and quality of aerial imagery, particularly focusing on high-resolution cropland images. By leveraging emerging diffusion models (DM) and introducing the Variance-Average-Spatial Attention (VASA) mechanism, EVADM significantly improves image super-resolution (SR) tasks.

<div style="text-align: center;"> <img src="img/Fig Abst.jpg" data-align="center" width="80%">

Efficient VASA-enhanced Diffusion Model (EVADM) and the elevated image Variance after SR.

</div>

Main Contributions

Dataset

CropSR (for training)

CropSR-FP/OR (for real-SR testing)

Model Performance

Generalization Ability

EVADM has demonstrated superior generalization capabilities on the open Agriculture-Vision dataset, highlighting its robustness across various aerial imagery tasks.

Ablation Studies

The model's effectiveness is validated through ablation studies and feature-attention map analyses, providing insights into the mechanism of VASA and the SR process.

Practical Applications

EVADM offers a promising approach for realistic aerial imagery super-resolution, showcasing high practicality for various downstream applications in agriculture and beyond.

💎 Go to /EVADM/ for demo & code

Installation

All models were implemented using Python and the PyTorch framework and trained on an NVIDIA RTX 4090 GPU. The EVADM model is based on the LDM (Rombach et al., 2022), please refer to both EVADM and LDM setup instructions. Download weights to EVADM/weights/ folder from weights.

Go under EVADM/ and run for EVADM SR usage demo:

python eva101_EVADM_infer.py

SRFI metrics

For calculating the SRFI model, see :

eva102_SRFI_metrics.py

License

This project is licensed under the MIT License. See the LICENSE file for details.

Acknowledgments

We thank all reviewers for their constructive feedback, which greatly contributed to the improvement of this project.