Home

Awesome

DCSA-Net

This repository is the official implementation of the paper "Dynamic Convolution Self-Attention Network for Land Cover Classification in VHR Remote Sensing Images".

Abstract

The current deep convolutional neural networks for Very-High-Resolution (VHR) remote sensing image land cover classification often suffer from two challenges. First, the feature maps extracted by network encoders based on vanilla convolution usually contain a lot of redundant information, which easily causes misclassification of land cover. Moreover, these encoders usually require a large number of parameters and high computational costs. Second, as remote sensing images are complex and contain many objects with large-scale variances, it is difficult to use the popular feature fusion modules to improve the representation ability of feature maps. To address the above issues, we propose a dynamic convolution self-attention network (DCSA-Net) for VHR remote sensing image land cover classification. The proposed network has two advantages. On the one hand, we design a lightweight dynamic convolution module (LDCM) by using dynamic convo-lution and a self-attention mechanism. This module can extract more useful image features than vanilla convolution, avoiding the negative effect of useless feature maps on land cover classifi-cation. On the other hand, we design a context information aggregation module (CIAM) with a ladder structure to enlarge the receptive field. This module can aggregate multi-scale contexture information from feature maps with different resolutions using the dense connection. Experiments results show that the proposed DCSA-Net is superior to state-of-the-art networks due to higher accuracy of land cover classification, fewer parameters, and lower computational cost.

DCSA-Net architecture

alt text

Results

Our model achieves the following performance on land cover classification:

DatasetImp. Surf.BuildingLow veg.TreeCarMean F1OAmIoU
Potsdam93.6996.3488.0588.8795.6392.5291.2584.24
Vaihingen92.1196.1983.0490.3182.3988.8190.5878.93

Reference

If you found this code useful, please cite the following paper:
(This paper is currently under review. The full publication information will be added.)

@article{DCSA-Net,
  title={Dynamic Convolution Self-Attention Network for Land Cover Classification in VHR Remote Sensing Images},
  author={Xuan Wang, Yue Zhang, Tao Lei, Yingbo Wang, Yujie Zhai, and Asoke K. Nandi},
}