Awesome

Transformer-in-Remote-Sensing:A-Survey

This repo supplements our Transformer in Remote Sensing Survey

Abdulaziz Amer Aleissaee*, Amandeep Kumar*, Rao Muhammad Anwer, Salman Khan, Hisham Cholakkal, Fahad Shahbaz khan

This repo includes the Remote Sensing papers with Transformers which are presented in our paper, and we aim to frequently update the latest relevant papers.

Content

• VHR Imagery<br>

  • Image Classification<br>
  • Image Detection<br>
  • Change Detection<br>
  • Image Segmentation<br>
  • Building Extraction<br>
  • Image Captioning<br>
  • Image Super Resolution<br>

• Hyperspectral Imagery<br>

  • Image Classification<br>
  • Pan Sharpening<br>

• SAR Imagery<br>

  • Image Classification<br>
  • Image Detection<br>
  • Despeckling<br>
  • Registration<br>
  • Change Detection<br>
  • SAR Image Interpretation<br>
  • Others<br>

  VHR Imagery

  Image Classification

  Vision transformers for remote sensing image classification [PDF]<br>

  TRS: Transformers for Remote Sensing Scene Classification [PDF]<br>

  Two-stream swin transformer with differentiable sobel operator for remote sensing image classification[PDF]<br>

  When cnns meet vision trans-former: A joint framework for remote sensing scene classification, [PDF]<br>

  Homo– heterogenous transformer learning framework for rs scene classification [PDF]<br>

  An Empirical Study of Remote Sensing Pretraining [PDF]<br>

  Image Detection

  An improved swin transformer-based model for remote sensing object detection and instance segmentation [PDF]<br>

  Transformer with transfer cnn for remote-sensing-image object detection [PDF]<br>

  Gansformer: A detection network for aerial images with high performance com- bining convolutional network and transformer[PDF]<br>

  Adt-det: Adaptive dynamic refined single-stage transformer detector for arbitrary- oriented object detection in satellite optical imagery, [PDF]<br>

  Point rcnn: An angle-free framework for rotated object detection [PDF]<br>

  Hybrid network model: Transconvnet for oriented object detection in remote sensing images [PDF]<br>

  Oriented reppoints for aerial object detection [PDF]<br>

  Oriented object detection with transformer [PDF]<br>

  Ao2-detr: Arbitrary-oriented object detection transformer [PDF]<br>

  Few could be better than all: Feature sampling and grouping for scene text detection, [PDF]<br>

  Rodformer: High- precision design for rotating object detection with transformers, [PDF]<br>

  Change Detection

  Remote sensing image change detection with transformers [PDF]<br>

  Deep multiscale siamese network with parallel convolutional structure and self-attention for change detection [PDF]<br>

  Swinsunet: Pure transformer network for remote sensing image change detection [PDF]<br>

  A network combining a transformer and a convolutional neural network for remote sensing image change detection, [PDF]<br>

  A hybrid transformer network for change detection in optical remote-sensing images [PDF]<br>

  Hybrid-transcd: A hybrid transformer remote sensing image change detection network via token aggregation [PDF]<br>

  Image Segmentation

  Stransfuse: Fusing swin transformer and convolutional neural network for remote sensing image semantic segmentation [PDF]<br>

  Cctnet: Coupled cnn and transformer network for crop segmentation of remote sensing images, [PDF]<br>

  Transformer and cnn hybrid deep neural network for semantic segmentation of very-high-resolution remote sensing imagery [PDF]<br>

  Transformer-based decoder designs for semantic segmentation on remotely sensed images [PDF]<br>

  Efficient transformer for remote sensing image segmentation [PDF]<br>

  Building Extraction

  Building extraction from remote sensing images with sparse token transformers, [PDF]<br>

  A swin transformer-based encoding booster integrated in u-shaped network for building extraction [PDF]<br>

  Building extraction with vision transformer [PDF]<br>

  Transferring transformer-based models for cross-area building extraction from remote sensing images [PDF]<br>

  Image Captioning

  Remote sensing image caption generation via transformer and reinforcement learning, [PDF]<br>

  Remote-sensing image captioning based on multilayer aggregated transformer [PDF]<br>

  A mask-guided transformer network with topic token for remote sensing image captioning [PDF]<br>

  Image Super Resolution

  Tr-misr: Multiimage super-resolution based on feature fusion with transformers, [PDF]<br>

  Transformer-based multistage enhancement for remote sensing image super-resolution [PDF]<br>

  A super- resolution method of remote sensing image using transformers [PDF]<br>

  Space-time Super-resolution for Satellite Video: A Joint Framework Based on Multi-Scale Spatial-Temporal Transformer [PDF]<br>

  Hyperspectral Imagery

  Image Classification

  Spectralformer: Rethinking hyperspectral image classification with transformers[PDF]<br>

  Multiscale convolutional transformer with center mask pretraining for hyperspectral image classification [PDF]<br>

  Multimodal fusion transformer for remote sensing image classification [PDF]<br>

  Convolutional transformer network for hyperspectral image classification, [PDF]<br>

  Deep hierarchical vision transformer for hyperspectral and lidar data classification [PDF]<br>

  Dss-trm: deep spatial–spectral transformer for hyperspectral image classification [PDF]<br>

  Hyperspectral image trans- former classification networks [PDF]<br>

  Hsi-bert: Hyperspectral image classification using the bidirectional en- coder representation from transformers [PDF]<br>

  Spectral–spatial feature tokenization transformer for hyperspectral image classification [PDF]<br>

  Spectral-spatial transformer network for hyperspectral image classification: A factorized architecture search framework, [PDF]<br>

  Pan-Sharpening

  PanFormer: a Transformer Based Model for Pan-sharpening [PDF]<br>

  Hypertransformer: A textural and spectral feature fusion transformer for pansharpening [PDF]<br>

  Pmacnet: Parallel multiscale attention constraint network for pan-sharpening [PDF]<br>

  Pan-sharpening based on cnn+ pyramid transformer by using no-reference loss, [PDF]<br>

  Multiscale spatial–spectral interaction transformer for pan-sharpening [PDF]<br>

  Transformer-based regression network for pansharpening remote sensing images [PDF]<br>

  SAR Imagery

  Image Classification

  Exploring vision transformers for polarimetric sar image classification [PDF]<br>

  High resolution sar image classification using global-local network structure based on vision transformer and cnn [PDF]<br>

  St-pn: A spatial transformed prototypical network for few-shot sar image classification [PDF]<br>

  Segmentation

  Gcbanet: A global context boundary-aware network for sar ship instance segmentation[PDF]<br>

  Image Detection

  Crtranssar: A visual transformer based on contextual joint representation learning for sar ship detection [PDF]<br>

  Geospatial transformer is what you need for aircraft detection in sar imagery [PDF]<br>

  Sfre-net: Scattering feature relation enhancement network for aircraft detection in sar images [PDF]<br>

  End-to-end method with transformer for 3d detection of oil tank from single sar image, [PDF]<br>

  Despeckling

  Transformer based sar image despeckling [PDF]<br>

  Change Detection

  A contrastive learning transformer for change detection in highresolution sar images [PDF]<br>

  Image Registration

  A transformer-based coarse-tofine wide-swath sar image registration method under weak texture conditions [PDF]<br>

  Citation

If you find this work useful in your research, please consider citing:

@article{aleissaee2022transformers,
  title={Transformers in Remote Sensing: A Survey},
  author={Aleissaee, Abdulaziz Amer and Kumar, Amandeep and Anwer, Rao Muhammad and Khan, Salman and Cholakkal, Hisham and Xia, Gui-Song and others},
  journal={arXiv preprint arXiv:2209.01206},
  year={2022}
}