Awesome

GenAI Meets SAR: A List of Resources

Awesome papers

Review & Survey Papers

GenAI Technology

A Survey on Generative Modeling with Limited Data, Few Shots, and Zero Shot

Controllable Data Generation by Deep Learning: A Review

Diffusion Models: A Comprehensive Survey of Methods and Applications

Making Images Real Again: A Comprehensive Survey on Deep Image Composition

Synthetic Aperture Radar

Application of deep generative networks for SAR/ISAR: a review

A review of Generative Adversarial Networks (GANs) and its applications in a wide variety of disciplines - From Medical to Remote Sensing

Deep Learning Methods For Synthetic Aperture Radar Image Despeckling: An Overview Of Trends And Perspectives

Explainable, Physics-Aware, Trustworthy Artificial Intelligence: A paradigm shift for synthetic aperture radar

Microwave Vision and Intelligent Perception of Radar Imagery

A review and meta-analysis of Generative Adversarial Networks and their applications in remote sensing

Electromagnetic Modeling

SARCASTIC v2.0—High-Performance SAR Simulation for Next-Generation ATR Systems

Ray-Tracing Simulation Techniques for Understanding High-Resolution SAR Images

Potentials and limitations of SAR image simulators – A comparative study of three simulation approaches

Imaging Simulation of Polarimetric SAR for a Comprehensive Terrain Scene Using the Mapping and Projection Algorithm

RaySAR - 3D SAR simulator: Now open source

Statistic Modeling

Numerical Simulation of SAR Image for Sea Surface

Synthetic Aperture Radar Image Statistical Modeling: Part One-Single-Pixel Statistical Models

Synthetic Aperture Radar Image Statistical Modeling: Part Two-Spatial Correlation Models and Simulation

A Facet-Based Numerical Model for Simulating SAR Altimeter Echoes From Heterogeneous Sea Ice Surfaces

Statistical Modeling of Polarimetric SAR Data: A Survey and Challenges

A Physical Analysis of Polarimetric SAR Data Statistical Models

Physics-Inspired GenAI Methods

NeRF + Radar:

Radar Fields: An Extension of Radiance Fields to SAR

DART: Implicit Doppler Tomography for Radar Novel View Synthesis

Radar Fields: Frequency-Space Neural Scene Representations for FMCW Radar

ISAR-NeRF: Neural Radiance Fields for 3-D Imaging of Space Target From Multiview ISAR Images

Circular SAR Incoherent 3D Imaging with a NeRF-Inspired Method

RaNeRF: Neural 3-D Reconstruction of Space Targets From ISAR Image Sequences

Physics Meets GenAI in computer vision:

PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identification

Physics-Informed Guided Disentanglement in Generative Networks

Model-Based Deep Learning

PhyRecon: Physically Plausible Neural Scene Reconstruction

Physically-aware Generative Network for 3D Shape Modeling

AI-Empowered Physical Model

Dynamic ocean inverse modeling based on differentiable rendering

Differentiable Rendering for Synthetic Aperture Radar Imagery

Learning Surface Scattering Parameters From SAR Images Using Differentiable Ray Tracing

Reinforcement Learning for SAR View Angle Inversion with Differentiable SAR Renderer

Extension of Differentiable SAR Renderer for Ground Target Reconstruction From Multiview Images and Shadows

Differentiable SAR Renderer and Image-Based Target Reconstruction

Model-Based Information Extraction From SAR Images Using Deep Learning

A SAR Target Image Simulation Method With DNN Embedded to Calculate Electromagnetic Reflection

Parameter Extraction Based on Deep Neural Network for SAR Target Simulation

Datasets

Multi-view SAR Target Generation

The moving and stationary target acquisition and recognition (MSTAR) dataset

The Synthetic and Measured Paired and Labeled Experiment (SAMPLE) dataset

飞机目标多角度SAR数据集

OpenSARShip dataset

FUSARShip dataset

SAR-to-Optical Image Translation

SEN1-2: The SEN1-2 Dataset for Deep Learning in SAR-Optical Data Fusion

SAR2Opt: A Comparative Analysis of GAN-Based Methods for SAR-to-Optical Image Translation

QXS-SAROPT: The QXS-SAROPT Dataset for Deep Learning in SAR-Optical Data Fusion

SEN12MS: SEN12MS – A Curated Dataset of Georeferenced Multi-Spectral Sentinel-1/2 Imagery for Deep Learning and Data Fusion

WHU-SEN-City: SAR-to-Optical Image Translation Using Supervised Cycle-Consistent Adversarial Networks

Multi-Sensor All Weather Mapping (MSAW) Dataset: SpaceNet 6: Multi-Sensor All Weather Mapping Dataset

Experiments

We provide several baseline models based on GAN for multi-view SAR target image generation under limited observation angles. The source code can be found at ./GAN

Method

The baseline models are based on ACGAN, utilizing class label $y$ and azimuth angle $\theta$ as conditional inputs. The discriminator not only differentiates whether the input image is true or false, but also predicts the class label and azimuth angle of it. Furthermore, in order to stabilize the training process, we adopt the following techniques respectively:

SNGAN(Spectral Normalization for Generative Adversarial Networks)
LSGAN(Least Squares Generative Adversarial Networks)
DRAGAN(On convergence and stability of gans)
WGAN-GP(Improved Training of Wasserstein GANs)

Getting started

Datasets

MSTAR dataset is used in the experiment. The dataset contains ten different classes of vehicles with azimuth angle ranging from 0° to 360°.

Training

To train a GAN model, run the following command:

python train.py \
   --bs 32 \
   --lrg 0.0001 \
   --lrd 0.0001 \
   --num_epochs 500 \
   --save_dir ${SAVE_PATH} \

lrg and lrd are the learning rate of the generator and discriminator respectively

Generating

After training stage, run the following command to generate SAR target images with given label and angle information corresponding to a 15◦ depression angle.

python generate.py