Home

Awesome

SegNet --> AirNet

AirNet is a segmentation network based on SegNet, but with some modifications. The goal is to use the model to segment multispectral images, so that geographical information (e.g. building information) can be extracted. The model is implemented in Tensorflow.

Recognition

Architecture

NB! If you are unfamiliar with how convolutional neural networks work, I have written a blogpost that explains the basic concepts.

I've implemented four different version of the models:

All the AirNet models have:

Airnet extended architecture

Optimizers and initializers

Different optimizers and initializers have been tested on each of the models. The ones that were tested are listed below, and the ones that was chosen based on performance is given in the model description.

Optimizers:

Weight initializers:

AirNet Basic

<img src="docs/Basic.png" title="AirNet basic architecture" width="400px"/>

AirNet Basic dropout

Same architecture as Basic, except for dropoutlayers that are added after the pooling layers, with a dropout rate of 0.5.

AirNet Extended

The extended model is much larger and has 5 encoders and 5 decoders. It takes longer time to train, it is slower during inference, but achieves higher performance when trained sufficiently.

<img src="docs/Extended.png" title="AirNet extended architecture" width="600px"/>

AirNet Extended dropout

Same architecture as Extended, except for dropoutlayers that are added after the pooling layers, with a dropout rate of 0.5.

<img src="docs/Extended-dropout.png" title="AirNet extended dropout architecture"/>

Usage

Requirements

pip install -r AirNet/requirements.txt

Run TensorBoard:

tensorboard --logdir=path/to/log-directory

Dataset

To verify the model I used the CamVid dataset. This can be downloaded from: https://github.com/alexgkendall/SegNet-Tutorial, and used in the model by setting the correct paths and dataset size in AirNet/_init_.py

The datasets of aerial images used to train and test the model is constructed through an automatic mapping of vector data and aerial images of Norway. Both a dataset with IR images, and with RGB images was constructed, both containing around 4500 images. The data is unfortunately not open source.

Example dataset

Results

The IR images gave a small increase in performance, and examples of the segmentation can be seen here:

<img src="docs/Example-result.png" width="250"/> <img src="docs/Example-result-2.png" width="250"/> <img src="docs/Example-result-3.png" width="250"/>