Home

Awesome

Deep Learning Based Large-Scale Automatic Satellite Crosswalk Classification

Rodrigo F. Berriel, André Teixeira Lopes, Alberto F. de Souza, and Thiago Oliveira-Santos

IEEE Geoscience and Remote Sensing Letters: 10.1109/LGRS.2017.2719863

Thumbnail

High-resolution satellite imagery have been increasingly used on remote sensing classification problems. One of the main factors is the availability of this kind of data. Even though, very little effort has been placed on the zebra crossing classification problem. In this letter, crowdsourcing systems are exploited in order to enable the automatic acquisition and annotation of a large-scale satellite imagery database for crosswalks related tasks. Then, this dataset is used to train deep-learning-based models in order to accurately classify satellite images that contains or not zebra crossings. A novel dataset with more than 240,000 images from 3 continents, 9 countries and more than 20 cities were used in the experiments. Experimental results showed that freely available crowdsourcing data can be used to accurately (96.78%) train robust models to perform crosswalk classification on a global scale.


Dataset Automatic Acquisition and Annotation

To download the dataset, you should run the command below for each region of interest. Be careful with your API quota.

python crosswalk-downloader.py --region={REGION_NAME} --negative --positive --key={API_KEY}
# e.g. to download the crosswalks only of the regions in Asia
python crosswalk-downloader.py --region=asia --positive --key={API_KEY}

Test with your data

Pre-trained models are available here.

This Python notebook may help you with the inference process.

Dataset

The dataset used in this work is defined by a group of city-based regions. As stated in the paper, "even though each part of the dataset is named after a city, some selected regions were large enough to partially include neighboring towns". The regions can be seen in the file regions.json and a summary of the dataset can be seen below.

Dataset NameCrosswalksNo-Crosswalks
Europe-Belgium-Brussels7,91618,739
Europe-France-Lion5,16811,960
Europe-France-Paris5,82813,353
Europe-France-Marseille2,6156,668
Europe-France-Toulouse4,79411,046
Europe-Italy-Turim5,08111,324
Europe-Italy-Milan4,53610,147
Europe-Portugal-Porto1,6303,786
Europe-Portugal-Lisbon1,7314,460
Europe-Spain-Saragoca1,4133,310
Europe-Switzerland-Zurich1,8424,668
Europe                42,55499,461 
America-USA-Seattle1,2762,929
America-USA-WashingtonDC2,8386,503
America-USA-Philadelphia2,3566,145
America-USA-NewYork2,1914,919
America-Canada-Mississauga3,2597,463
America-Canada-Toronto3,9028,852
America15,82236,811
Asia-Japan-Tokyo6,88815,529
Asia-Japan-Toyokawa1,8374,140
Asia-Japan-Sapporo6,94615,780
Asia15,67135,449
Total74,047171,721

Positive Samples

PositiveSamples

Negative Samples

NegativeSamples

BibTeX

@article{berriel2017grsl,
    Author  = {Rodrigo F. Berriel and Andre T. Lopes and Alberto F. de Souza and Thiago Oliveira-Santos},
    Title   = {{Deep Learning Based Large-Scale Automatic Satellite Crosswalk Classification}},
    Journal = {IEEE Geoscience and Remote Sensing Letters},
    Year    = {2017},
    DOI     = {10.1109/LGRS.2017.2719863},
    ISSN    = {1545-598X},
}