Awesome

🌏 Note: This branch contains the Australia-specific implementation of DEA Coastlines. For a more flexible implementation adapted to globally available USGS Collection 2 Level 2 Landsat data, we recommend adapting the Digital Earth Africa Coastlines implementation instead.

Digital Earth Australia Coastlines

License: The code in this repository is licensed under the Apache License, Version 2.0. Digital Earth Australia data is licensed under the Creative Commons by Attribution 4.0 license.

Contact: For assistance with any of the Python code or Jupyter Notebooks in this repository, please post a Github issue. For questions or more information about this workflow, email Robbi.BishopTaylor@ga.gov.au.

To cite:

Bishop-Taylor, R., Nanson, R., Sagar, S., Lymburner, L. (2021). Mapping Australia's dynamic coastline at mean sea level using three decades of Landsat imagery. Remote Sensing of Environment, 267, 112734. Available: https://doi.org/10.1016/j.rse.2021.112734

Nanson, R., Bishop-Taylor, R., Sagar, S., Lymburner, L., (2022). Geomorphic insights into Australia's coastal change using a national dataset derived from the multi-decadal Landsat archive. Estuarine, Coastal and Shelf Science, 265, p.107712. Available: https://doi.org/10.1016/j.ecss.2021.107712

Bishop-Taylor, R., Sagar, S., Lymburner, L., Alam, I., Sixsmith, J. (2019). Sub-pixel waterline extraction: characterising accuracy and sensitivity to indices and spectra. Remote Sensing, 11 (24):2984. Available: https://doi.org/10.3390/rs11242984

Digital Earth Australia Coastlines is a continental dataset that includes annual shorelines and rates of coastal change along the entire Australian coastline from 1988 to the present.

The product combines satellite data from Geoscience Australia's Digital Earth Australia program with tidal modelling to map the typical location of the coastline at mean sea level for each year. The product enables trends of coastal erosion and growth to be examined annually at both a local and continental scale, and for patterns of coastal change to be mapped historically and updated regularly as data continues to be acquired. This allows current rates of coastal change to be compared with that observed in previous years or decades.

The ability to map shoreline positions for each year provides valuable insights into whether changes to our coastline are the result of particular events or actions, or a process of more gradual change over time. This information can enable scientists, managers and policy makers to assess impacts from the range of drivers impacting our coastlines and potentially assist planning and forecasting for future scenarios.

Applications

Monitoring and mapping rates of coastal erosion along the Australian coastline
Prioritise and evaluate the impacts of local and regional coastal management based on historical coastline change
Modelling how coastlines respond to drivers of change, including extreme weather events, sea level rise or human development
Supporting geomorphological studies of how and why coastlines have changed across time

Digital Earth Australia Coastlines - Applications

Repository code

The code in this repository is built on the Digital Earth Australia implementation of the Open Data Cube software for accessing, managing, and analyzing large quantities of Earth observation (EO) data. The code currently runs on the Digital Earth Australia Sandbox infrastructure.

Getting started

Clone the dea-coastlines repository and checkout the develop branch:

git clone https://github.com/GeoscienceAustralia/dea-coastlines.git
git checkout --track origin/develop

FES2014 tidal model

DEA Coastlines uses the FES2014 tidal model to account for the influence of tide on shoreline positions. To install this tidal model, follow the Setting up tidal models for DEA Coastlines guide on the Wiki.

Python modules

Code in this repository is included in the coastlines Python package which contains three main modules. These are intended to be run in the following order:

coastlines.raster: This module conducts raster generation for DEA Coastlines. This analysis is processed on individual study area tiles to minimise peak memory usage.
- Load stack of all available Landsat 5, 7 and 8 satellite imagery for a location using ODC Virtual Products
- Convert each satellite image into a remote sensing water index (e.g. MNDWI)
- For each satellite image, model ocean tides into a tidal modelling grid based on exact time of image acquisition
- Interpolate tide heights into spatial extent of image stack
- Mask out high and low tide pixels by removing all observations acquired outside of 50 percent of the observed tidal range centered over mean sea level
- Combine tidally-masked data into annual median composites representing the most representative position of the shoreline at approximately mean sea level each year
coastlines.vector: This module conducts vector subpixel coastline extraction and rates of change statistics calculation. This analysis is processed on individual study area tiles to minimise peak memory usage.
- Apply morphological extraction algorithms to mask annual median composite rasters to a valid coastal region
- Extract shoreline vectors using subpixel waterline extraction (Bishop-Taylor et al. 2019b)
- Compute rates of coastal change at every 30 m along the coastline using linear regression
coastlines.continental: This module combines tiled layers into seamless continental-scale vector files:
- Combines multiple output shoreline and rates of change statistics point vectors into single continental datasets
- Aggregates this data to produce moving window coastal change hotspot datasets that summarise coastal change at regional and continental scale.

Jupyter notebooks

An interactive walk-through of each step of the tiled raster and vector DEA Coastlines workflow and the continental layer generation is provided in the following Jupyter Notebooks. These notebooks can be run on the DEA Sandbox to assist in prototyping or troubleshooting:

Running a DEA Coastlines analysis using the command-line interface (CLI)

These three modules have a command-line interface that can be used to automate each stage of the analysis. An example of using these tools is provided in the following Jupyter Notebook:

DEA Coastlines generation using command line tools

For help using these command line tools, run:

python -m coastlines.raster --help
python -m coastlines.vector --help
python -m coastlines.continental --help

Analysis outputs

Files generated by DEA Coastlines are exported to the data directory.

Temporary raster and vector outputs produced by coastlines.raster and coastlines.vector for each study area grid cell are exported to:

data/interim/raster/{unique_analysis_name}/{unique_analysis_name}_{study_area_name}
data/interim/vector/{unique_analysis_name}/{unique_analysis_name}_{study_area_name}

Once all study area grid cells have been processed, these are combined into a continental-scale output GeoPackage vector file and zipped ESRI Shapefiles using coastlines.continental. These final outputs are exported to:

data/processed/{unique_analysis_name}/coastlines_{continental_version}.gpkg
data/processed/{unique_analysis_name}/coastlines_{continental_version}.shp.zip

Data access

Data download

To download DEA Coastlines data for the entire Australian coastline, visit the "Access" tab of the Geoscience Australia DEA Coastlines product description and follow the instructions under "Access notes". Data is available in two formats:

GeoPackage (recommended): suitable for QGIS; includes built-in symbology for easier interpretation
ESRI Shapefiles: suitable for ArcMap and QGIS

Interactive map

To explore DEA Coastlines on an interactive map, visit the Digital Earth Australia Maps platform.

Zooming to annual rates of change and plotting chart in DEA Maps

Loading DEA Coastlines data from the Web Feature Service (WFS) using Python

DEA Coastlines data can be loaded directly in a Python script or Jupyter Notebook using the DEA Coastlines Web Feature Service (WFS) and geopandas:

import geopandas as gpd

# Specify bounding box
ymax, xmin = -33.65, 115.28
ymin, xmax = -33.66, 115.30

# Set up WFS requests for annual shorelines & rates of change points
deacl_annualshorelines_wfs = f'https://geoserver.dea.ga.gov.au/geoserver/wfs?' \
                       f'service=WFS&version=1.1.0&request=GetFeature' \
                       f'&typeName=dea:shorelines_annual&maxFeatures=1000' \
                       f'&bbox={ymin},{xmin},{ymax},{xmax},' \
                       f'urn:ogc:def:crs:EPSG:4326'
deacl_ratesofchange_wfs = f'https://geoserver.dea.ga.gov.au/geoserver/wfs?' \
                       f'service=WFS&version=1.1.0&request=GetFeature' \
                       f'&typeName=dea:rates_of_change&maxFeatures=1000' \
                       f'&bbox={ymin},{xmin},{ymax},{xmax},' \
                       f'urn:ogc:def:crs:EPSG:4326'

# Load DEA Coastlines data from WFS using geopandas
deacl_annualshorelines_gdf = gpd.read_file(deacl_annualshorelines_wfs)
deacl_ratesofchange_gdf = gpd.read_file(deacl_ratesofchange_wfs)

# Ensure CRSs are set correctly
deacl_annualshorelines_gdf.crs = 'EPSG:3577'
deacl_ratesofchange_gdf.crs = 'EPSG:3577'

# Optional: Keep only rates of change points with "good" certainty 
# (i.e. no poor quality flags)
deacl_ratesofchange_gdf = deacl_ratesofchange_gdf.query("certainty == 'good'")

Loading DEA Coastlines data from the Web Feature Service (WFS) using R

DEA Coastlines data can be loaded directly into R using the DEA Coastlines Web Feature Service (WFS) and sf:

library(magrittr)
library(glue)
library(sf)

# Specify bounding box
xmin = 115.28
xmax = 115.30
ymin = -33.66
ymax = -33.65

# Read in DEA Coastlines annual shoreline data, using `glue` to insert our bounding 
# box into the string, and `sf` to  load the spatial data from the Web Feature Service 
# and set the Coordinate Reference System to Australian Albers (EPSG:3577)
deacl_annualshorelines = "https://geoserver.dea.ga.gov.au/geoserver/wfs?service=WFS&version=1.1.0&request=GetFeature&typeName=dea:shorelines_annual&maxFeatures=1000&bbox={ymin},{xmin},{ymax},{xmax},urn:ogc:def:crs:EPSG:4326" %>% 
  glue::glue() %>%
  sf::read_sf() %>% 
  sf::st_set_crs(3577)

# Read in DEA Coastlines rates of change points
deacl_ratesofchange = "https://geoserver.dea.ga.gov.au/geoserver/wfs?service=WFS&version=1.1.0&request=GetFeature&typeName=dea:rates_of_change&maxFeatures=1000&bbox={ymin},{xmin},{ymax},{xmax},urn:ogc:def:crs:EPSG:4326" %>% 
  glue::glue() %>%
  sf::read_sf() %>% 
  sf::st_set_crs(3577)

Jupyter Notebook

An Introduction to DEA Coastlines Jupyter notebook providing additional useful tools for loading and analysing DEA Coastlines data can be found on the DEA Notebooks repository. This notebook is available on the interactive DEA Sandbox learning and analysis environment for easy access via a web browser.

Credits

Tidal modelling is provided by the FES2014 global tidal model, implemented using the pyTMD Python package. FES2014 was produced by NOVELTIS, LEGOS, CLS Space Oceanography Division and CNES. It is distributed by AVISO, with support from CNES (http://www.aviso.altimetry.fr/).

References