Australian Geoscience Data Cube

The Australian Geoscience Data Cube ( AGDC ) is an approach to storing, processing and analyzing large collections of earth observation data. The technology is designed to meet the challenges of national interest by being agile and flexible with vast amounts of layered grid data.

The AGDC reduces the processing time of traditional image analysis by calibrating, pre-computing known extents, pixel alignment and storing metadata in a cell lattice structure. The temporal-pixel aligned data can often be analyzed. This Allows the AGDC to be flexible in Tackling future challenges and Improve analysis times are every-Increasing data repositories of earth observation.

The AGDC has also been used internationally [1] to allow countries to maintain ecologically sustainable programs and reduce the difficulty of utilizing remote sensing data. [2]

Background

The AGDC was originally conceived by Geoscience Australia as a joint venture between Geoscience Australia , the Commonwealth Scientific and Industrial Research Organization (CSIRO) and National Computational Infrastructure National Facility (Australia) (NCI). The National Collaborative Research Infrastructure Strategy (NCRIS). [3]

Analysis Ready Data, Ingestion and Indexing

The data processed in the cube is made analysis ready [4] before being ingested and indexed into the AGDC. (Geometrical alignment) and radiometry (solar illumination, incidence angle, topography, atmospheric interference). The ingestion process manages the translation of datasets into the storage units while maintaining a database index. The data storage dans le index and can be accessed via API calls Often Within compiled code Such As Python (programming language) .

example

S2a_l1c = dc.load (product = ‘s2a_level1c_granule’, x = (147.36, 147.41), y = (- 35.1, -35.15), measurements = [’04’, ’03’, ’02’], output_crs = ‘EPSG : 4326 ‘, resolution = (- 0.00025.0.00025))

Datasets currently stored

  • Geoscience Australia Landsat Surface Reflectance (1987 to present)
  • Landsat Pixel Quality
  • Landsat Fractional Cover
  • Landsat NDVI

Datasets that have been piloted

  • USGS Landsat Surface Reflectance
  • SRTM DEM
  • Himawari 8
  • MODIS
  • Sentinel-2 L1C / S2A
  • Australian Gridded Climate Data

Open source

The AGDC code is based in GitHub as an open repository. [5] The core code for the Open Data Cube in early 2017 as part of an international collaboration. Whilst the basic code is the Open Data Cube , cubes exist as individual Their Own right Such As the AGDC on the National Computational Infrastructure National Facility (Australia) (NCI) using the High-Performance Computing Cluster HPCC . The basic code can be installed on personal computers or public computers (using git) and has many unit tests.

Documentation for the code base on Read the Docs. [6]

Challenges of the AGDC

The AGDC is designed to meet nationally significant challenges such as the following.

  • Sustainability
  • Environment
  • Water resource management
  • Disaster assist
  • Policy development
  • Community planning
  • Forest preservation
  • Carbon measurement

International Awards

The AGDC won [7] the 2016 Content Platform of the Year award from Geospatial World Forum. [8]

References

  1. Jump up^ http://ceos.org/
  2. Jump up^ https://software.nasa.gov/featuredsoftware/ceos2
  3. Jump up^ https://www.education.gov.au/national-collaborative-research-infrastructure-strategy-ncris
  4. Jump up^ http://www.datacube.org.au/wiki/Category:Analysis_Ready_Data
  5. Jump up^ https://github.com/opendatacube/datacube-core
  6. Jump up^ http://datacube-core.readthedocs.io/en/latest/
  7. Jump up^ http://www.ga.gov.au/news-events/news/latest-news/australian-geoscience-data-cube-innovation-recognised-on-world-stage
  8. Jump up^ http://geospatialworldforum.org/

Leave a Comment

Your email address will not be published. Required fields are marked *