australian oceans distributed active archive center peter turner, csiro/cawcr imos is an initiative...

10
Australian Oceans Distributed Active Archive Center Peter Turner, CSIRO/CAWCR IMOS is an initiative of the Australian Government being conducted as part of the National Collaborative Research Infrastructure Strategy

Upload: osborne-perkins

Post on 12-Jan-2016

217 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Australian Oceans Distributed Active Archive Center Peter Turner, CSIRO/CAWCR IMOS is an initiative of the Australian Government being conducted as part

Australian Oceans Distributed Active Archive Center

Peter Turner, CSIRO/CAWCR

IMOS is an initiative of the Australian Government being conducted as part of the National Collaborative Research Infrastructure Strategy

Page 2: Australian Oceans Distributed Active Archive Center Peter Turner, CSIRO/CAWCR IMOS is an initiative of the Australian Government being conducted as part

Credits Turner P.J1, E.A. King1, P.P.Y. Mak2,3, G.P. Smith1, K.D. Suber1, M.J. Paget1, C. J. Jackett1, P. Fearns4, A.L. Rohl5, F. Goessmann3,5, L. Majewski6, S. Reddy7, C. Steinberg8.

1. CSIRO Marine & Atmospheric Research, GPO Box 1538, Hobart, Tasmania, 7001;2. Tasmanian Partnership for Advanced Computing (http://www.tpac.org.au);3. Australian Research Collaboration Service (http://www.arcs.org.au);4. Imaging & Applied Physics, Curtin University of Technology, GPO Box U1987, Perth, WA, 6845;5. iVEC, 'The hub of advanced computing in Western Australia', 26 Dick Perry Avenue, Technology Park, Kensington WA 6151; 6. Bureau of Meteorology, GPO Box 1289, Melbourne, Victoria, 3001;7. Geoscience Australia, GPO Box 378, Canberra ACT 2601;8. Australian Institute of Marine Science, PMB 3, Townsville, Queensland, 4810

Page 3: Australian Oceans Distributed Active Archive Center Peter Turner, CSIRO/CAWCR IMOS is an initiative of the Australian Government being conducted as part

aodaac1-mel.vic.csiro.auaodaac2-cbr.act.csiro.auand iVec Perth

imos.org.au

Page 4: Australian Oceans Distributed Active Archive Center Peter Turner, CSIRO/CAWCR IMOS is an initiative of the Australian Government being conducted as part

Integrated Satellite Data System

Page 5: Australian Oceans Distributed Active Archive Center Peter Turner, CSIRO/CAWCR IMOS is an initiative of the Australian Government being conducted as part

Objective• To deliver gridded satellite data products

to the Australian Marine Research Community.

Requirements

• To deliver data in near real time.

• To automatically catalogue data sets.

• To automatically manage meta-data.

• To deliver time series data.

• To provide data in a number of formats

Page 6: Australian Oceans Distributed Active Archive Center Peter Turner, CSIRO/CAWCR IMOS is an initiative of the Australian Government being conducted as part

Australian Oceans DAAC Architecture

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Page 7: Australian Oceans Distributed Active Archive Center Peter Turner, CSIRO/CAWCR IMOS is an initiative of the Australian Government being conducted as part

Client / User Applications

Metadata Harvester

Spatial Database

Web Query Service

OPeNDAP Servers

OPeNDAP Interface Web Service Interface

Client / User Applications

Aggregator

Control scripts

Graphical User Interface

Page 8: Australian Oceans Distributed Active Archive Center Peter Turner, CSIRO/CAWCR IMOS is an initiative of the Australian Government being conducted as part

Australian Oceans DAAC GUI (beta)

• incremental development

• AJAX technology

Enhancements

Add more datasets with improved selection menu

Add a description for each dataset

Add a status indicator

Improve error indicators

Allow multiple requests

Add simple visualisation

www.marine.csiro.au/remotesensing/imos/aggregator.html

Page 9: Australian Oceans Distributed Active Archive Center Peter Turner, CSIRO/CAWCR IMOS is an initiative of the Australian Government being conducted as part

Conclusions

• We have build a system which can deliver satellite derived marine data products in near real time

• The system is layered and can be accessed a number of ways

• The system automatically harvests metadata information

• The system has been built by reutilising existing technologies with some “glue” and the development of an aggregator and GUI

• The system supports standards

• IT SEEMS TO WORK AS EXPECTED!

Page 10: Australian Oceans Distributed Active Archive Center Peter Turner, CSIRO/CAWCR IMOS is an initiative of the Australian Government being conducted as part

Peter Turner, CSIRO Marine and Atmospheric Research Hobart