Coordinated Energy and water-cycle Observations Peroject

A Well Organized Data Archive System

Data Integrating/Archiving

Center at University of Tokyo and JAXA of

Japan

Model Output Data Archiving Center at the World Data Center

for Climate, Max-Planck Institute for Meteorology of

Germany

In-Situ Data Archiving Center at NCAR (National

Center for Atmospheric Research) of USA

Unique Capabilities

CEOP Reference Site Map

Coordinated Energy and water-cycle Observations Project

Data Management Distributed- and Centralized- Data Integration Functions

In-situ

satellitesatellite

satellitesatellite

satellitesatellite

satellite

modelmodel

model

modelmodel

model

UCAR

MPI

UT/JAXA

In-situIn-situ

In-situ

In-situIn-situ

In-situ

Computing Power

Computing Power

DistributedIntegration

Services

GrADS/DODS

for Subsets

GrADS/DODS

for Subsets

GrADS/DDDS

for Subsets

Centralized Integration

Services

http://jaxa.ceos.org/wtf_ceop/

http://monsoon.t.u-tokyo.ac.jp/ceop-dc/ceop-dc_top.htm

http://www.eol.ucar.edu/ projects/ceop/dm/http://www.eol.ucar.edu/ projects/ceop/dm/

INTEGRATEDINTEGRATED

IN-SITUIN-SITU

SATELLITESATELLITE

MODELMODEL

• Based on ISO 19115 Metadata Standards

• Design for Finding and Integrating data

CEOP Metadata Design Meeting University of Tokyo, 1-2 November 2004

http//:earthobservations.org

Upload

Meta Data

Meta Data Meta Data

Data Integration and Analysis System (DA-09-02a)

Quality Control

Data Provider (Observer)

User

Meta Data Registration

•Search with Metadata•Data Download

•Document Generation from Meta Data•Data Visualization

・・

Observation Data

Meta Data

Data Upload＋ (part of )Meta Data

ObservationData

Meta Data

Data Quality Control Process

Meta Data

Post-QCObservation Data

InputMeta Data

Data Download Search IF Document Generator Visualization System

Data A

rchivin

gD

ata Integ

ration

Web-based Data Archiving & Integration System

Basic Information

Observation Point Inf.,Contact Person Inf.,……

Coordinated Energy and water-cycle Observations Project

Data Management Distributed- and Centralized- Data Integration Functions

In-situ

satellitesatellite

satellitesatellite

satellitesatellite

satellite

modelmodel

model

modelmodel

model

UCAR

MPI

UT/JAXA

In-situIn-situ

In-situ

In-situIn-situ

In-situ

Computing Power

Computing Power

DistributedIntegration

Services

GrADS/DODS

for Subsets

GrADS/DODS

for Subsets

GrADS/DDDS

for Subsets

Centralized Integration

Services

http://jaxa.ceos.org/wtf_ceop/

http://monsoon.t.u-tokyo.ac.jp/ceop-dc/ceop-dc_top.htm

17

WTF-CEOPDistributed Data Integration Services

Spatial and TemporalData Integration -

In-situ, MOLTS, Satellite, Model OutputData location

Standalone physical location

Distributed sites reference by links

Data types

Model output data

Insitu data

Satellite data

Data sources

Services

Metadata keyword search

Data value search

File format translation

Reprojection

Regridding

Data Interpolation

Integrated datasets

Multiple files from individual member

datasets

SpatialTemporalrectificatio

n

SpatialSubsettin

g

IntercomparisonOf

Integrated Datasets

18

JAXA Prototype: “Distributed Data Integration

Prototype System for CEOP ”

Live Access Server(LAS)

Ferret

Web Browser

NCAR Archive [In-situ]

(U.S.)

MPI Archive[MOLTS, Model Output]

(Germany)

CSDIC Archive [Satellite]

(Japan)

CEOP Data ArchivesWCS Server　 (satellite data)

NASA Bridge

WTF-CEOP: Phase 1 Prototype

Users can access;

(1)The data located in distributed archive centers

(2)The data which is temporally and geospatially coordinated

NASA Prototype:A bridge between DODS formatted data

requests and OGC WCS servers

OPeNDAP Interface

Custom Interface

19

(i) Satellite Data•250 km x 250 km subset scenes, regridded to Lat/Lon grid, centered over the 35 in-situ data sites•Band selection, period selection and download multiple scenes available

(ii) In situ Data•Four types of CEOP in-situ data from 35 Reference Sites

Surface (19 variables), Tower (9 variables), Soil (temperature, moisture), Flux (Sensible Heat, Latent Heat, CO2, Soil Heat Flux)

•Download of QC flags available

(iii) Model Output Data•NWP – Numerical Weather Prediction data•MOLTS – Model Output Location Time Series (time series at model grid point nearest center of in-situ data sites)•Gridded Model Output – 2D/3D time series.

JAXA Prototype: Phase 1 Status = Available Data =

20

•AccessAccess data from distributed archive sites•SelectSelect

data typelocation (Reference Site, Station name)variable nameheight or depthtime range (start time / stop time)

•“See the dataSee the data” plot view values on the screen

•Download NetCDFAsciiSpreadsheet format

•Registration (to satisfy CEOP data policy)

JAXA Prototype: Phase 1 Status = Main Functions =

21

JAXA Prototype: Phase 1 Status =Examples=

MOLTS data plot in time seriesModel Output data

plot in 2D view

Top Page

Satellite data plot in 2D view

In-situ data in NetCDF format with QC flags

QC flags Observed Data

Please visit and use our system at:http://jaxa.ceos.org/wtf_ceop/

Tutorial DVD

23rd CEOS Plenary I Phuket, Thailand I 3-5 November 2009

WGISS Way Forward – 2010 and beyond

• New CEOP for “Coordinated Energy and water cycle Observations Project” leveraging WTF-CEOP (successfully completed WGISS-26)– Supports Data Integration &Analysis System (DIAS) [DA-09-02a]– JAXA Lead, Prof Koike represents the user community– Leverage WTF-CEOP and identify additional data/datasets and services– Propose to develop Water Community of Practice Portal

• Contribution to Data Democracy to be enhanced with software packages and training, working closely with WEdu

WGISS Report at CEOS Plenary in Phuket, November 3 - 4, 2009