ooi ci eoi lca review december 13, 2010 ocean observatories initiative external observatory...

OOI CI EOI LCA REVIEWDecember 13, 2010

Ocean Observatories Initiative

External Observatory Integration

Christopher MuellerLife Cycle Architecture ReviewDecember 13, 2010


Agenda

Life Cycle Architecture Review

• Subsystem Purpose

• Release 1 Product Description Use Case Overview

• Architectural Overview

• Status of Progress

• Use Cases Address, Use Cases Demonstrated

• Technology Challenges and Achievements

• Plan for Construction

• Risk Assessment

• Demonstration

2


External Observatory Integration Subsystem: Purpose

1.Integrates external observatories (IOOS in R1)

with the OOI Integrated Observatory

2.Facilitates inclusion of external data

3.Delivers data in community specific forms

4.Allows immediate full scale testing of the OOI-CI

System

5.Introduces OOI to a community of early adopters

3


EOI R1 Product Description Use Case Overview

Responsible For

Supports

Uses

4


Dataset Agents Supporting UC.R1.04

•EOI Supports this use case by providing Dataset

Agents that facilitate acquisition of data from

external repositories (such as NDBC and AOML)

•The Dataset Agents are responsible for mapping

between the data format provided by the

external repository and the OOI Canonical Data

Model

5


UC.R1.21: Derive Data Product Externally

•Normalization of disparate data sources

•Transformation to the desired output format

•Automated delivery of data to the end user (R1

modeling groups)

•Automated launching of client-side processing

scripts

•Resulting data may be sent back to OOI-CI

6


Architectural Overview

7


Architectural Overview – Client View2010 OOI-CI – IOOS Collaboration

NDBCWx

NDBCHFR

CO-OPSWL

USGS AOML

IOOS Data Sources Non-IOOS Sources

SOS TDS SOS HTTP

WaterML

OOI-CIService

TranslationFormat

ConversionNotification

Feeds/Subscriptions

Espresso ROMS

other models

IOOSCatalo

g IOOSRAs

SOS

External Observatory Integration (EOI)

OOI-CIService

TranslationFormat

ConversionNotification

Feeds/Subscriptions

External Observatory Integration (EOI)External Observatory Integration (EOI)

IOOSCatalo

g

8


MARACOOS Integration Design

9


User Interfaces

Core Infrastructure Services

Architectural Overview – OOI-CI View

CommonOperating

Infrastructure

Data Distribution andPreservation Infrastructure

CommonExecution

Infrastructure

DataManagement

Application LevelServices

Externalization andIntegration

InstrumentAgents

External Observatory Integration

Sensing & Acquisition

IOOS Modeling Groups

10


2650-00007 OV2 CI


ApplicationServices

InfrastructureServices

IOOS Modeling Groups

11



Subscribe(Dispatcher)

Publish(Dataset Agents)

http://oceanobservatories.org/spaces/display/syseng/CIAD+OV+06+External+Observatory+Integration

12


Architectural Overview – Dataset Agent

http://oceanobservatories.org/spaces/display/syseng/CIAD+EOI+Dataset+Agents

13

(1)(2)

(4)

(5)

(3)

(7)

(6)


Architectural Overview – Dataset Agent

http://oceanobservatories.org/spaces/display/syseng/CIAD+EOI+Dataset+Agents

14


Architectural Overview – Dispatcher

http://oceanobservatories.org/spaces/display/syseng/CIAD+EOI+Dispatcher

15


Status of Progress

• Implemented end-to-end exchange of messages on

both the Publication (Dataset Agent) and

Subscription (Dispatcher) sides of the system.

• Completed Dataset Agent implementations for all

data required by Rutgers modeling group

• Completed Dispatcher implementation capable of

receiving notification and reacting by launching an

external workflow script

16


Status of Progress –Rutgers Data SourcesCurrently Implemented Capabilities

•Providers:

• PFEG, NAVY, USGS, RADS, NCEP, AOML, NDBC

•Acquisition Protocols:

• OPeNDAP, SOS, WaterML, urlread

•CDM Types:

• Grid, Station, Station Profile, Trajectory

•Data Variables:

• Sea Surface Height, Currents, Winds, Salinity, Temperature, River

Discharge, …

•Acquisition Forms:

• NetCDF, ASCII

17


EOI Technology List

Matlab

NetCDF Java

18


Plan for Construction

Current Schedule:

•Three 6 week Construction Iterations – 12/20/2010 5/2/2011

•IOC Review – week of 5/3/2011

Considering rescheduling to bring EOI into alignment with core

subsystems:

•Two 8 week Construction Iterations – 12/20/2011 4/1/2011

• EOI will be aligned for the 2nd iteration

•R1 Deployment concurrent with the rest of the systemhttp://www.oceanobservatories.org/spaces/display/CIDev/EOI+Release+1+Construction+Plan

19


Plan for Construction – R1C1

Theme: Analysis of 2nd & 3rd Modeling Group & Refinement

of Elaboration Implementations

•Analysis of modeling group data needs• University of Hawaii• Texas A&M

•Integration of mature ION capabilities• Refactoring of Dataset Agent & Dispatcher

implementations•Thorough documentation

http://www.oceanobservatories.org/spaces/display/CIDev/EOI+Release+1+Construction+Plan

20


Plan for Construction – R1C2

Theme: Development of Additional Dataset Agents &

Adoption of OOI-CI as the Data Provider for R1 Modeling

Groups

•Continued integration of mature ION capabilities•Development of Additional Dataset Agents• For University of Hawaii data• For Texas A&M data

•Incorporation of OOI-CI as the data provider in the acquisition scripts of the 3 R1 Modeling Groups

http://www.oceanobservatories.org/spaces/display/CIDev/EOI+Release+1+Construction+Plan

21


Risk Assessment – EOI

Use Case

ID Name Delivery Risk Maturity Level Target Use

UC.R1.21 Derive Data Product Externally (Merge Data) Low Required User

22


EOI Technologies at Risk for Release 1

None at this time!

23


End-to-end Demonstration

https://docs.google.com/drawings/edit?id=1HDMg7rLhic5dIeZ_iWpez8EokfTh0bnFrpNZHXteNYA&hl=en&authkey=CLG0xoMI

Translation from raw form to OOI-CI Canonical Data

Model

Transmission of data via ION

Messages

24

For Demo Only!!


Thanks !

Questions ?

25

ooi ci eoi lca review december 13, 2010 ocean observatories initiative external observatory...

Documents