sci-bus is supported by the fp7 capacities programme under contract ri-283481 er-flow is supported...

27
SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI- 312579 Workflows for HELIOPhysics Dr. Gabriele Pierantoni Dr. David Perez Suarez

Upload: cornelia-rich

Post on 28-Dec-2015

219 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Workflows for HELIOPhysics

Dr. Gabriele PierantoniDr. David Perez Suarez

Page 2: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Workflows for Heliophysics

• What advantages ? – Formal representation of a process– Allows to handle very complex

programs– Allows sharing of knowledge through

repositories.

Page 3: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Workflows for Heliophysics

• What are they for ? – Propagation Models– Search metadata– Extract metadata

Page 4: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Workflows for Heliophysics

• Where do they come from ? – Propagation Models

• WS-PGRADE (TCD-SCSS & Others)– Search metadata

• TAVERNA (HELIO)– Extract metadata

• WS-PGRADE (TCD-PHY & TCD-SCSS)

Page 5: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Propagation Models

• A propagation model is used to help determine which observations, where and when may be of interest in order to satisfy the user's search criteria.

Page 6: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Advanced Propagation Model

Origin

t

Target

t

Perio

d of

inte

rest E

E

ETA Range

P = Pmin

P = Pmax

EP = POK

Page 7: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Propagation Models

Page 8: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Download Event List from catalogues

Step Workflow Meaning

SourceEventFinder Given a list of catalogues an extraction criteria returns a VOtable with the list of all relevant events

ParameterExtractor Givent a list of events, it extracts the parameter values or ranges that are relevant for the execution of the propagation model.

TimeExtractor Given a list of events, it extracts the time values or ranges that are relevant for the execution of the propagation model.

Propagator It invokes the SHEBA propagation model with the parameters and times produced by ParameterExtractor and TimeExtractor

Ranker It ranks the results of the propagation model.

Page 9: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Extract Parameters

Step Workflow Meaning

SourceEventFinder Given a list of catalogues an extraction criteria returns a VOtable with the list of all relevant events

ParameterExtractor Givent a list of events, it extracts the parameter values or ranges that are relevant for the execution of the propagation model.

TimeExtractor Given a list of events, it extracts the time values or ranges that are relevant for the execution of the propagation model.

Propagator It invokes the SHEBA propagation model with the parameters and times produced by ParameterExtractor and TimeExtractor

Ranker It ranks the results of the propagation model.

Page 10: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Extract Time Ranges

Step Workflow Meaning

SourceEventFinder Given a list of catalogues an extraction criteria returns a VOtable with the list of all relevant events

ParameterExtractor Givent a list of events, it extracts the parameter values or ranges that are relevant for the execution of the propagation model.

TimeExtractor Given a list of events, it extracts the time values or ranges that are relevant for the execution of the propagation model.

Propagator It invokes the SHEBA propagation model with the parameters and times produced by ParameterExtractor and TimeExtractor

Ranker It ranks the results of the propagation model.

Page 11: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Execute the model

Step Workflow Meaning

SourceEventFinder Given a list of catalogues an extraction criteria returns a VOtable with the list of all relevant events

ParameterExtractor Givent a list of events, it extracts the parameter values or ranges that are relevant for the execution of the propagation model.

TimeExtractor Given a list of events, it extracts the time values or ranges that are relevant for the execution of the propagation model.

Propagator It invokes the SHEBA propagation model with the parameters and times produced by ParameterExtractor and TimeExtractor

Ranker It ranks the results of the propagation model.

Page 12: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Rank the results

Page 13: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

LO-FAR

• LOFAR is a real-time multiple sensor array.

• Very different sensors can be placed along a common infrastructure and make use of it the same time.

• Analysis of raw frequency data requires significant storage and computation resources.

• We are developing a standardizes processing and storage workflow to the community to be easily configured

Page 14: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Processing Nodes

• Data Staging• PreProcessing• Processing• PostProcessing• DataPublications

Page 15: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Java Standard Node

PORTLET / PORTAL

WORFLOWS

NODES

PROGRAMS

Page 16: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Java Standard Node

Standard Java Node

Input Data

Input Status

Input Parameter

Output Data

Output Status

Page 17: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Java Standard Node

Input Data

Load FilesInput Status

Input Parameter

Check Status

Failed

Processing

Completed

Output Data

Output Status

Page 18: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Java Standard Node

AbstractGenericNode

AbstractStringNode

ConcreteStringNode

Defines the sequence of actions

Defines how to read and write files

Defines the processing

Page 19: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Metadata Extraction(LO-FAR)

Page 20: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Metadata Extraction(LO-FAR)

Page 21: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

ER-FLOW

WS-Pgrade WorkflowsDevelopment of HELIO portal

Access to DCIs

Web ServicesTAVERNA workflows

Page 22: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Events Count

Page 23: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Events Count

Counts the number of events for a period.

Page 24: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Fastest CMEs Propagation

This workflow is used to investigate one of the most relevant events in HELIOphysics; Coronal Mass Ejections. The propagation of these events is studied throughout the Solar System by the means of the execution of the SHEBA propagation model on the HELIO Processing Service.

Page 25: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Fastest CMEs Propagation

Find parameters for model

Execute the model

Validate the results

Page 26: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

High Energy Flares

Given a time range, this workflow looks for flares within the specified energy range and provides the observations for such time range for the list of instruments asked. It also provides the table of flares with its properties.

Page 27: SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481 ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

High Energy Flares