Istituto Nazionale di AstrofisicaInformation Systems Unit INAF-SI

WP 5 - Activity

G.Taffoni, F.Pasian

VO DCA Board Meeting – Strasbourg, October 2006

Activity plan

A. Knowledge acquisition;

B. Coordination;

C. Suggestions and guidelines;

D. Dissemination

VO DCA Board Meeting – Strasbourg, October 2006

A. Knowledge acquisition

• Survey of European/national/campus GRID initiatives– Middleware tools analysis;– Production status

• Interactions with EGEE

• Relations with OGF (aka GGF) standards.

VO DCA Board Meeting – Strasbourg, October 2006

“Wise” analysis

• Grid => evolving standards

• Grid => de facto standards

• Not always a production environment follows the standards!

• We shall be careful.

VO DCA Board Meeting – Strasbourg, October 2006

Middleware tools

• the “Four Pillars” of Grid:– Auth&auth– Information system– Data management– Job management

VO DCA Board Meeting – Strasbourg, October 2006

Comparison of tools

• Authentication and Authorization;

• Grid data management: data access for/to DCs;

• Grid job management and workflow tools: job access/exchange for DCs.

VO DCA Board Meeting – Strasbourg, October 2006

B. Coordination

• Coordination with other WPs in particular WP4:– Common startup in late November ?– Interactions every 3 months (?)

• Coordination with VO-Tech– Inputs to / feedback from DS3

• Coordination with IVOA! • Mid-term meeting? Common docs?

VO DCA Board Meeting – Strasbourg, October 2006

C. Suggestions and guidelines

• HOWTOs– best practice procedures to access Grid

facilities from DCs

• Suggestions (e.g.):– Similar/compatible auth&auth procedures ?– Data sharing between DCs and Grid ?– Interoperable workload management

systems ?

VO DCA Board Meeting – Strasbourg, October 2006

D. Dissemination

• Pervasive knowledge of Grid systems to DCs:– HOWTOs – Single knowledge repository: up-to-date

pointers to documents on Grid Initiatives– Workshop – Schools (in coordination with Grid projects)

VO DCA Board Meeting – Strasbourg, October 2006

Knowledge repository

• Information on Grid is also distributed ...

• Grid info for DCs:– Documentation;– API + CLI;– Examples

• Grid info for users

• Very complex and time-consuming

VO DCA Board Meeting – Strasbourg, October 2006

Dissemination to Grid

• Collections of VObs requirements;

• Make Grid initiatives aware of the VObs requirements;

• Interoperating is a two way interaction!!!

VO DCA Board Meeting – Strasbourg, October 2006

Preliminary working plan

Phase 0

Phase 1

Phase 2

Phase 3Kick-Off (with WP4? End-Nov?)Phase 0: surveyPhase 1: middleware analysisPhase 2: howtos and suggestions (WShop)Phase 3: dissemination

KO

Workshop

VO DCA Board Meeting – Strasbourg, October 2006

Across phases ...• Ideally, partners should have their own

pet application(s) to be integrated with their own campus/national Grid and/or EGEE

• This would allow experience-based gathering of information and preparation of howtos and suggestions

• WP4 (+ others!) could provide examples• EGEE should have maximum priority

VO DCA Board Meeting – Strasbourg, October 2006

Preliminary working plan

Phase 0

Phase 1

Phase 2

Phase 3

KO

Workshop

Integration of applications

Kick-Off (with WP4? End-Nov?)Phase 0: surveyPhase 1: middleware analysis (practical!)Phase 2: howtos and suggestions (WShop)Phase 3: dissemination

VO DCA Board Meeting – Strasbourg, October 2006

Add foregrounds

Add foregrounds

Generate CMB sky

Add foregrounds

Add foregrounds

Add foregrounds“Observe”

sky with LFI

referencesky maps

Time-OrderedData

cosmologicalparameters

frequency sky maps

cosmologicalparameters

Add foregrounds

Add foregrounds

Data reduction

Freq. merge Comp. sep.

component maps

C(l) evaluationC(l)

Parameter evaluation

instrument parameters

Knowledge and detail increase over time, therefore the whole computational chain must be iterated many times

Planck end-to-end simulations

VO DCA Board Meeting – Strasbourg, October 2006

• User defines simulation to be performed: parameters are sent to Grid nodes

• Ideal generated sky is generated and “observed” (TOD); some analysis and mapmaking is performed

• Maps (ideal, observed skies, map-making residuals) are sent back to user

de-striped “observed” sky

de-striping residuals map

params

maps maps

maps, TOD maps, TOD

params

Node 1

Node k

User Node

CE CE

WNWN ...

VO DCA Board Meeting – Strasbourg, October 2006

• Standard definition of an application-specific layer

(being used for other astro processing tasks, within the Grid.it and DRACO projects)

• Standard mechanism to run processing software and access data (input and results)

VO DCA Board Meeting – Strasbourg, October 2006

• Full mission simulated on Grid.it and EGEE, at full resolution for LFI (TOD ~ 1.3 TB) – plan to extend to HFI channels (74 total, 5.4 TB of TOD size)

• Given distribution of computing/storage resources, only limited amounts of storage can be exchanged across the network TOD are not downloaded from host nodes

• Some applications (e.g. full-sky convolutions, LSQ map-making) have a memory footprint requiring large centralised RAM not feasible within a standard Grid environment

0

100

200

300

400

500

600

700

1 2 4 8 16 22

Number of Worker Nodes

Tim

e [

m]

StartTime

SaveTime

ExecTime

Planck simulations approved by EGAAP in Nov ’04

VO DCA Board Meeting – Strasbourg, October 2006

VO DCA Board Meeting – Strasbourg, October 2006

VO DCA Board Meeting – Strasbourg, October 2006

VO DCA Board Meeting – Strasbourg, October 2006

VO DCA Board Meeting – Strasbourg, October 2006

VO DCA Board Meeting – Strasbourg, October 2006

VO DCA Board Meeting – Strasbourg, October 2006

VO DCA Board Meeting – Strasbourg, October 2006