www.eu-eela.eu e-science grid facility for europe and latin america wam final report yassine...
TRANSCRIPT
www.eu-eela.eu
E-science grid facility forEurope and Latin America
WAMFinal Report
Yassine LASSOUED & Ali Al Othman
Coastal and Marine Resources Centre
University College Cork
Ireland
Itacuruçá , First EELA-2 Grid School, 13.11.2008 2www.eu-eela.eu
Application: WAM
• WAM = Global ocean Wave prediction Model• Field:
– Earth Sciences (Marine)
• Objective:– forecast wave conditions around Ireland on a fine
resolution, using high resolution winds obtained as boundary conditions from Met Eireann, for the periods 2020-2030 and 2050-2060
• Resolution:– 5 km (Met Eireann: 25 km)
• Code: Fortran
Itacuruçá , First EELA-2 Grid School, 13.11.2008 3www.eu-eela.eu
Difficulties
• Input Data:– Bathymetry
160 KB
– High Resolution Wind Fields 60 MB per file 1 file per month 100 years
Total size: 72 GB
– Wave Boundary Conditions 50 MB per file 2 files per day 100 years
Total size: 3.6 TB
Itacuruçá , First EELA-2 Grid School, 13.11.2008 4www.eu-eela.eu
Difficulties
• Code compiled on 64b machine does not work
Itacuruçá , First EELA-2 Grid School, 13.11.2008 5www.eu-eela.eu
Done
• Transfer code and sample input data to a SE• Script to:
– download code and data from SE,– Rebuild directory structure as required,– Execute model on a working node,– Store outputs on SE.
• AMGA catalogue for processed data• Script to check whether data have been processed• Command line user interface:
– Script to generate JDL files and submit jobs– Script to check jobs status– Script to download outputs
Itacuruçá , First EELA-2 Grid School, 13.11.2008 6www.eu-eela.eu
Difficulties
Storage Element
TAR.GZ TAR.GZ
Code
TAR.GZ
TAR.GZ
TAR.GZ
TAR.GZ
Input Data Output Data
AMGACatalogue
YearMonth Period Done LFN
--- --- --- ---
--- --- --- ---
Working Node
wam.sh execute_wam.sh
loading
Code
TAR.GZ TAR.GZ
TAR.GZloading
wam.jdl
wam.sh execute_wam.sh
wam-status.sh wam-output.sh wam-clean.sh
User Interface
wam_template.jdlwam-exe.sh
generates
Uservoms-proxy-init
Thanks Daniel and Michael
Itacuruçá , First EELA-2 Grid School, 13.11.2008 7www.eu-eela.eu
Synergy with Other Teams
• HMMER Team– Similarities in work flows and user interfaces– Build on user interface developed by Daniel and Michael
• Satellite Images Team– Potential for using same approach for seabed classification
using large multi/single beam data
Itacuruçá , First EELA-2 Grid School, 13.11.2008 8www.eu-eela.eu
Next Steps
• Benchmarking [3-4 Months]• Production [6-8 Months]
– Transfer 3.6 TB of data to the grid– Deploy WAM on the EELA Grid
• Develop a user interface using GENIUS [9-12 Months]
Support needed
www.eu-eela.eu
E-science grid facility forEurope and Latin America
Thank You EELA-2, tutors, students, et. al…
Yassine LASSOUED
CMRC, UCC (Ireland)
+353 21 470 31 03
Skype: yassine.lassoued
Jeremy GAULT
CMRC, UCC (Ireland)
+353 21 470 31 00