dorian gorgan, danut mihon, victor bacu technical university of cluj-napoca romania

37
www.see-grid-sci.eu SEE-GRID-SCI The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338 GreenView – Refinement of surface and vegetation parameters in SEE region based on satellite images Dorian Gorgan, Danut Mihon, Victor Bacu Technical University of Cluj-Napoca Romania Environmental VO, SEE-GRID-SCI 10 September 2009

Upload: matty

Post on 18-Mar-2016

51 views

Category:

Documents


0 download

DESCRIPTION

GreenView – Refinement of surface and vegetation parameters in SEE region based on satellite images. Environmental VO, SEE-GRID-SCI 10 September 2009. Dorian Gorgan, Danut Mihon, Victor Bacu Technical University of Cluj-Napoca Romania. GreenView Application. Primary contact - PowerPoint PPT Presentation

TRANSCRIPT

  • GreenView ApplicationPrimary contactDorian [email protected] University of Cluj-NapocaUTCN, third party SEE-GRID-SCI partner acronymRomaniaCurrent statusBetaExpected availability1st April 2010Licensing statusGPL 3

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • GreenView ApplicationGreenView - Refinement of surface and vegetation parameters in SEE region based on satellite images

    The aim of the GreenView pilot application is a refinement of surface and vegetation parameters in SEE region based on satellite images. In the frame of this project, construction, usage and comparison of diverse satellite datasets will be performed. High resolution satellite measurements can be used for numerous environmental studies (climate-related or air pollution modeling). Using the sophisticated environmental data the change of the vegetation distribution in the Carpathian Basin and its climate-related causes will be investigated. It may also be used to extend the urban climate related research, in order to study the impact of urban environment on the vegetation.

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Partners and beneficiariesGreenView application development partners:UTCN, NCIT, UVT, and ICI (Romania)Etvs Lornd University (ELU) from Budapest (Hungary)Research and Educational Networking Association of Moldova (RENAM)

    Future developments and Beneficiaries:Government Organizations, Environment Agencies, Hydrological Institutes, and Research Groups involved in environment supervision and behavior prediction of natural phenomena, especially in vegetation related studiesBased on ESIP Platform developed through the JRA1 activities of SEE-GRID-SCI ProjectGreenView experience will support the development of other SEE-GRID-SCI partners applications: EnviMon (RENAM)Soil Pollution by Heavy Metals (CENS NAS RA - Center for Ecological-Noosphere Studies of National Academy of Sciences of the Republic of Armenia)

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • GreenView Pilot ApplicationFunctionality:Data interpolationModel calibrationUses the ESIP Platform Inputs Satellite image datasetsMODIS (MODerate Resolution Imaging Sounder) products.Meteorological dataField measurementsEddy covariance measurements for a particular geographical area.OutputsVegetation parametersNDVI-FPAR/LAI correlation functionSatellite images classified by vegetation indicesStatistics on output dataPerformance evaluation on data processing

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • GreenView Related Architecture

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • GreenView ApplicationData interpolation Computes data to an arbitrarily chosen grid defined by the userfrom fine to coarse gridfrom coarse to fine gridProvides data series for a period chosen by the user, in time steps of the original data or averaged for a certain periodModel calibrationGPP (Gross Primary Production) the total amount of carbon taken up by vegetation via photosynthesisDetermination of GPPField measurements (eddy covariance technique) accurate, but limitedMOD 17 product (algorithm is based on the BIOME-BGC ecosystem model)Calibration and sensitivity analysis based on BIOME BGC modelPeriod: 19972008, Monte Carlo methodPost processingNonlinear inversion method

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • GreenView Application Development Methodology1.Algorithm identification and analysis2.Data model definition3.Identify atomic parts of the algorithmsParallel or serial processingImplementation as services, procedures, separate applications4.Algorithm implementation5.Description of processing using gProcessPDG DefinitioniPDG specificationExecution6.Create the application interfaceLink the application interface to the GRID level

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • GreenView - Algorithm identification and analysis Interpolation: eg. neighbor interpolation, bicubic interpolation, bilinear interpolation etc. Solution: Coarse to fine interpolation The missing points will be computed using a distance weighted nonlinear interpolation that computes the value of a Vm point from four surrounding known values: V1, V2, V3 and V4.

    Vi - one of the four surrounding pixels, Vi( ); di - the great circle distance between two points; dmax - the great circle distance between the furthest two pixels of the surrounding four pixels; R - average radius for a spherical approximation of the Earth (6371.01Km)

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • GreenView - Data model definition Identify the inputs, e.g. satellite image types (MODIS, Landsat, Aster etc.) The data model will be defined by a MODIS satellite image representing a certain area of the Earth and temperature data values recorded in specific points inside the same area. The resolution of the MODIS image is 1Km2 and the resolution of the temperature measurements is about 150Km2

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • GreenView - Identify atomic parts of the computation The parts of the processing algorithms that can be executed independently, named atomic parts, should be identified and analyzed for potential parallel execution. The interpolation algorithm used in our example is a simple one and does not involve separate processing steps, so it can be all considered as an atomic part.

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • GreenView - Algorithm implementation We will need three operators in our example application: system coordinate conversion, interpolation algorithm computation, and the pseudo-coloring.

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • GreenView PDG description

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Current StatusCoarse to Fine interpolationFine to Coarse interpolationMonteCarlo based model calibration, GPP computationGreenView functionality based on the ESIP PlatformExperiment the GreenView functionality over the Grid testbed under gLite middlewareGraphical user interface for Web applicationExperiments over the See-Grid infrastructure (access through WMS at ICI and UVT, the effective execution over the following nodes: ce.ngcc.acad.bg ce01.grid.info.uvt.rotestbed001.grid.ici.rocluster1.csk.kg.ac.yu

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • On-Line GreenView ApplicationGreenView application is available on Internet: http://gisheo01.mediogrid.utcluj.ro:8095/interpolation_v2.1/

    Wiki GreenView http://wiki.egee-see.org/index.php/GreenView

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Coarse To Fine Interpolation

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Map area selection

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Time interval specification

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Fine To Coarse Interpolation

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • GPP Computation

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • GPP Computation uploaded files

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Results

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Results

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Coarse to fine performance evaluation

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Coarse to fine performance evaluation

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • GPP computation

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • GPP computation

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Conclusions on the experimentsOn the Grid infrastructure the time execution of a job means Time to search free nodes of the Grid Time to send the required information Time required to execute the job Time required to retrieve the results from the GridThe gap that appears in these charts is determined byTime for searching free nodes on each siteThe computation power of a nodeThe network traffic and bandwidth Only the applications that require large processing data volume and the applications that are using the parallel computing power of the Grid infrastructure should be implemented as Grid applications

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Deployment and supportGreenView is a web applicationThe user accesses by Internet the computation resources and environmental data that are provided by the Grid infrastructureThe GreenView application is based on the ESIP platform and related methodology

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Future developmentGreenView ApplicationTests and optimizationTests on other data provided by partnersInclude tests on extended set of data (e.g. beneficiaries)Extend the GreenView functionality according the new requirements (eg. EnviMon, soil pollution by heavy metals

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • DisseminationParticipation to the Regional Environmental Science Workshop, Sofia, May 6-8, 2009. Presentations:Victor Bacu, Dorian Gorgan, Teodor Stefanut, "GreenView. Reference: SEEGRIDSCI-NA4-RO-001-GreenView_EnvVO-a-2009-05-07.pptVictor Bacu, Dorian Gorgan, Teodor Stefanut, "ESIP Platform. Reference: SEEGRIDSCI-JRA1-RO-001-ESIP-a-2009-05-07.pptParticipation to SCICOM09 - 7th International Conference on "Large-Scale Scientific Computations", 4-8 June, 2009, Sozopol, Bulgaria.Presentation:Dorian Gorgan, Teodor Stefanut, Victor Bacu, Danut Mihon, Denisa Rodila, Grid based Environment Application Development MethodologyParticipation to HiPerGRID - 3rd International Workshop on High Performance Grid Middleware, 28 May, 2009, Bucharest. Presentation:Victor Bacu, Teodor Stefanut, Denisa Rodila, Dorian Gorgan, Process Description Graph Composition by gProcess Platform" Participation to the Student Scientific Communication Session, 22 May 2009, Technical University of Cluj-Napoca. Presentations:Denisa Rodila, Victor Bacu, Dorian Gorgan, Integration of Satellite Image Operators as Workflows in the gProcess ApplicationDanut Mihon, Dorian Gorgan, Victor Bacu, Teodor Stefanut, "Grid Based Environment Application Development- Green View"

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Papers to ConferencesGorgan, D., Bacu, V., Stefanut, T., Rodila, D., "Grid based Satellite Image Processing Platform for Earth Observation Applications Development". IDAACS'2009 - IEEE Fifth International Workshop on "Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications", 21-23 September 2009, Rende, Cosenza, Italy (2009)Gorgan, D., Stefanut, T., Bacu, V., Mihon, D., Grid based Environment Application Development Methodology, SCICOM09 - 7th International Conference on "Large-Scale Scientific Computations", 4-8 June, Sozopol, Bulgaria, (to be published in LNCS, 2009)Bacu V., Stefanut T., Rodila D., Gorgan D., Process Description Graph Composition by gProcess Platform. HiPerGRID - 3rd International Workshop on High Performance Grid Middleware, 28 May, Bucharest. Proceedings of CSCS-17 Conference, Vol.2. ISSN 2066-4451, pp. 423-430, (2009)Rodila D., Bacu V., Gorgan D., Integration of Satellite Image Operators as Workflows in the gProcess Application. ICCP2009, 27 Aug, 2009 Cluj-Napoca (accepted for publication)

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Mihon D., Bacu V., Stefanut T., Gorgan D., Grid Based Environment Application Development GreenView Application. ICCP2009 - IEEE 5th International Conference on Intelligent Computer Communication and Processing, 27 Aug, 2009 Cluj-Napoca (accepted for publication).Denisa D. Rodila, Victor Bacu, Dorian Gorgan, "Semantic Annotation based Service Composition for Grid Workflow Description and Execution". SYNASC Symposium, 26-29, September 2009, Timisoara, (Accepted for publication in IEEE Computer Press)Gorgan D., "Earth Science Application Development Methodology by ESIP and gProcess Platforms". Abstract sent for the workshop "Federation and interoperability of Earth Science Digital Repositories: data discovery, access and visualization" within the Conference EGEE'09 - Uniting our strengths to realise a sustainable European grid, 21-25 Sept, Barcelona (2009)

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Users, Results, Plans for FuturePossible long-term developmentsThe ESIP Platform and the set of tools and components from the Application Oriented Level could be used in:Development of other environmental and geographical data based applications in SEE and CE regionsDevelopment of tools and application required by other related European projects such as EnviroGRIDS, http://www.envirogrids.net/ Basic software platform for related national programmes from the SEE and CE regions Center for Ecological-Noosphere Studies of National Academy of Sciences of the Republic of Armenia - CENS NAS RADevelopment of environment applications. For instance, soil pollution by heavy metalsGreenView experience will support the development of the EnviMon application (RENAM)Data access services to data repositories provided by the GENESI-DR Project

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • GreenView developing plan

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • AcknowledgmentsThis research is supported by SEE-GRID-SCI (SEE-GRID eInfrastructure for regional eScience) project, funded by the European Commission through the contract nr RI-211338.Climate change data have been retrieved from the PRUDENCE data archive, funded by the EU through contract EVK2-CT2001-00132.MODIS data have been produced and distributed by NASA through the EOS Data Gateway system.Biome-BGC version 4.1.1 was provided by the Numerical Terradynamic Simulation Group (NTSG) at the University of Montana. NTSG assumes no responsibility for the proper use of Biome-BGC by others.

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

  • Thanks for attending!

    *The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338