integration of grid service and web processing service

State Key Laboratory of Resources and Environmental Information System China

Integration of Grid Service and Web Processing Service

Gao AngState Key Laboratory of Resources and Environmental Information System

[email protected]

OSGeo China

23/4/22 2State Key Laboratory of Resources and Environmental Information System China

Agenda

Overview of Grid Technology and Grid Service• Grid Technology• Grid Service• Integrate Grid with Spatial Database

WPS and Grid Service• WPS Process• Combination with Grid Service

Geospatial data access and Integration• GridGIS Architecture• Integrate Grid Technology with Spatial Database

Our Work: LGrid GIS Prototype• LGrid Architecture• LGrid Snapshoot


Grid Computing Overview

Definition• A service for sharing computer power and data storage capacity

over the Internet.

Grid Computing• Resources Management• Data Management• Information Service

Characteristic• Computing resources are not administered centrally.• Open standards are used.• Non-trivial quality of service is achieved.

Analogy• like a power company or water company


Hierarchy of Typical Grid Structure

Comparison of sandglass model and core components

NOTE: As in the Internet, applications can use capabilities at any level of the stack. Abstractions are provided for convenience.


Grid and Web Services - Integration

Grid

Web

WSRF

OGSI

GT2

GT1

HTTPWSDL,

WS-*

WSDL 2,

WSDM

Have beenconverging

The definition of WSRF means that Grid and Web communities can move forward on a common baseWSRF: WS-Resource (Reference: http://www.globus.org/wsrf/)


Globus Toolkit Components Stack


Globus Service in Grid Container


Original Blueprint of Grid GIS

System Independence Distributing Database

Extension of Geospatial Database

High Level Security Management

Geospatial Service Based on Database

Processing Interface and Service Protocol

GRID

SECURITY

Geospatial Universal Operation and Analysis MiddlewareSpatial query

RenderingStatisticAnalysisNetwork

Preproce-ssing

Overlay Neighbor

CondorGT4

(Globus)Vega GOS

Geospatial Data Access and Integration

Cluster

ServiceGSQLSpatial DB

DriverOLTP/OLAP

Data Migration Storage Rollback

WebGIS

Web Service Container->Grid Service Container

Large Scale Geospatial Data Resources

Spatial Information Processing

Middleware

Spatial Data Processing Interface

Desktop GIS


Web Processing Service

GetCapabilities• Request and receive service

metadata that describe the abilities of the specific server implementation.

DescribeProcess• Request and receive back

detailed information about process that can be executed by an Execute operation, including the input parameters and formats, and the outputs.

Execute• Run a specified process

implemented by the WPS, using provided input parameter values and returning the outputs produced.

OGCWebService {Abstract}

+ getCapabilities(request : GetCapabilities) : ServiceMetadata

(from OWS Get Capabi lites)

<<Interface>>

Each server instance instantiates only one object of this class, and this object always exists while server is available.

WPService

+ describeProcess(request : DescribeProcess) : ProcessDescriptions+ execute(request : Execute) : ExecuteResponse


Combination of WPS with Grid Service

Geo-Data Services• Data access: Easy and efficient access to various types of Geo-

data.• Data consistency: Consistency can be maintained when Geo-

data is modified.• Data persistency: Geo-data and its association with its

metadata should be maintained. • Data integration: Mechanisms for integrating heterogeneous

and distributed data under Grid environment.

Extensibility

Interoperability

Security


Data Access and Integration for Geospatial

OGSA-DAI: An extensible framework for data access and integration.Expose heterogeneous data resources to a grid through web services.Interact with data resources:

• Queries and updates.• Data transformation / compression• Data delivery.

Customise for project using• Additional Activities• Client Toolkit APIs• Data Resource handlers

Base for higher-level services• federation, mining, visualization


SQL/MM Support in OGSA-DAI Service

SQL/MM Based Spatial Data Access and Integration

GDSROGSA-DAI

Client

Globus Toolkit

DBMS(Oracle Spatial)

DBMS(PostGIS)

DBMS(MySQL Spatial)

SQL/MM Query

SQL/MM Query

Data Interoperate

OGSA-(Spatial) DAI onGlobus Web Service Container

OGSA-DAI Client

Globus Toolkit

Perform.xml

Response

Response

GDSF

GDSPerform.xml


Data Service in OGSA-DAI


Object Query Tree for Spatial Data

Data Query Process in Distribution Query Process

HASH_JOIN

REDUCE

OPERATION_CAll

EXCHANGE

EXCHANGEEXCHANGE

REDUCE REDUCE

TABLE_SCAN TABLE_SCAN

(C.NAME, AREA)

(AREA(C.LOCATION))

(P.PROVID =C.PROVID)

(C.NAME, AREA)

(CITY) (PROVINCE)(PROVID=130)

(PROVID)

SELECT C.NAME, AREA(C.LOCATION)FROM C IN CITY, P IN PROVINCEWHERE P. PROVID=’130’ AND C.PROVID= P.PROVID


Distributed Query for Spatial Data

Demonstration


LGrid Prototype

Build on NetBeans Platform

NetBeans Platform is a generic framework for Swing applications.NetBeans Platform provides a reliable and flexible application architecture.


Data Integration with OGSA-DAI


SQL Multi-media Query in LGrid Platform


Distribute Data Query


Geospatial Data Source Information in LGrid


Map Visualization in LGrid


Geospatial Sequence Work Flow Execution in LGrid


Performance Monitor in LGrid Node


Data Source Deployment for Geospatial Service


China National Grid and China Educational Grid

Grid Node Distribution Map

http://www.cngrid.org/ http://www.chinagrid.edu.cn/


OSGeo China Protal


OSGeo in China

Michael P. Gerlek deliver a speech for Chinese students


OSGeo in China

Professor Michael F. Goodchild at Institute of Geography


OSGeo in China

OSGeo Monthly Lecture at Institute of Geography, CAS


OSGeo in China

OSGeo Booth at Institute of Geography, CAS


Mail Alias of OSGeo China


More Information…

Contact Gao AngChina State Key Laboratory of Resources and Environmental Information [email protected]

http://www.osgeo.org.cn

http://www.lreis.ac.cn/

http://www.gaoang.com/

Correlative Links:

integration of grid service and web processing service

Documents