![Page 1: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/1.jpg)
IRIS/UNAVCO Web Services WorkshopAndrea Donnellan – Jet Propulsion Laboratory
June 8, 2005
QuakeSim/iSERVO
![Page 2: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/2.jpg)
Quakesim
• Geoscientists develop simulation codes, analysis and visualization tools.
• Need a way to bind distributed codes, tools, and data sets.
• Need a way to deliver it to a larger audience– Instead of downloading and
installing the code, use it as a remote service.
• Under development in collaboration with researchers at JPL, UC Davis, USC, UC Irvine, and Brown University.
![Page 3: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/3.jpg)
Objective
Infogroup Server
Web browser
Web Client
HTML
Tomcat Coyote Web Server
JSP/Servlet
JDBC
HTTP GET/POST
HTML
Internet
Fault Database
MySQLDBMS
Infogroup Server
Web browser
Web Client
HTML
Tomcat Coyote Web Server
JSP/Servlet
JDBC
HTTP GET/POST
HTML
Internet
Fault Database
MySQLDBMS
• Assimilate distributed data sources and complex models into a parallel high-performance earthquake simulation and forecasting system
• Simplify data discovery, access, and usage from the scientific user point of view
• Provide capabilities for efficient data mining
• Assimilate distributed data sources and complex models into a parallel high-performance earthquake simulation and forecasting system
• Simplify data discovery, access, and usage from the scientific user point of view
• Provide capabilities for efficient data mining
Develop real-time, large-scale, data assimilation grid implementation for the study of earthquakes that will:
![Page 4: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/4.jpg)
QuakeSim Portal Examples
![Page 5: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/5.jpg)
Philosophy
• Store simulated and observed data• Archive simulation data with original simulation code and
analysis tools• Access heterogeneous distributed data through cooperative
federated databases• Couple distributed data sources, applications, and hardware
resources through an XML-based Web Services framework. • Users access the services (and thus distributed resources)
through Web browser-based Problem Solving Environment clients.
• The Web services approach defines standard, programming language-independent application programming interfaces, so non-browser client applications may also be built.
![Page 6: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/6.jpg)
Five Components of QuakeSim
1. Web Services • Indiana University (Geoffrey Fox and Marlon Pierce)
2. Metadata Services and Federated Database System• USC (Dennis McLeod)
3. Data Assimilation Infrastructure• JPL (Jay Parker, Greg Lyzenga), UC Davis (John Rundle)
4. Datamining Infrastructure• JPL (Robert Granat), UC Davis (John Rundle)
5. High Performance Modeling Software (FEM, BEM)• JPL (Jay Parker, Greg Lyzenga, Charles Norton)• UC Davis (John Rundle)• Brown (Terry Tullis)
![Page 7: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/7.jpg)
Indiana U. (Web Services)
USC ( Federated Database)
UC Davis (Data Assimilation)
JPL (Lead)
Co-Investigators: Loosely Coupled Compute Nodes
Key Collaborators
Geographic Distribution
complexity.ucs.indiana.edu: 8 processor Sun Sunblade server. This runs the portal.
{kamet, danube, darya}.ucs.indiana.edu: dual (duel) processor linux hosts with various code services (GeoFEST, patterninfo, RDAHMM, Virtual California).
gf1.ucs.indiana.edu: a 4 processor linux server. This hosts the current QuakeTables DB and the Web Feature Service
gf2.ucs.indiana.edu: a 4 processor linux server. This hosts various code services services.
grids.ucs.indiana.edu: a Sun server that runs Disloc and Simplex services
orion.jpl.nasa.gov: 64 processor linux cluster runs GeoFEST
jabba.jpl.nasa.gov: 8 processor SGIruns Riva and web services for making movies
losangeles.jpl.nasa.gov: 8 processorruns GeoFEST
infogroup.usc.edu: This was the database server
CSEBEO: parallel Beowulf cluster that currently has 22 opteron nodes - runs Virtual California for data assimilation, as well as other codes.
siro-lab.usc.edu: informationmanagement development and storage platform. On line June 2005.
![Page 8: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/8.jpg)
Web Services
• Build clients in the following styles:
– Portal clients: ubiquitous, can combine
– Fancier GUI client applications
– Embed Web service client stubs (library routines) into application code
• Code can make direct calls to remote data sources, etc.
• Regardless of the client one builds, the services are the same in all cases:
– my portal and your application code may each use the same service to talk to the same database.
• So we need to concentrate on services and let clients bloom as they may:
– Client applications (portals, GUIs, etc.) will have a much shorter lifecycle than service interface definitions, if we do our job correctly
– Client applications that are locked into particular services, use proprietary data formats and wire protocols, etc., are at risk
![Page 9: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/9.jpg)
SERVO Grid
Solid Earth Research Virtual Observatory using grid technologies and high-end computers
Solid Earth Research Virtual Observatory using grid technologies and high-end computers
RepositoriesFederated Databases Sensor Nets
Streaming Data
Closely Coupled Compute Nodes
Database
Loosely Coupled Filters (Coarse Graining)
Analysis and Visualization
![Page 10: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/10.jpg)
NASA’s Main Interest
Developing the necessary data assimilation and modeling infrastructure for future InSAR missions.
InSAR is the fourth component of EarthScope
InSAR is the fourth component of EarthScope
![Page 11: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/11.jpg)
iSERVO Web Services• Job Submission: supports remote batch and shell invocations
– Used to execute simulation codes (VC suite, GeoFEST, etc.), mesh generation (Akira/Apollo) and visualization packages (RIVA, GMT).
• File management:– Uploading, downloading, backend crossloading (i.e. move files
between remote servers) – Remote copies, renames, etc.
• Job monitoring• Apache Ant-based remote service orchestration
– For coupling related sequences of remote actions, such as RIVA movie generation.
• Database services: support SQL queries• Data services: support interactions with XML-based fault and surface
observation data.– For simulation generated faults (i.e. from Simplex)– XML data model being adopted for common formats with translation
services to “legacy” formats.– Migrating to Geography Markup Language (GML) descriptions.
![Page 12: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/12.jpg)
Our Approach to Building Grid Services
• There are several competing visions for Grid Web Services.– WSRF (US) and WS-I+ (UK) are most prominent
• We follow the WS-I+ approach– Build services on proven basic standards (WSDL,
SOAP, UDDI)– Expand this core as necessary
• GIS standards implemented as Web Services• Service orchestration, lightweight metadata
management
![Page 13: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/13.jpg)
Grid Services Approach
• We stress innovative implementations
– Web Services are essentially message-based.
– SERVO applications require non-trivial data management (both archives and real-time streams).
– We can support both streams and events through NaradaBrokering messaging middleware.
– HPSearch uses and manages NaradaBrokering events and data streams for service orchestration.
– Upcoming improvements to the Web Feature Service will be based on streaming to improve performance.
– Sensor Grid work is being based on NaradaBrokering.
• Core NaradaBrokering development stresses the support for Web Service standards
– WS-Reliability, WS-Eventing, WS-Security
![Page 14: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/14.jpg)
NaradaBrokeringManaging Streams
• NaradaBrokering– Messaging infrastructure for collaboration, peer-to-peer and
Grid applications– Implements high-performance protocols (message transit
time of 1 to 2 ms per hop)– Order-preserving, optimized message transport with QoS
and security profiles for sent and received messages– Support for different underlying protocols such as TCP,
UDP, Multicast, RTP – Discovery Service to locate nearest brokers
![Page 15: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/15.jpg)
HPSearchArchitecture Diagram
Request Handler
Java script Shell
Task SchedulerFlow Handler
Web Service EP
Other Objects
HPSearch Kernel
URIHandler
DBHandler
WSDLHandler
WSProxyHandler
Request Handler
HPSearch Kernel
HPSearch Kernel
Broker Network
SOAP/HTTP
. . .
DataBase
Web Service
FilesSocketsTopics
Network Protocol
JDBC
SOAP/HTTP
WSProxy
Service
WSProxy
Service
WSProxy
Service
HPSearch Control Events
using PUB/SUB on predefined topic
Data buffers sent / received as Narada Events
![Page 16: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/16.jpg)
Problem Solving Environment
High-level architecture showing grids, portals, and grid computing environments.
ClientBrowser
User InterfaceServer
Service Provider
InformationRepository
Service Provider
ServiceProvider
ServiceProvider
(SOAP/HTTP)
(HTTP)
Publish ServicesBind and Use Service
Find Service
Client Requests
(1)
(2)
(0)(3)
Raw (HPC) Resources
Middleware
Database
PortalServices
SystemServices
SystemServices
SystemServices
Application Service
SystemServices
SystemServices
GridComputing
Environments
UserServices
“Core”Grid
Loosely coupled systems that use asynchronous message exchanges between distributed services
Loosely coupled systems that use asynchronous message exchanges between distributed services
![Page 17: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/17.jpg)
SERVOGrid Application Descriptions
• Codes range from simple “rough estimate” codes to parallel, high performance applications.– Disloc: handles multiple arbitrarily dipping dislocations (faults) in an elastic
half-space.– Simplex: inverts surface geodetic displacements for fault parameters using
simulated annealing downhill residual minimization. – GeoFEST: Three-dimensional viscoelastic finite element model for
calculating nodal displacements and tractions. Allows for realistic fault geometry and characteristics, material properties, and body forces.
– Virtual California: Program to simulate interactions between vertical strike-slip faults using an elastic layer over a viscoelastic half-space
– RDAHMM: Time series analysis program based on Hidden Markov Modeling. Produces feature vectors and probabilities for transitioning from one class to another.
– PARK: Boundary element program to calculate fault slip velocity history based on fault frictional properties.a model for unstable slip on a single earthquake fault.
• Preprocessors, mesh generators• Visualization tools: RIVA, GMT
![Page 18: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/18.jpg)
WMS submits script execution request (URI of script, parameters)
Data Filter(Danube)
PI Code Runner(Danube) Accumulate Data Run PI Code Create Graph Convert RAW -> GML
GPS Database(Gridfarm001)
WMS
HPSearch(TRex)
HPSearch(Danube)
HPSearch hosts an AXIS service for remote deployment of scripts
GML(Danube)
WS Context(Tambora)
NaradaBroker network: Used by HPSearch engines as well as for data transfer
Actual Data flow
HPSearch controls the Web services
Final Output pulled by the WMS
HPSearch Engines communicate using NB Messaging infrastructure
Virtual Data flow
Data can be stored and retrieved from the 3rd part repository (Context Service)
SERVOGrid: Behind the Scenes
![Page 19: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/19.jpg)
Federated Database
• Understand the meaning and format of heterogeneous data sources and requirements of simulation and analysis codes
• Desire to interoperate various codes with various information sources (subject to security)
• Problem of semantic and naming conflicts between various federated datasets– Discovery, management, integration and use of data difficult– Presence of many large federated datasets in seismology– Different interpretations and analysis of the same datasets by
different experts
Ontology-based federated information managementOntology-based federated information management
![Page 20: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/20.jpg)
Database Goal
• Support interoperation of data and software• Support data discovery• Semi-automatically extract ontologies from
federated datasets– Ontology: concepts and inter-relationships
• Mine for patterns in data to discover new concepts in these federated ontologies
• Employ generalized geo-science ontology– Sources: Geon, GSL, Intellisophic, …
![Page 21: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/21.jpg)
Database Approach
• A semi-automatic ontology extraction methodology from the federated relational database schemas
• Devising a semi-automated lexical database system to obtain inter-relationships with users’ feedback
• Providing tools to mine for new concepts and inter-relationships
• Ontronic: a tool for federated ontology-based management, sharing, discovery
• Interface to Scientist Portal
![Page 22: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/22.jpg)
Evaluation Plan
• Initially employ three datasets: – QuakeTables Fault Database (QuakeSim)– The Southern California Earthquake Data Center
(SCEDC) – The Southern California Seismology Network
(SCSN) • From these large scale and inherently heterogeneous
and federated databases we are evaluating– Semi-automatic extraction– Checking correctness– Evaluating mapping algorithm
![Page 23: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/23.jpg)
Where Is the Data?
• QuakeTables Fault Database– SERVO’s fault repository for California.– Compatible with GeoFEST, Disloc, and VirtualCalifornia– http://infogroup.usc.edu:8080/public.html
• GPS Data sources and formats (RDAHMM and others).– JPL: ftp://sideshow.jpl.nasa.gov/pub/mbh– SOPAC: ftp://garner.ucsd.edu/pub/timeseries– USGS: http://pasadena.wr.usgs.gov/scign/Analysis/plotdata/
• Seismic Event Data (RDAHMM and others)– SCSN: http://www.scec.org/ftp/catalogs/SCSN– SCEDC: http://www.scecd.scec.org/ftp/catalogs/SCEC_DC– Dinger-Shearer:
http://www.scecdc.org/ftp/catalogs/dinger-shearer/dinger-shearer.catalog
– Haukkson: http://www.scecdc.scec.org/ftp/catalogs/hauksson/Socal• This is the raw material for our data services in SERVO
![Page 24: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/24.jpg)
Geographical Information System Services as a Data Grid• Data Grid components of SERVO are implemented using
standard GIS services.– Use Open Geospatial Consortium standards– Maximize reusability in future SERVO projects– Provide downloadable GIS software to the community as a
side effect of SERVO research.• Implemented two cornerstone standards
– Web Feature Service (WFS): data service for storing abstract map features
• Supports queries• Faults, GPS, seismic records
– Web Map Service (WMS): generate interactive maps from WFSs and other WMSs.
• Maps are overlays• Can also extract features (faults, seismic events, etc)
from user GUIs to drive problems such as the PI code and (in near future) GeoFEST, VC.
![Page 25: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/25.jpg)
Geographical Information System Services as a Data Grid
• Built these as Web Services– WSDL and SOAP: programming interfaces and messaging
formats– You can work with the data and map services through
programming APIs as well as browser interfaces.– Running demos and downloadable code are available from
www.crisisgrid.org.• We are currently working on these steps
– Improving WFS performance– Integrating WMS clients with more applications – Making WMS clients publicly available and downloadable
(as portlets).– Implementing SensorML for streaming, real-time data.
![Page 26: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/26.jpg)
Screen Shot From the WMS Client
![Page 27: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/27.jpg)
When you select (i) and click on a feature in the map
![Page 28: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/28.jpg)
WFS by the Numbers
• The following data is available in the SERVO Web Feature Services– These were collected from public sites– We have reformatted to GML
• Data– Filtered GPS archive (297 stations) from : 48.02MB – Point GPS archive (766 stations): 42.94MB – SCEDC Seismic archive: 34.83MB – SCSN Seismic archive: 26.34MB – California Faults (from QuakeTables Fault DB): 62KB – CA Fault Segments (from QuakeTables Fault DB): 41KB – Boundaries of major European Cities: 12.7KB – European map data: 636KB – Global Seismic Events:14.8MB – US Rivers: 11KB – US Map-State Borders: 1.13MB – US State Capitals:5.75KB
• WFS URLs – http://gf1.ucs.indiana.edu:7474/axis/services/wfs?wsdl – http://gf1.ucs.indiana.edu:7474/wfs/testwfs.jsp
![Page 29: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/29.jpg)
GEOFEST: Northridge Earthquake Example• Select faults from
database
• Generate and refine mesh
• Run finite element code
• Receive e-mail with URL of movie when run is complete
![Page 30: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/30.jpg)
GeoFEST FEM and Mesh Decomposition
1992 Landers earthquake finite element mesh decomposed using PYRAMID.
Colors indicate partitioning among processors (64 in this run).
GeoFEST has been run for 60 million elements on 1024 processors (capable of larger problems)
GeoFEST has been run for 60 million elements on 1024 processors (capable of larger problems)
Partitions cluster near domain center due to the high mesh densitythat is used near the faults.
![Page 31: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/31.jpg)
Virtual California
Simulations show b-values and clustering of earthquakes in space and time similar to what is observed.
Will require numerous runs on high-performance computers to study the behavior of the system.
Accessible through the portal.
1000 years of simulated earthquakes1000 years of simulated earthquakes
![Page 32: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/32.jpg)
QuakeSim Users
• http://quakesim.jpl.nasa.gov• Click on QuakeSim Portal tab• Create and account• Documentation can be found off the QuakeSim page
We are looking for friendly users for beta testing (e-mail [email protected] if interested)
Coming soon:Tutorial [email protected]
We are looking for friendly users for beta testing (e-mail [email protected] if interested)
Coming soon:Tutorial [email protected]
![Page 33: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/33.jpg)
Ontronic Architecture
Client Server
Java Applet
RDF files
OntologyDAG
OntologyTree
OntologyExtractor
Ontology Visualization
API
MetadataManager
import/export
Visualize ontology
OntologyMapper
Add Inter-relationship
Jena API
Updating metadata
WordNetWrapper
LexicalDBWrapper
Lexical Database
Ontronic DatabaseWordNet
Diverse Information Sources
SCSN
SCEDC
QuakeTables
![Page 34: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/34.jpg)
Mapping Algorithm
• A “Standard” ontology for the domain
• Extracting ontologies from the federated datasets– e.g., using relational
metadata to extract the table and column names
(or file structures)
• Mapping and storing relationships– Mapping algorithm
Ontologies extracted from the Federated datasets are denoted by Fi
The Global ontology is denoted by Gi
For each Fi
For each Concept Ci in Fi
Begin
Try an exact string match to each concept in Gi
If no matches were found then
Lookup the Lexical database by Fi
If no results are found in this lookup then
Lookup WordNet for synonyms Si of Fi
Find the closest synonym to Fi in Si by string matching
If no synonyms were found then
Ask for user input on this mapping
Store this mapping in the Lexical database
Else
Store the mapping in the Lexical database
Else
Store the mapping in the Lexical database
Else
Store the mapping in the Lexical database
End
![Page 35: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/35.jpg)
Mapping Process
Discover the best matches between 1. local concept name 2. concept name of global ontology using WordNet API and our lexical database
databasendatabasendatabase1database1
database2database2database3database3
Standard Ontology
Domain Expert
Verify themapping
Ontronic
Mapping local conceptsand inter-relationships
to standardized ontology
Extraction fromdatabase
(relational, file)
LexicaldatabaseLexical
database
WordNetWordNet
![Page 36: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/36.jpg)
Visual Ontology Manager in Ontronic
![Page 37: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/37.jpg)
Metadata and Information Services
• We like the OGC but their metadata and information services are too specialized to GIS data. – Web Service standards should be used instead
• For basic information services, we developed an enhanced UDDI– UDDI provides registry for service URLs and queryable metadata.– We extended its data model to include GIS capabilities.xml files.
• You can query capabilities of services.– We added leasing to services
• Clean up obsolete entries when the lease expires.• We are also implementing WS-Context
– Store and manage short-lived metadata and state information– Store “personalized” metadata for specific users and groups– Used to manage shared state information in distributed applications
• See http://grids.ucs.indiana.edu/~maktas/fthpis/
![Page 38: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/38.jpg)
Service Orchestration with HPSearch
• GIS data services, code execution services, and information services need to be connected into specific aggregate application services.
• HPSearch: CGL’s project to implement service management– Uses NaradaBrokering to manage events and stream-based data
flow• HPSearch and SERVO applications
– We have integrated this with RDAHMM and Pattern Informatics• These are “classic” workflow chains
– UC-Davis has re-designed the Manna code to use HPSearch for distributed worker management as a prototype.
– More interesting work will be to integrate HPSearch with VC.• This is described in greater detail in the performance analysis
presentation and related documents.– See also supplemental slides.
![Page 39: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/39.jpg)
HPSearch and NaradaBrokering
• HPSearch uses NaradaBrokering to route data streams– Each stream is represented by a topic name– Components subscribe / publish to specified topic
• The WSProxy component automatically maps topics to Input / Output streams
• Each write (byte[] buffer) and
byte[] read() call is mapped to a NaradaBrokering event
![Page 40: IRIS/UNAVCO Web Services Workshop Andrea Donnellan – Jet Propulsion Laboratory June 8, 2005 QuakeSim/iSERVO](https://reader034.vdocuments.net/reader034/viewer/2022051621/56649cd95503460f949a2957/html5/thumbnails/40.jpg)
In Progress
• Integrate HPSearch with Virtual California for loosely coupled grid application parameter space study.– HPSearch is designed to handle, manage multiple loosely coupled
processes communicating with millisecond or longer latencies.• Improve performance of data services
– This is the current bottleneck– GIS data services have problems with non-trivial data transfers– But streaming approaches and data/control channel separation can
dramatically improve this.• Provide support for higher level data products and federated data
storage– CGL does not try to resolve format issues in different data providers
• See backup slides for a list for GPS and seismic events. • GML is not enough
– USC’s Ontronic system researches these issues.• Provide real time data access to GPS and other sources
– Implement SensorML over NaradaBrokering messaging– Do preliminary integration with RDAHMM
• Improve WMS clients to support sophisticated visualization