a sensor-centric grid middleware management systems by geoffrey fox, alex ho, rui wang, edward chu...

45
A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University) In collaboration with Ball Aerospace ANABAS

Upload: terence-thomas

Post on 11-Jan-2016

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

A Sensor-Centric Grid Middleware Management Systems

by

Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan

(Anabas, Inc. and Indiana University)

In collaboration with Ball Aerospace

ANABAS

Page 2: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Motivation

• Information Age versus Integration Age• Need for better intelligence for decision support• Increased use of low cost sensors in commercial and defense environments• Support the concepts of

• User-Defined Operational Pictures (UDOP), and• Common Operational Pictures (COP)

• Interoperability through Grid and Cloud middleware

Page 3: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

UDOP - User-Defined Operational Pictures

• Enables situational awareness and facilitates a user to easily choose, create, visualize and present decision-focused views of an operation or mission

COP – Common Operational Pictures

• Enables sharing of situational awareness operational pictures with relevant personnel

ANABAS

Page 4: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

• An operational environment refers to the environment where stakeholders of an operation reside.• Making accurate decisions in a stressful operational environment involves many processes including but not limited to

* collecting, decomposing, analyzing, * visualizing, organizing, sharing of information, and

* deriving new information

Page 5: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Objectives

Design and develop an sensor-centric grid middlewareenabling framework to enable easy

• development• deployment• management• real-time visualization• organization• presentation

of collaborative geo-coded sensor grid applications withUDOP/COP capabilities.

Page 6: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Our definition:

• A sensor is a time-dependent stream of information with a geo-spatial location.• A static electronic entity is a broken sensor with a broken GPS! i.e. a sensor architecture applies to everything

Page 7: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Sensor Layer

Meta Data Layer

Information Management Layer

Application Layer

Images RSS RFID Tags GPS

LocationLogicalGroups

SensorType

UserDefined

Properties

MessagingServices

SensorManagement

MilitaryApplications

LogisticsApplications

FinancialApplications

UDOP Architecture

Page 8: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS Sensor Layer

• Sensors provide raw information which is captured dynamically in different environments.

Metadata Layer• Describes the properties of sensor; gives meaning to raw data collected from sensors. Makes information filtering possible.

Information Management Layer• Transport messages from sensors to applications• Messaging facilities that supports multi-protocol• Facilities for sensor management such as deploying and disconnecting sensors

Application Layer• UDOP applications

Page 9: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

SCGMMS – Sensor-Centric Grid MiddlewareManagement System

SCGMMS API allows application developers to retrieve sensor data and metadataabout sensors. The SCGMMS SSAL facilitates sensor developers to define sensormetadata for application-level filtering and expose sensor services to applications.

Page 10: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

NaradaBrokering (NB) provides the transport-level messaging support for SCGMMS. NB supports a distributed message-based overlay network with a publish-subscribe messaging model.

With the help of NB different components of SCGMMS can be integrated, deployed and works collaboratively in a distributed manner.

For NB information, see IU exhibition booth for details.

Page 11: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Sneak preview of sample applications developed using the SCGMMS API

Page 12: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

Problem: Unable to perform advanced research for

multi-layered sensor Net-Centric infrastructure

without an ,advanced scalable grid framework that

allows existing systems and new systems to interact

andcooperate.

Objective: Integrate Global Grid Technology with

multi-layered sensor technology to provide a

Collaboration Sensor Grid for Network-Centric

Operations research to examine andderivewarfighter

requirementsontheGIG.

Collaboration Sensor Grid – Connecting the Warfighter

Challenges:• Adapt the technologies so that valid experiments

and demonstrations of fundamental GIG

infrastructurerequirementscanberealized.• Discover hidden requirements for intelligence

,exploitation decision support and advanced

collaborationontheGIG.• Perforate multi-layered sensor stovepipes to

enable GIG operations without re-factoringexisting software.

Approach:• Investigate grid technologies (e.g., ’IBM s

GLOBUS ,toolkit ’IU s ,NaradaBroker etc.)

• Design & implement grid middleware using

NaradaBroker to produce a prototype

collaborationsensor grid

• Integrate with NetOps to provide collaboration

sensor gridsituational awareness

• Usesensor gridforwarfighter GIGresearch.

Anabas, Inc.

:Technologies

• NaradaBroker fromIndianaUniversity

• ’ Ball sNetOpsSituational Awarenesstechnology

• JAVA

• Haskell

• Functional ReactiveProgramming

• ( . ., , Lowcostsensors e g Wii IRsensor RFIDreader

& , , , .)RFIDtags GPSsensor ultrasonicsensor etc

::Acronyms

• ( )Global InformationGrid GIG

• ( )Radio FrequencyIdentification RFID

• ( ) Global PositioningSystem GPS

• ( )NetworkOperations NetOps

ForMoreInformation– PleaseContact:

AnabasInc.Alex ,Ho (415) [email protected]

Dr. Geoffrey ,Fox (812) [email protected]

BallAerospace& TechnologiesCorp.Gary ,Whitted (937) [email protected]

Timothy ,Choate (937) [email protected]

Anabas, Inc.

Ball Aerospace & Technologies Corp.

Gary Whitted, (937) 320-6022 [email protected]

Timothy Choate, (937) [email protected]

Anabas Inc.

Alex Ho, (415) [email protected]

Dr. Geoffrey Fox, (812) 856-7977 [email protected]

Page 13: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)
Page 14: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS Distributed Architecture for Data Access

Page 15: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Distributed Architecture for Data Access

Page 16: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS Data Model

• Sensors in different geo-spatial locations continuously publish data into the distributed brokering network.

• SCGMMS routes relevant data to all connected applications according to their UDOP requirements.

• Applications are notified for each data arrival through data listeners. • Some sensors are capable of receiving requests from applications and perform some actions in return. These actions are sensor-specific.

• Sensors data could be routed to other computational services for further processing.

Page 17: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Data Selection and Filtering

• Each UDOP application is only interested in certain domain-specific information extracted from the large raw data pool supported by SCGMMS.

• Filtering follows the request/response model where• an application user defines a “filter”• the filter is sent to SCGMMS as a request• SCGMMS responds with sensors that match the filter• the application subscribes to data of these sensors through the SCGMMS API

Page 18: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

An example of a filter in SCGMMS

A decision-maker wants to locate all GPS and RFID sensors in US or UK, the corresponding query looks like: 

Page 19: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

A sample UDOP-capable sensor-centricapplication provides a GUI to support ease of filtering.

Page 20: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Sensor-Centric Grid Middleware Management System Architecture

Page 21: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

 

• Defining the properties of sensors• Deploying sensors according to defined properties• Monitoring deployment status of sensors• Remote Management - Allow management irrespective of the location of the sensors• Distributed Management – Allow management irrespective of the location of the manager / user

Grid Builder (GB)

GB is a sensor management module which provides services for

Page 22: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

 

Sensor Grid (SG)

Sensor Grid communicates with

• sensors• applications• Grid Builder

to mediate the collaboration of these 3 logical modules.Primary functions of SG are to manage and brokersensor message flows.

Page 23: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

 

Sensor Grid (SG)

• Sensor/Sensor Grid Message Flow

• SG keeps track of the status of all sensors when they are deployed or disconnected so that applications using the sensors will be notified of changes.

• Sensor data normally does not pass through SG except when it has to be recoded intentionally.

Page 24: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

 

Sensor Grid (SG)

• Application/Sensor Grid Message Flow

• Applications communicates with SCGMMS via API, which in turn communicates with SG internally.

• Applications can define their own filtering criteria, which will be sent to SG for discovering and linking appropriate sensors logically.

• SG forwards messages among relevant sensors and applications.

• SG updates applications if there are any changes of relevant sensors.

Page 25: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

 

Sensor Grid (SG)

• Grid Builder/Sensor Grid Message Flow

• Sensor properties are defined in GB.• Applications obtain sensor properties through SG.• SG sends application filtering requests to GB regularly to obtain updated sensor information.

Page 26: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

 

Sensor Grid (SG)

• Application/Sensor Message Flow

• SG provides each application with information of sensors they need according to the filtering criteria.

• Applications communicates with sensors via the SCGMMS API.

Page 27: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

 

Sensor Grid (SG)

Page 28: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Page 29: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS Grid Builder (GB)

• GB is originally designed for managing Grid of Grids.• GB is extended to support sensor-centric grid.• The Grid which GB manages is arranged hierarchically into domains.• Each domain is typically a PC which manages local sensors.• Sensors can be deployed in any domain and accessible from any domains.

Page 30: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS Grid Builder (GB)

Domains have some basic components

• Managers and Resources• Each resource is wrapped in a Service Adapter

• Bootstrapping Service• Ensures the current domains are up and running. • It periodically spawns a health check manager that checks the health of the system.

• Registry• All data about registered services and SA are stored in Registry. WS-Context is used for persistency. • Processes messages for managing SA and update SA status.

Page 31: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

Distributed Geospatial Intelligence-EnabledUser Defined Operating Pictures & Common Operating Pictures

-- An illustrative demo in CTS 2008

ANABAS

Page 32: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

Problem: Unable to perform advanced research for

multi-layered sensor Net-Centric infrastructure

without an ,advanced scalable grid framework that

allows existing systems and new systems to interact

andcooperate.

Objective: Integrate Global Grid Technology with

multi-layered sensor technology to provide a

Collaboration Sensor Grid for Network-Centric

Operations research to examine andderivewarfighter

requirementsontheGIG.

Collaboration Sensor Grid – Connecting the Warfighter

Challenges:• Adapt the technologies so that valid experiments

and demonstrations of fundamental GIG

infrastructurerequirementscanberealized.• Discover hidden requirements for intelligence

,exploitation decision support and advanced

collaborationontheGIG.• Perforate multi-layered sensor stovepipes to

enable GIG operations without re-factoringexisting software.

Approach:• Investigate grid technologies (e.g., ’IBM s

GLOBUS ,toolkit ’IU s ,NaradaBroker etc.)

• Design & implement grid middleware using

NaradaBroker to produce a prototype

collaborationsensor grid

• Integrate with NetOps to provide collaboration

sensor gridsituational awareness

• Usesensor gridforwarfighter GIGresearch.

Anabas, Inc.

:Technologies

• NaradaBroker fromIndianaUniversity

• ’ Ball sNetOpsSituational Awarenesstechnology

• JAVA

• Haskell

• Functional ReactiveProgramming

• ( . ., , Lowcostsensors e g Wii IRsensor RFIDreader

& , , , .)RFIDtags GPSsensor ultrasonicsensor etc

::Acronyms

• ( )Global InformationGrid GIG

• ( )Radio FrequencyIdentification RFID

• ( ) Global PositioningSystem GPS

• ( )NetworkOperations NetOps

ForMoreInformation– PleaseContact:

AnabasInc.Alex ,Ho (415) [email protected]

Dr. Geoffrey ,Fox (812) [email protected]

BallAerospace& TechnologiesCorp.Gary ,Whitted (937) [email protected]

Timothy ,Choate (937) [email protected]

Anabas, Inc.

Ball Aerospace & Technologies Corp.

Gary Whitted, (937) 320-6022 [email protected]

Timothy Choate, (937) [email protected]

Anabas Inc.

Alex Ho, (415) [email protected]

Dr. Geoffrey Fox, (812) 856-7977 [email protected]

Page 33: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

Supported Services

Sensor Services:

• RFID• GPS• Wii remote• Webcam video• Lego Mindstorm NXT

• Ultrasonic• Sound• Light• Touch• Gyroscope• Compass• Accelerometer• Thermistor

• Nokia N800 Internet Tablet

Computational Service• VED (Video Edge Detection)• RFID positioning

Page 34: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)
Page 35: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)
Page 36: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Page 37: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Page 38: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Page 39: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Page 40: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Page 41: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Page 42: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Acknowledgment

We thank Bill McQuay of AFRL, Gary Whittedof Ball Aerospace, Shrideep Pallackara andMarlon Pierce for their advise and support.

Page 43: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Page 44: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS

Page 45: A Sensor-Centric Grid Middleware Management Systems by Geoffrey Fox, Alex Ho, Rui Wang, Edward Chu and Isaac Kwan (Anabas, Inc. and Indiana University)

ANABAS