advanced user interfaces + data integration + mobile process management = save yourself !! the...

Advanced User Interfaces + Data Integration + Mobile Process Management = Save Yourself !! The WORKPAD project for supporting emergency operators Mobile Process Management, Integrated Data and Geo-collaboration for Emergency Teams Tiziana Catarci SAPIENZA Universit di Roma Dipartimento di Informatica e Sistemistica [Department of System & Computer Engineering] [email protected]

WORKPAD Project 2 Objective & Partners Universit di Roma LA SAPIENZA Italy (COORDINATOR) Universit di Roma TOR VERGATA Italy Salzburg Research Austria Technische Universitaet Wien Austria IBM Italia Center for Advanced Studies Italy APIF Moviquity S.A. Spain Software602 A.S. Czech Republic Calabria Region Civil Protection Department Italy An Adaptive Peer-to-Peer Software Infrastructure for Supporting Collaborative Work of Human Operators in Emergency/Disaster Scenarios

WORKPAD Project 3 Dealing with Emergencies We address response and short-term recovery

WORKPAD Project 4

WORKPAD Project 5

6 SUOR = Sala Operativa Unificata Regionale CCS = Centro Coordinamento dei Soccorsi COM = Centro Operativo Misto Command Coordination

WORKPAD Project 7

Main Innovations on top of reliable communication networks, we build smart applications supporting teams on top of reliable communication networks, we build smart applications supporting teams Process management and coordination Provision of Integrated Data Geo-collaboration WORKPAD Project 8

WORKPAD Project 9 Outline The Workpad user-centered methodology Process Management and Coordination P2P Data Integration Geo-collaboration User Validation

The WORKPAD Methodology: UCD (1) WORKPAD Project 10

The WORKPAD Methodology: UCD (2) WORKPAD Project 11

Requirement Engineering Top down Top down Regulations, laws, initiatives and projects on a European basis Bottom up Bottom up Case study: EM of Civil Protection Experience of users and system engineers WORKPAD Project 12

Deployed HCI Techniques User group categorisation User group categorisation Focus groups Focus groups Structured interviews Structured interviews Scenario development Scenario development Storyboards Storyboards Hierarchical task analysis Hierarchical task analysis Usability tests Usability tests Mock-ups and real prototypes WORKPAD Project 13

Requirement Classification User requirements User requirements What will the user be able to do with the final system? System requirements System requirements Which functionalities must be implemented by the engineers? (in order to satisfy the user requirements) WORKPAD Project 14

PROCESS MANAGEMENT AND COORDINATION ROME4EU WORKPAD Project 15

Motivations Currently most teams are intra- coordinated through transceivers and the operational knowledge is tight to the leader Currently most teams are intra- coordinated through transceivers and the operational knowledge is tight to the leader Formalize such knowledge, and enact it through software applications offered on mobile devices Formalize such knowledge, and enact it through software applications offered on mobile devices WORKPAD Project 16

WORKPAD Project 17 1. A process designer defines a template for a certain event class capturing best practices and protocols at peace time. The template leaves some configuration option open (e.g., a template for all earthquakes) WORKPAD at work / 1

P2P Back-end AN EMERGENCY FIRES!!! Daniele (Generic member) Alessandro (Team leader) 1. Back-end sends the template 2. Template instantiated to the specific emergency WORKPAD at work / 2 2. At run-time Alessandro instantiates the template closing the open options The abstract templates is made concrete by closing the open options The concrete process schema is loaded into the PMS Alessio (Generic member)

P2P Back-end 3. The process is enacted inside ROME4EU WORKPAD at work / 3 3. The process is enacted to team members. Now some tasks are ready to be assigned to team members. PMS assigns tasks whose conditions are all fulfilled to an actor qualified to execute them Alessandro (Team Leader) Alessio (Generic member) Daniele (Generic member)

P2P Back-end WORKPAD at work / 4 4. Members join the team specifying the capabilities they can provide Task assignment is done by considering the capabilities required and those provided by the members Alessandro (Team Leader) Alessio (Generic member) Daniele (Generic member) 4. Members join the team

WORKPAD at work / 5 5. The Work-list handlers of certain members receive the notification of the assigned tasks together with their inputs P2P Back-end 5.Assignment of tasks to team members Alessio (Generic member) Daniele (Generic member) Alessandro (Team Leader)

WORKPAD at work / 6 6. When a certain member completes a task execution, her WLH alerts the PMS. This may cause other tasks to become enabled P2P Back-end 6.Notification of task completion Alessio (Generic member) Daniele (Generic member) Alessandro (Team Leader)

WORKPAD at work / 7 7. PMS analyzes if new enabled tasks are assignable If any tasks, then assigns tasks to the best available peer (human and/or automatic service) that provides all required capabilities. P2P Back-end 7. (Possible) Additional assignment of tasks to team members Alessio (Generic member) Daniele (Generic member) Alessandro (Team Leader)

ROME4EU: An adaptive PMS for smart devices / 1 ROME4EU is an aPMS completely developed on Smart devices ROME4EU is an aPMS completely developed on Smart devices PMS is in charge of carrying out processes by assigning tasks to appropriate humans and/or software resources. It is adaptive, able to automatically adapt the process execution to deal with exogenous events breaking the initial assumptions.

ROME4EU: An aPMS for smart devices / 2 ROME4EU is specifically targeted to highly dynamic and mobile environments ROME4EU is specifically targeted to highly dynamic and mobile environments Dealing with unreliable and slow mobile networks Limiting the battery consumption and the power usage. Dealing with reduced PDAs screen size, which limit the amount of the information concurrently visualisable.

Architecture Team Members Team Leaders

Lessons learned Process Management Systems are worthy using in emergency management Process Management Systems are worthy using in emergency management Processes show the same complexity as business ones Practically feasible (small memory and CPU requirements) Well understood by end users Automatic adaptation is necessary as a number of unexpected contingencies may occur Automatic adaptation is necessary as a number of unexpected contingencies may occur Manual adaptation would delay the operation execution

At a Glance

INTEGRATING DATA - ONDA

Motivations Having data not only belonging to my organization but also coming from other sources Having data not only belonging to my organization but also coming from other sources Persons to save in a given building: 10 (with prob. 10% as this is the number of residents) 14 (with prob. 90% as this is the number of different mobile phones registered in the area just 2 minutes before the emergency) without establishing a centralized system without establishing a centralized system

What is P2P Semantic Integration? Semantic data integration is about integrating data at the conceptual level Semantic data integration is about integrating data at the conceptual level With centralized mediator-based systems, this is accomplished by a global view (ontology) which is mapped to source DB schemas (GAV, LAV, GLAV) With centralized mediator-based systems, this is accomplished by a global view (ontology) which is mapped to source DB schemas (GAV, LAV, GLAV) In decentralized environments, each system (peer) acts both as source and mediator In decentralized environments, each system (peer) acts both as source and mediator

Aim of the component Allow rapid integration of information flows of rescue organizations Support organzations of every kind, even if they meet on the emergency for the first time Support flexible design of command & coordination flows Support Geo Data Manage event notification Command Coordination

Front-End Back-End Modeling & Configuration Modeling & Configuration Queries & Notifications P2P Mappings & Notifications Queries & Notifications Local Sources Mappings with Local Sources FE/BE Link KP Ontology

Technical Overview Each Peer is a Semantic Data Integration System wich Each Peer is a Semantic Data Integration System wich Has an own ontology as global schema Integrates heterogeneous sources through mapping with the local ontology Integrates other peers through mappings between ontologies A Client is able to A Client is able to Perform semantic conjunctive queries Receive notifications about relevant data changes (Add and Remove subscriptions) The WORKPADs Back-End network is a Peer-to-Peer Semantic Data Integration System (P2P-DIS)

Architecture Information Layer Query & Reasoning Layer Modelling Layer Resources Knowledge Base Management Conceptual Modelling Dialogs Source Mappings Dialogs Administrator Peer-to-peer Mapping Dialogs Reasoner Wrapper Reasoner Query Processor Query Executor P2P Query Propagator Local Data Ontologies, Mappings External Reasoner Front-end Applications External Applications Interaction Layer Active Subscr. Subscriptions & Notifications Peers Change Synch BE peers publish conceptual schemas (ontologies), then define mappings with local and remote systems The core element is a query processor that is able to evaluate \ propagate \ reconcile queries according with ontologies and mapping semantics

1. Schemas are specified by rich logic languages (Description Logics) City is_a Place(NAME) 2. Semantic mappings (GAV) with data sources are established CAPITAL(ID) City(f(ID)) TOWN(NM) City(f(NM)) 3. Queries are expressed in terms of ontology concepts x,y | Place(x) AND NAME(x,y) 4. Queries get reformulated in terms of source schemas, based on mappings How WORKPADs Semantic Integration Works \ 1 E1E2E3 S1S2S3 C1 C2 C3 Wrapping Mapping Ontology Query: get C1 instances

5.Suitable sub-queries are propagated to wrapped sources 6.Consistency of local data is up to local DBMS 7.Updates are propagated through a publish-subscribe mechanism Peers subscribe updates on specific views (queries) Notifications may be used to optimize data access or raise alerts How WORKPADs Semantic Integration Works \ 2

Peer Configuration Ontology Ontology Protg Peer Configuration Peer Configuration Modeling Environment Peer Manifest Unique Identifier Services URLs Ontology URL Sources Sibling Peers Local and P2P Mappings The Ontology translated in DL-Lite (XML) Translation Log (details about translated, approximated and omitted ontology elements)

The user configures a peer by loading the systems ontology and mapping it with local databases

Novelty With state-of-the-art centralized systems, information integration is accomplished by a single schema (global view) which is statically mapped to information sources However, this would require every organization to rely on a single integration system and rigidly adopt the very same conceptualization In WORKPADs decentralized environment, on the contrary, each system (peer) acts both as source and mediator This gives the possibility to every system (organization) to keep its legacy and provide contributions to global knowledge in a flexible and yet controlled way

Lessons learned In many cases, mapping legacy sources to ontologies may be not very easy Development of rich conceptualizations, such as ontologies, cannot be entirely made at crisis time P2P conceptual mapping could be facilitated if based on semantic standards Information integration infrastructures for crisis management should be therefore prepared in advance for some extent

GEO-COLLABORATION

Motivations To offer operators location- awareness To offer operators location- awareness annotated with relevant information (coming from the integrated data) annotated with relevant information (coming from the integrated data) and the possibility of annotating back and disseminating the new knowledge and the possibility of annotating back and disseminating the new knowledge

Other features Enrichment of aerial photos with geographic features Enrichment of aerial photos with geographic features Real-time location indication of objects- and persons-of- interest Real-time location indication of objects- and persons-of- interest Real-time distribution of data input/modifications Real-time distribution of data input/modifications Interaction with layered geo-information on handheld devices Interaction with layered geo-information on handheld devices Creating and annotating relevant points-of-interests Dynamic updates of geo-information within WORKPAD front-end teams Dynamic updates of geo-information within WORKPAD front-end teams Querying and persisting into back-end systems Querying and persisting into back-end systems No need of central server for operation No need of central server for operation Decentral P2P-based information distribution Possible BE interaction with semantically integrated information from various sources Possible BE interaction with semantically integrated information from various sources

GIS component architecture Java EE based server + GeoServer Web Service stub to access BE Distributed tuple space- based information distribution J2ME based viewer/editor of SVG data

Lessons learned Presentation of geographic information is greatly appreciated A great part of coordination is location-based Currently mostly deployed on desktop machines Much conceptual contributions could be achieved to Mobile GeoCollaboration Long way from concept to implementation to product Evaluation based on research prototype is difficult Functionality is the first step, stability the second for acceptance Tradeoff between platform independence and device coverage (=Java) vs. performance (=native, Windows Mobile) Emulator real device discrepancy Pervasive computing: more (uncontrollable) variables (e.g. changing context factors, immaturity of technologies) Testing, testing, testing (in the wild in particular)

At a Glance

USER VALIDATION

Overview User Test Methodology User Test Methodology Online Pre-Tests Mock-ups and Questionnaires Controlled Experiments Cooperative Evaluation Test with External Users The WORKPAD Showcases The WORKPAD Showcases Without and with WORKPAD

User Test Methodology

User Test Methodology (2)

Controlled Experiments Lab environments under controlled conditions Lab environments under controlled conditions 2 parts: 2 parts: First: during Prague meeting for technical partners (English) Second: extra, bilateral meeting for users (Italian) Direct feedback given to technical partners responsible for the relevant components Direct feedback given to technical partners responsible for the relevant components

Cooperative Evaluation First real user tests with prototypes on mobile devices in the real-world context

Cooperative Evaluation: Summary of Results

First Showcase without WORKPAD In the scope of the 100th anniversary of the Messina earthquake event of PCRC In the scope of the 100th anniversary of the Messina earthquake event of PCRC Intention of the WORKPAD team: Intention of the WORKPAD team: Better understanding of real world activities Verifying if storyboards are feasible and realistic Become familiar with the showcase site Pentidattilo Practical issues (logistics, power, toilets etc)

The location

Second Showcase with WORKPAD Goal: Show and evaluate the prototypical implementation of the reference architecture proposed in the project WORKPAD One week of showcase User organisations Carpo Nazionale dei Vigili del Fuoco (VVF) The Fire Brigade Provincial Headquarters Corpo Nazionale Soccorso Alpino e Speleologico (CNSAS) Alpine Aid and Speleologic National Body Servizio di Urgenza ed Emergenza Medica (SUEM) Service of Urgency and Medical Emergency Croce Rossa Italiana (CRI) Italian Red Cross Europa Unita (EU) Voluntary organisation Confraternita Misericordia (CM) Voluntary organisation Four storyboards

The four storyboards SB1: Assessing an area SB2: Establishing a medical point SB3: Evacuation of people SB4: Configuration of the data integration

Some Results Metrics Metrics Time span, number of required assists, correct task outcome, number of errors Evaluation is based on task execution forms and interviews Evaluation is based on task execution forms and interviews Trial and real execution Trial and real execution For interesting conclusions: all mean values dropped meaning that users accustomed quickly

Current Modus Operandi vs. WORKPAD Improvements

Users Conclusions Active involvement of Protezione Civile both as institution and as individuals Active involvement of Protezione Civile both as institution and as individuals Satisfactory project results Satisfactory project results Impact of the project on actual procedures and workflows Impact of the project on actual procedures and workflows Willingness to further exploit project results in real everyday activity Willingness to further exploit project results in real everyday activity

CONCLUDING

Lessons Learned Innovative software solutions -- developed on top of reliable emergency communication infrastructures -- have the potential to improve emergency management Innovative software solutions -- developed on top of reliable emergency communication infrastructures -- have the potential to improve emergency management Coordination Integration of data and knowledge Geo-collaboration Users should be involved in research projects Users should be involved in research projects UCD approaches

Summary and Final Remarks Is a Net-centric approach to disaster risk management feasible? Yes If yes, what kind of R&D is needed ? In addition to communication infrastructures, software systems should be conceived, with disruptive approaches to the current way of working What features should the Future Internet have in order to support emergency management effectively ? Built-in support for mobile devices, high bandwidths also in case of ad-hoc networks To what extend multi-disciplinary research should be part of new projects ? Not an option, a must

advanced user interfaces + data integration + mobile process management = save yourself !! the...

Documents

workpad methodology

mobile devices workpad

shortterm recovery slide

teams process management

software applications

smart applications

operational knowledge

final system