A User Evaluation ofA User Evaluation ofVirtual Alabama Virtual Alabama

Steve HendersonSteve HendersonCity of Gulf Shores, ALCity of Gulf Shores, AL

GIS CoordinatorGIS Coordinator

OutlineOutline

►Background and MotivationBackground and Motivation►MethodologyMethodology►Study ParticipantsStudy Participants►Testing ScenariosTesting Scenarios►Analysis PlansAnalysis Plans►SignificanceSignificance

Background and MotivationBackground and Motivation► Hurricane Opal – 1995Hurricane Opal – 1995► Hurricane Danny – 1997Hurricane Danny – 1997► Hurricane Georges – 1998Hurricane Georges – 1998► Tropical Storm Isidore - 2002 Tropical Storm Isidore - 2002 ► Hurricane Ivan – 2004Hurricane Ivan – 2004► Hurricane Katrina – 2005Hurricane Katrina – 2005► BP Oil Spill - 2010 BP Oil Spill - 2010

► Collaboration with Auburn Collaboration with Auburn University to locate utility University to locate utility structures prior to a storm to structures prior to a storm to prevent damage afterwards prevent damage afterwards during the removal of storm during the removal of storm debris and sand.debris and sand.

► Needed a partner for data Needed a partner for data storage for small communities storage for small communities that did not have GIS software that did not have GIS software and hardware.and hardware.

► Alabama Department of Alabama Department of Homeland SecurityHomeland Security

► Virtual Alabama, an enterprise Virtual Alabama, an enterprise edition of Google Earthedition of Google Earth

► Gulf Shores Fire Rescue Dept.Gulf Shores Fire Rescue Dept.

► Needed geovisualization tools Needed geovisualization tools to support their roles in to support their roles in emergency management for emergency management for both routine and disaster both routine and disaster related activities.related activities.

Background and MotivationBackground and Motivation

Virtual AlabamaVirtual Alabama

► A desktop program for viewing of local data or data A desktop program for viewing of local data or data streamed from the internet in a 3D Globe visualization streamed from the internet in a 3D Globe visualization environment.environment.

► Initiated in 2005 by the Alabama Department of Initiated in 2005 by the Alabama Department of Homeland Security to create a common visualization Homeland Security to create a common visualization environment for sharing state and local geographic data environment for sharing state and local geographic data between emergency responders and decision makers.between emergency responders and decision makers.

► Can be downloaded from the internet and used for free Can be downloaded from the internet and used for free by state and local officials.by state and local officials.

► Securely connected to state servers to view data without Securely connected to state servers to view data without downloading it. Multiple levels of security are available.downloading it. Multiple levels of security are available.

► Can be set up to view data on a remote server by means Can be set up to view data on a remote server by means of a separate password controlled by the third party of a separate password controlled by the third party provider.provider.

Virtual AlabamaVirtual Alabama

Virtual AlabamaVirtual Alabama

Virtual Alabama Program Fact SheetVirtual Alabama Program Fact Sheet

Real time activities associated Real time activities associated with Virtual Alabama:with Virtual Alabama:

• Common operational pictureCommon operational picture• Emergency evacuation routingEmergency evacuation routing• Situational awareness/understandingSituational awareness/understanding• Vehicle and asset trackingVehicle and asset tracking• Critical infrastructure mappingCritical infrastructure mapping• Student densityStudent density• Identification of assets and Identification of assets and

vulnerabilitiesvulnerabilities• Visualization of risksVisualization of risks• Plume modeling and real time sensors Plume modeling and real time sensors

feedsfeeds• Implementation of protective measures Implementation of protective measures

during eventsduring events• Damage assessmentDamage assessment

MethodologyMethodology

► Test the usability of Virtual Alabama (VA) for Test the usability of Virtual Alabama (VA) for assisting the Gulf Shores Fire/Rescue assisting the Gulf Shores Fire/Rescue Department operations.Department operations.

►Develop prototypical tasks based on the stated Develop prototypical tasks based on the stated goals of the system. (VA Program Fact Sheet)goals of the system. (VA Program Fact Sheet)

► Employ heuristic evaluation (Nielsen, 1990) of Employ heuristic evaluation (Nielsen, 1990) of program interface following a task analysis program interface following a task analysis evaluation.evaluation.

MethodologyMethodology

►Develop four tasks of simulated incidents Develop four tasks of simulated incidents incorporating as many of VA goals as incorporating as many of VA goals as possible.possible.

►Measure success rate and time to complete Measure success rate and time to complete the tasks.the tasks.

► Prepare post-testing interview questions to Prepare post-testing interview questions to obtain qualitative feedback.obtain qualitative feedback.

Study ParticipantsStudy Participants

► City of Gulf Shores Fire/Rescue Department City of Gulf Shores Fire/Rescue Department personnel.personnel.

► Approximately five supervisory and at least Approximately five supervisory and at least 10 or more non-supervisors to participate.10 or more non-supervisors to participate.

► Pre-testing interview will collect data on Pre-testing interview will collect data on participants job duties and skills as well as participants job duties and skills as well as familiarity with information technology, familiarity with information technology, especially geovisualization tools.especially geovisualization tools.

Testing ScenariosTesting Scenarios

1.1. Emergency evacuation routingEmergency evacuation routing

2.2. Critical infrastructure mappingCritical infrastructure mapping

3.3. Identification of assets and Identification of assets and vulnerabilitiesvulnerabilities

4.4. Damage assessmentDamage assessment

Testing ScenariosTesting Scenarios► Initial view of the data showing City Facilities markers in the isolated Initial view of the data showing City Facilities markers in the isolated

area and colored polygons representing the areas likely to see storm area and colored polygons representing the areas likely to see storm surge from various hurricane categories. surge from various hurricane categories.

Testing ScenariosTesting Scenarios► The view as a user zooms into a particular facility to see if it lies The view as a user zooms into a particular facility to see if it lies

within the areas expected to experience storm surge. within the areas expected to experience storm surge.

Testing ScenariosTesting Scenarios► The view as a user places markers, identifies likely vulnerabilities The view as a user places markers, identifies likely vulnerabilities

and color codes markers to categorize facilities likely to see storm and color codes markers to categorize facilities likely to see storm surge damage. surge damage.

Testing ScenariosTesting Scenarios► After all of the facilities are identified and color coded, the user saves After all of the facilities are identified and color coded, the user saves

the markers into a KMZ file to email. the markers into a KMZ file to email.

Analysis PlansAnalysis Plans

► The average success rate of each task will be The average success rate of each task will be calculated. calculated.

► The average heuristic evaluations ratings and The average heuristic evaluations ratings and the user's opinions on which operations can be the user's opinions on which operations can be helped by VA will be calculated.helped by VA will be calculated.

► Tasks will be ranked to determine which type of Tasks will be ranked to determine which type of activities are best supported. activities are best supported.

SignificanceSignificance

► Evaluate usability test results to determine Evaluate usability test results to determine which tasks are well supported by VA.which tasks are well supported by VA.

► Incorporate well supported tasks into regular Incorporate well supported tasks into regular departmental training and response procedures departmental training and response procedures using VA to maintain familiarity.using VA to maintain familiarity.

► Use different tools/methods for activities that Use different tools/methods for activities that VA does not support well or recommend VA does not support well or recommend extensions or improvements to the current VA extensions or improvements to the current VA tools.tools.

Thanks to:Thanks to:► Gulf Shores Fire Rescue Department, especially Deputy Fire Chief Gulf Shores Fire Rescue Department, especially Deputy Fire Chief

Keith MartinKeith Martin

► Dr. Anthony Robinson – Academic AdvisorDr. Anthony Robinson – Academic Advisor

Questions?Questions?