© copyright by renee wy chow (2005) 1 sy de 542 eid for social systems march 28, 2005 r. chow...
TRANSCRIPT
![Page 1: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/1.jpg)
© Copyright by Renee WY Chow (2005)
1
SY DE 542
EID for Social Systems
March 28, 2005
R. ChowEmail: [email protected]
![Page 2: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/2.jpg)
© Copyright by Renee WY Chow (2005)
2
EID for technical systems
• Nuclear power generation • Conventional (fossil fuel) power generation • Petrochemical processing • Medicine • Aviation
• Network management
![Page 3: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/3.jpg)
© Copyright by Renee WY Chow (2005)
3
EID for social systems
Some examples:• Book House (Pejtersen, 1992)
• HyperErgo (Xu, Dainoff, Mark, 1999)
• Dirty Dog (Burns, Proulx, 2001)
But consider Self-Paced vs. Event-Driven environments …
![Page 4: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/4.jpg)
© Copyright by Renee WY Chow (2005)
4
Emergency Ambulance Dispatching
• Event-driven (dynamic)• Human-human coordination
• High Social Value• Time critical• Safety critical• Large problem spaces• Uncertainty• Expertise
![Page 5: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/5.jpg)
© Copyright by Renee WY Chow (2005)
5
Purpose
• Can Ecological Interface Design support real-time resource management in emergency ambulance dispatching?
Motivation applied: Emergency Medical Services
under strain basic: (Ecological) Interface Design for
dynamic, primarily social work domains
![Page 6: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/6.jpg)
© Copyright by Renee WY Chow (2005)
6
• area serviced: 580 km2
• population serviced: 2.5 M (+1.5 M weekday)• 36 ambulance stations in 4 quadrants• 15-20 ambulances per quadrant at any time• ~ 12 calls per quadrant per hour, 8 responses,
5 transports• Operations: mixed fleet of ALS, BLS, ERUs• Communications: call receivers, dispatchers,
hospital destination coordinators, supervisors
Metropolitan Toronto Emergency Medical Services (TEMS)
![Page 7: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/7.jpg)
© Copyright by Renee WY Chow (2005)
7
EMS Response
Caller Operator (911)
Call Receiver (EMS)
Dispatcher (EMS)
<= 0:45
<= 1:15Paramedics (EMS)
Alphas: <=20:59Bravos: <=10:59Charlies,
Deltas, Echos: <= 8:59
LocationProblemPriority
Unit
![Page 8: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/8.jpg)
© Copyright by Renee WY Chow (2005)
8
Project Activities
Field Studycurrent problemscurrent solutions
Work Domain Analysis information requirements
InterfaceDesign
interfacespecifications
SimulatorNeeds
Assessment
simulatorrequirements
Interface Evaluation researchfindings
interface / simulator issues
SimulatorTesting
IntegratedTesting
InterfaceTesting
![Page 9: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/9.jpg)
© Copyright by Renee WY Chow (2005)
9
Field Study 118 hours in communication centre
spanning 11 shifts 10 key dispatchers (0.75-20 yrs. of experience) 23 dispatch personnel in total (call receivers, other
dispatchers, hospital coordinators, 1desk)
24 hours on rideouts two 12-hour shifts ALS (19/25 yrs exp): 7 responses, 4 transports BLS: (0.75/2 yrs exp): 6 responses, 5 transports
![Page 10: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/10.jpg)
© Copyright by Renee WY Chow (2005)
10
Information Requirements:The Decomposition Hierarchy
City Toronto
Quadrants NW, SW, NE, SE
Station Areas #10, 11, … 39
Units Ambulance Units
Emergency Response Units
Hospitals
Patients
Components Trucks, Jeeps
Paramedics
coarse
fine
![Page 11: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/11.jpg)
© Copyright by Renee WY Chow (2005)
11
Info Req’ts: The Abstraction HierarchyRisks: patients vs Resources: ambulances
FP Threat to Public Health
(Over / Under- Utilization)
Vs Protection of Public Health
(Appropriate Utilization)
AF Death / Deterioriation
(late response,
poor resource match)
vs Survival / Improvement
(on-time response,
good resource match)
GF Priority
(alpha … echo)
Mobility
(ambulatory, stretcher-bd)
vs Response
(avail, to-scene, at-scene …)
Transport
(avail, to-dest, at-dest …)
PFu Injury / Disease
(breathing problem, fall …)
vs Skill (advanced / basic)
Transfer Capacity (stretcher?)
PFo Locations, Identities vs Locations, Identities
![Page 12: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/12.jpg)
© Copyright by Renee WY Chow (2005)
12
Information Requirements:The Abstraction Hierarchy (cont’d)
Risks: priority posts
FP Threat to Public Health
(Effective vs. Ineffective Utilization)
AF Death / Deterioration of Potential Patients
(post coverage)
GF Post Priority
(key vs. non-key)
PFu Post
(1-16)
PFo Post Locations
![Page 13: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/13.jpg)
© Copyright by Renee WY Chow (2005)
13
Information Availability: Summary
City Quadrants Station Areas
Units
FP x x x x
AF x x x x
GF / x
PFu
PFo
![Page 14: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/14.jpg)
© Copyright by Renee WY Chow (2005)
14
Key Design Opportunities• Feedback at High Levels of Abstraction
– response times in relation to targets for each priority (AF-U)– resource utilization (FP-U, FP-Q/C)– resource availability (FP-Q/C)
• Feedback at High Levels of Aggregation– average response times for quadrant or city (AF-Q/C)– 90th percentile of response times for quadrant or city (AF-Q/C)
• Coverage– different levels of coverage (i.e., advanced vs. primary) for a
priority post (AF-S)– number or percentage of priority posts covered (AF-Q/C)
![Page 15: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/15.jpg)
© Copyright by Renee WY Chow (2005)
15
Current Utilization Display(AF, All AH levels for Posts)
![Page 16: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/16.jpg)
© Copyright by Renee WY Chow (2005)
16
Historic Utilization Display (FP)
![Page 17: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/17.jpg)
© Copyright by Renee WY Chow (2005)
17
Current Response Times Display(AF, GF)
![Page 18: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/18.jpg)
© Copyright by Renee WY Chow (2005)
18
Historic Response Times Display(AF)
![Page 19: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/19.jpg)
© Copyright by Renee WY Chow (2005)
19
New Interface - Overview
![Page 20: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/20.jpg)
© Copyright by Renee WY Chow (2005)
20
Interface Evaluation• 2 pilot subjects
– supervisors / trainers– training, practice, reduced test scenarios
• 8 “actual” subjects– 0.75-27 years as dispatcher (mean=9.8 years)– 0.75-5 years using existing interface (mean=3.3 years)
• Training session – 90 min. Tutorial + Quiz
• Practice sessions – 60 min. structured + 120 min. free-form
• Test sessions – 60 min. x 2 sessions x 2 interfaces)
![Page 21: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/21.jpg)
© Copyright by Renee WY Chow (2005)
21
Interface EvaluationPerformance Measures
• Response Times (19 incidents over 2 scenarios)
• Assignment Times (25 incidents over 2 scenarios)
• Effectiveness – % of Deltas given Advanced Care (11 incidents over 2 scenarios)
• Efficiency – % of Alphas given Primary Care (4 incidents over 2 scenarios)
• Coverage (at PPs) (4 posts)
• Utilization– total time providing response, coverage, and patient care (2 hours)
NO significant differences between display conditions
![Page 22: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/22.jpg)
© Copyright by Renee WY Chow (2005)
22
• For 3 of 4 displays (except CU), most participants agreed that the displays had helpful content
• For 3 of 4 displays (except CU), most participants agreed that the displays had logical structure
• For 4 of 4 displays, most participants agreed that displays were easy to use
• 7 of 8 participants would prefer to have the new displays
Interface EvaluationSubjective Ratings
![Page 23: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/23.jpg)
© Copyright by Renee WY Chow (2005)
23
Order of Preference• Current Response Times >• Historic Utilization >• Current Utilization (Priority posts vs. Assigned units) >• Historic Response Times
NASA TLX Subjective Workload• No significant interface effect• Marginally significant order effect (p=0.07 based on
sign test) – workload higher for 2nd interface
Interface EvaluationSubjective Ratings / Rankings
![Page 24: © Copyright by Renee WY Chow (2005) 1 SY DE 542 EID for Social Systems March 28, 2005 R. Chow Email: chow@mie.utoronto.cachow@mie.utoronto.ca](https://reader030.vdocuments.net/reader030/viewer/2022032605/56649e845503460f94b85e7c/html5/thumbnails/24.jpg)
© Copyright by Renee WY Chow (2005)
24
Interface EvaluationDiscussion
• Key contributors to dispatcher acceptance:– relevance to current / future decisions– relevance to own scope of authority and
responsibility
• Key barriers to dispatcher acceptance:– screen real estate– view control– potential stress