emerging trends in crisis informatics
TRANSCRIPT
![Page 1: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/1.jpg)
Emergent Trends and Tools in Crisis Informatics
Adam PapendieckJan 30, 2014
![Page 2: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/2.jpg)
Objectives
1. Gain an understanding of key trends in ICT innovation which are influencing/disrupting crisis informatics.
2. Be able to trace these trends through discussions later this semester, and understand their influence and potential.
3. Introduce visualization lab
![Page 3: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/3.jpg)
Conventional, Centralized Info Management
Source: Harvard Humanitarian Initiative. Disaster Relief 2.0
![Page 4: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/4.jpg)
Crisis Information Ecosystem:Complex Adaptive System
• Some information needs are clear and structured.
• But the actual information ecosystems in emergencies are complex and changing rapidly.
• Individual technologies, information systems and their relationship to others are ephemeral, even in the short-to-medium term. They evolve.
![Page 5: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/5.jpg)
![Page 6: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/6.jpg)
Crisis Information Ecosystem:Complex Adaptive System
• Rapid, adaptive collaboration can be advantageous• complex adaptive systems are built upon feedback
loops• Shift from institutions to collaborations• Closed, rigid institutions Open, fluid cooperation
![Page 7: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/7.jpg)
![Page 8: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/8.jpg)
1/12/2
010
1/15/2
010
1/18/2
010
1/21/2010
1/24/2010
1/27/2
010
1/30/2
010
2/2/2010
2/5/2010
2/8/2010
2/11/2
010
2/14/2
010
2/17/2
010
2/20/2010
2/23/2010
2/26/2
010
3/1/2010
3/4/2010
3/7/2010
3/10/2
010
3/13/2
010
3/16/2
010
3/19/2
010
3/22/2
010
3/25/2
010
3/28/2
010
3/31/2010
4/3/2010
4/6/2010
4/9/2010
4/12/2
0100
100
200
300
400
500
600
Five most common categories of reports to the Ushahidi Haiti Crisis Map over the first 90 days
Food Shortage Shelter Needed Water Shortage Vital Lines Emergency
Reports
![Page 9: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/9.jpg)
Information Feedback Loop
![Page 10: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/10.jpg)
Data Capture
Curation
Analysis
Dissemination
Use
mon
ths,
yea
rs
min
utes
, wee
ksAgency effort, resources
Agency effort, resources
Value StreamConventional Emergent
Humanitarian Information Systems
![Page 11: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/11.jpg)
![Page 12: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/12.jpg)
Emergent ICT(Trends)
1. Improved Global Connectivity2. The Cloud3. Semantic Web and Open Standard4. Mobile5. Networks6. Data Mining
![Page 13: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/13.jpg)
http://www.submarinecablemap.com/
TREND: Improved Global Connectivity
Global Submarine Cables (2012)
![Page 14: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/14.jpg)
NSFNet (1986)
![Page 15: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/15.jpg)
![Page 16: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/16.jpg)
![Page 17: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/17.jpg)
Mobile Phone Subscribers per 100 Individuals
![Page 18: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/18.jpg)
TREND: The Cloud
• Centralization of computing power and standardization of data– Semantic Web, XML, APIs– Subscription-based “Software as a Service” (SaaS)
Source: http://resource.onlinetech.com/cloud-computing-prompts-2012-data-center-expansion-plans/
![Page 19: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/19.jpg)
Software as a Service (SaaS)
![Page 20: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/20.jpg)
TREND: Semantic web
• Old characteristics of the web: HTML, text, individual static web pages
• New characteristics: XML, APIs (Application Programming Interfaces), webservices, open standards, dynamic and interactive web pages
![Page 21: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/21.jpg)
TREND: Semantic web
• Augments information on web pages with machine-readable metadata and relationship information.
• Enables the “mashup”• Example tools: Yahoo pipes, Google API,
Calais, Yahoo Terms, Google Maps
![Page 22: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/22.jpg)
How Systems Communicate: XML
Other standard formats: JSON, RDF, CSV
![Page 23: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/23.jpg)
How Systems Communicate: APIs(Application Programming Interfaces)
![Page 24: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/24.jpg)
Yahoo Pipes
![Page 25: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/25.jpg)
![Page 26: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/26.jpg)
Mashups and Dashboards
![Page 27: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/27.jpg)
TREND: Mobile Computing
• Proliferation of thin clients (our various “screens”) to access cloud– API’s, XML etc.
• Sensor devices connected to the cloud– human sensors– internet of things– enables more continuous assessment across time
and geography than ever before
![Page 28: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/28.jpg)
Informed Human Sensors
![Page 29: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/29.jpg)
http://opendatakit.org/
http://www.amazonteam.org/index.php/193/Participatory_Ethnographic_Mapping_Mapping_Indigenous_Lands
![Page 30: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/30.jpg)
![Page 31: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/31.jpg)
Report 295: Buras, LA. 05/13/2010 “I have a sore throat and headache!!! And I can not go run my crab traps because my fishing grounds are closed, now for the 14th day..”
Report 1646: Plaquemines, LA. 08/02/2010 “While walking on a beach in an area heading toward South pass, we got stuck in 2 "baby" sinkholes of oil buried beneath the sand. We started poking the holeswith sticks and oil came oozing out. The first sinkholewas 4 feet wide and 6" deep. The second sinkhole was 2x2 diameter. The tide must be bringing in sand covering up the oil.”
Report 130: California Point, LA. 05/06/2010 Crabman out of work. “I have crabbed in the California Point area inside Breton Sound for well over 20 years. I also fish shad in this area and sell it for crawfish bait. I also shrimp seasonally. I am 52 years old and I am very concerned about the future of commercial fishing, my family responsibilities, my livelihood and way of life.”
![Page 32: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/32.jpg)
TREND 4: Social Networking
Proliferation of networking and collaboration tools
![Page 33: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/33.jpg)
Clay Shirky: Social Media makes Collaboration Efficient
• TV is uni-directional: we just consume.
• Social media is bi-directional: Participants produce and consume information
• This transition yields a “cognitive surplus”– All the time we used to spend consuming TV can
now be used for producing something new, together.
Clay Shirky: How Cognitive Surplus Will Change the World http://goo.gl/ZIgA
![Page 34: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/34.jpg)
So, what do we do with this surplus?
![Page 35: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/35.jpg)
The “Long Tail” of Contributors
![Page 36: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/36.jpg)
Institutions vs. Collaboration
![Page 37: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/37.jpg)
Crowdsourcing and Micro-tasking
![Page 39: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/39.jpg)
Collaborative, Community-driven and Open Source Development Models
• Depend upon:– feedback loops– some level of openness and sharing
![Page 40: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/40.jpg)
Crowdmap: SaaS for Crowdsourcing
![Page 41: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/41.jpg)
TREND: Data Mining
• Open data• Big Data– Our “digital exhaust”
• Emphasis on Trend Visualization– Dynamic– Info-graphics
![Page 42: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/42.jpg)
Open Data
• Standardized formats, APIs• Share, Share Alike– CRED EM-DAT– World Bank http://data.worldbank.org– USG– Ushahidi
![Page 43: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/43.jpg)
Big Data• web logs• sensor networks (e.g. mobile phones, RFIDs)• social networks (who’s connected to who)• social data (what’s being shared and generated)• teaching and learning management systems• financial transaction data and large-scale e-commerce• Internet text and documents• Internet search indexing• call detail records• military surveillance; • medical records; • photography archives; • video archives;• astronomy, atmospheric science, genomics, biogeochemical, biological, and
other complex and/or interdisciplinary scientific research;
![Page 44: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/44.jpg)
Importance of Innovation in Data Visualization/Analysis
• Time, energy and resources are moving from data collection & curation to data interpretation & use.
What information consumes is rather obvious: it consumes the attention of its recipients. Hence a wealth of information creates a poverty of attention, and a need to allocate that attention efficiently among the overabundance of information sources that might consume it.
(Herb Simon, quoted in Scientific American, 2005)
![Page 45: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/45.jpg)
Bengtsson, L., Lu, X., Thorson, A., Garfield, R., & Schreeb, J. von. (2011). Improved Response to Disasters and Outbreaks by Tracking Population Movements with Mobile Phone Network Data: A Post-Earthquake Geospatial Study in Haiti. PLOS Med, 8(8), e1001083. http://doi.org/10.1371/journal.pmed.1001083
![Page 46: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/46.jpg)
FluTrends Video & Website: http://goo.gl/ZcgVSource Paper: http://goo.gl/nMFvDz
Google Flu Trends
![Page 47: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/47.jpg)
Global Pulse Research Case Studies
Cases: 1. Commodities E-Index: http://goo.gl/tzCb0z2. Twitter & Crisis Stress: http://goo.gl/LVPtf3. Unemployment & Social Media: http://goo.gl/RuRTb
Questions4. How were things done before?5. How is big data visualization being used to do things
differently or add something new?6. Strengths, weaknesses, opportunities?
![Page 48: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/48.jpg)
Bread Index based on online pricing information
Source: UN Global Pulse
![Page 49: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/49.jpg)
Source: UN Global Pulse
Twitter and Crisis-related Stress
![Page 50: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/50.jpg)
Social Media and Unemployment
Source: UN Global Pulse
![Page 51: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/51.jpg)
Open and Big Data will Require Protection Measures
Source: Big Data, Communities and Ethical Resilience: A Framework for Action (PopTech Fellows) http://goo.gl/LAKrjF
![Page 52: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/52.jpg)
Interactive Data Visualization Lab
Background for Lab Exercises
![Page 53: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/53.jpg)
Two Parts
1. Individual Assignment - Today– Get to know software and data site– Get started with independent work – Due Wed
2. Group Synthesis – Next week– Expand on visualization types, data, tools– Integrate with RLP
![Page 54: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/54.jpg)
Visualization Lab Exercise
• On Blackboard:– All instructions, links and submission details• http://goo.gl/eZlh8z
– Visualization Lab Discussion Forum is for asking questions and posting data and other resources. • http://goo.gl/1VFHX6
![Page 55: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/55.jpg)
Next time: Visualization Tools
• End-user cloud databases and services– Google Maps, Google Spreadsheets, – Zoho Creator
• Visualization APIs and Kits for the web– D3, MIT Simile Project
• Web-based end-user geodata and mapping platforms– Geocommons
• Web-based dynamic visualization platforms:– IBM Many Eyes– Infogr.am
• Desktop platforms for creating dynamic visualization– Tableau (Windows only, OSX soon)
![Page 56: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/56.jpg)
• Big Data open to the public– http://
www.quora.com/Data/Where-can-I-find-large-datasets-open-to-the-public
![Page 57: Emerging Trends in Crisis Informatics](https://reader035.vdocuments.net/reader035/viewer/2022062412/58730be51a28ab99088b6d67/html5/thumbnails/57.jpg)
Caveats
• Awareness of privacy / security is importany• Protect your data! – Keep an eye on your escape hatch– Use open, established standards
• Limits: query rate and database size• Attribution/Fair Use• Engage the tools but be critical– Pay attention to utility and face validity