leveraging artificial intelligence and big data to create value...leveraging artificial intelligence...

60
Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence and Analytics Anheuser-Busch Professor of MIS, Entrepreneurship & Innovation Professor of Computer Science Eller College of Management Email: [email protected] Dr. Sudha Ram August 19, 2020 EROSS-2020

Upload: others

Post on 29-Sep-2020

18 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

Leveraging Artificial Intelligence and Big Data to Create Value

Director, INSITE Center for Business Intelligence and Analytics

Anheuser-Busch Professor of MIS, Entrepreneurship & Innovation

Professor of Computer Science

Eller College of Management

Email: [email protected]

Dr. Sudha Ram

August 19, 2020EROSS-2020

Page 2: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

BIG DATA: From Petabytes to ZettaBytes

2

Page 3: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

Meaning of “BIG”

Page 4: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

Meaning of “BIG”

Page 5: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

5

Big Data – Traditionally Defined

VOLUME VARIETY

VELOCITYVERACITY

VALUE

Page 6: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

Diverse Sources of Data

Many Different Sources generating Data

Page 7: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

An Internet Minute

Page 8: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

PARADIGM SHIFT

PARADIGM SHIFT!“Datafication” of the

world

Sensors embedded in Physical Objects

IP Protocol based communication

Page 9: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence
Page 10: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

Health Internet of Things

Page 11: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

Paradigm Shift

Temporal and Spatial Dimensions

Billions of Users and Objects

Leaving Massive Traces of Activity

“Laboratory” for understanding the pulse

of humanity

Page 12: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

12

QUEST for the HOLY

GRAIL

Predicting the Future

Page 13: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

13

INSITE Center for Business Intelligence and Analytics

• Interdisciplinary Research Center at University of Arizona

• www.insiteua.org

Page 14: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

14

Creating a Smarter/Better World• Data Science and Network Science• Visualizations Using Time and Space• Scalable techniques for network analysis and graph mining• Predictive Modeling • Train students in Data science• Work on interesting research projects with industry partners to

solve real world problems

Page 15: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

15

RESEARCH PROJECTS• Health Care• Education• News Media/Journalism• Crowdfunding• Crowdsourcing• Internet of Things and Wearable devices• Social Media

SOCIAL IMPLICATIONS

Page 16: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

16

Leveraging Data Science• Define a problem/challenge• Identify signals • Use data science methods • Solve the problemRepurposing

Data is Key

Page 17: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

17

PREDICTION MODELSPredict Emergency Department Visits in near Real Time

Using Big Data

Freshman Retention Prediction

COVID-19 Research

Page 18: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

18

Leverage Big dataBig Data not just about volume

• Social media

• Internet search

• Environmental sensors

• Wearable sensors

• Spatial and Temporal Dimensions

• Fine Grained - Spatial/Temporal

Page 19: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

19

Focus on Asthma• 25 million people affected in the United States

• 2 million emergency department (ED) visits

• 0.5 million hospitalizations

• 3,500 deaths

• 50 billion dollars in medical costs annually

• 11 million missed school days every year

• 14 million missed work days every year

Source: CDC Reports (2011, 2012)

Page 20: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

20

Pediatric asthma ER Visits, USA, 2011

Page 21: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

21

Our Research ObjectiveDevelop Robust Models to predict Asthma Related Emergency Department Visits in near Real Time Using Big DataPartner: Parkland Center for Clinical InnovationJoint work with Wenli Zhang, Dr. Yolande Pengetenze, Max Williams, funded in part by Parkland Center for Clinical Innovation

Page 22: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

22

Leverage Big dataBig Data not just about volume

• Social media

• Internet search

• Environmental sensors

• Wearable sensors

• Spatial and Temporal Dimensions

• Fine Grained - Spatial/Temporal

Page 23: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

23

EXTRACTING SIGNAL from Noisy DataTrue asthma related tweets Not actually related to asthma

Page 24: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

24

Asthma Related Tweets

Page 25: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

25

Asthma Related Tweets

Page 26: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

26

Asthma Keywords

Asthma

Inhaler

Sneezing

Runny Nose

Wheezing

Page 27: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

27

Asthma Keywords

Asthma

Inhaler

Sneezing

Runny Nose

Wheezing

Page 28: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

28

Asthma-Related Stream

Twitter Asthma Stream - United States

Asthma related tweets, United States, (Asthma stream, 11 Oct, 2013 – 31 Dec, 2013)

Page 29: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

29

Extracting Signals

1. Tweets indicating awareness of disease, E.G., “Hope I don’t get an asthma attack again today..”

2. Using disease as rhetoric, e.G., “He is so cute I think I got asthma”

Distinguish tweets that are relevant to asthma from tweets that mentioned asthma in an irrelevant context.

Page 30: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

30

Emergency Room Visits and Tweets

Page 31: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

31

Air Quality Sensor Data• Identify and include AQI data from a specific

geographic region.

• Collected pollution data from 27 air quality sites around the Dallas area.

• Selected sites closest to the zip codes of the ED asthma patients in our ED visits dataset. Using this data, we calculated daily average AQI for our model.

Page 32: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

32

Pollutants• CO: Carbon monoxide• NO2: Nitrogen dioxide • O3: Ozone • Pb: Lead• PM2.5: Atmospheric particulate matter, diameter of 2.5 micrometres

or less • PM10: Atmospheric particulate matter, diameter of 10 micrometres

or less • SO: Sulfur monoxide

Page 33: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

33

EPA Pollution Sensor Data and Emergency Visits

Page 34: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

34

Prediction Models Using Streaming Data

• Air Quality Sensor data streams• Tweets• Google Trends search data• Machine Learning Techniques to predict

number of ED visits per day with high accuracy

Page 35: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

35

Best Predictors

Successfully predicted with 80% accuracy

• # of asthma tweets

• CO

• NO2

• PM2.5

Page 36: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

36

USEFUL for Public Health NOTIFICATION

I. Epidemiologic surveillance of asthma disease activity in the community, e.g., the department of health and human services (DHHS)

II. Stakeholders notifications of community-level asthma-disease activity and risk factors

Page 37: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

37

Hospital/ED Preparedness

Predicting asthma ED visits and staffing ED consequently

Page 38: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

38

Targeted Patient InterventionsTargeted patient interventions using patient address and geo-localization data for tweets. E.g., patient alerts about asthma risks and counseling for preventive methods.

Page 39: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

39

ContributionsPromising ResultsDemonstrate the utility and value of linking big data from diverse sources in developing predictive models for non-communicable diseasesSpecific focus on asthmaRelevant for other chronic conditions – Diabetes, Cardiac problems, Obesity

Page 40: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

40

Internet of Things and Big Data

Big Data for Improving EducationInternet of Things: Smart Cards, WifiLogs, Mobile Apps

Page 41: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

41

BUILDING A SMARTER CAMPUS

Page 42: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

Combining Network Science and Machine Learning

42

Societal Challenge: Student RetentionProactive Prediction is very ImportantSocial Science theories indicate:• Social Interactions• Regularity of Routine

Page 43: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

ObjectivePredict freshman retention at individual levelMake proactive prediction before knowing first term GPALearn students’ behavioral patterns from their CatCardtransactionsProvide actionable suggestions for retention management

Page 44: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

BIG DATAInstitutional Student Dataset

~ 7000 full-time registered freshmen, 6500 are left after removing international students for whom SAT scores or high school GPAs were not available479 (7.37%) drop-out after Fall and 843 (12.98%) drop-out at the end of Spring

SmartCard Transaction Dataset1.8 million transactions made by freshmen from Aug 2012 thru May 2013271 different locations include restaurants, vending machines, printers, parking, labs.

Page 45: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

Behavior and Interactions

Page 46: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

46

Patterns and Differences

Page 47: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

Movement and Behavior

Page 48: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

COMPUTATIONAL and NETWORK SCIENCE APPROACH

Fills gaps in behavioral and extant data-driven approachesNew prediction approach

CatCard transactions implicit social networks and spatial sequences

Proactive predictionPredicting retention beforethe end of 1st semester with 90% recall

Page 49: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

COVID-19 Related Research Projects

49

Page 50: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

What is Contact Tracing?Digital vs. Manual Methods Three Different methods

a. Manual contact Tracingb. Manual with Digital assistance from Prompted Mobility Pathway

aka Memory Joggerc. Digital: BlueTooth App for exposure notification

50

Page 51: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

51

Page 52: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

Memory Jogger using Wifi Logs

Page 53: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

Working with Jeremy Frumkin, Research and Discovery Technologies

Using Wifi network logs with Catcard data to support strategic efforts related to congestion tracking on campus and managing campus foot traffic

Understanding Movement Patterns among Campus spacesComplementing app-based and manual contact tracing efforts with

the additional insights that can be gained through the wifi logs.Design a Memory Jogger – prompted Mobility pathway tool to

enhance manual contact tracing

53

Page 54: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

Traffic/Crowd Analysis

Select Date: Feb 3, 2020

Time 8 am-9 am

Building

User types

Traffic on campus between8am and 9amTop ten traffic spots visualized and compared with selected building (in red)

Comparison of hourly Traffic in selected building

Page 55: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

To compare the three methods for Contact Tracing and Exposure notification. How do the three contact tracing approaches differ in their outcomes such

as timeliness and coverage of contacts and other metrics? How do these methods complement each other and what are their relative

strengths and weaknesses? How do these methods perform overall in preserving privacy while allowing

for comprehensive contact tracing? What are the tradeoffs? How acceptable are these three strategies to the community and what is

an effective path to deploying comprehensive contact tracing?

55

Page 56: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

56

Some General Lessons

• Need for complex techniques? • Is causality really necessary for prediction?• What level of accuracy is good?• Working with your stakeholders is important• Research is very important in training next

generation scientists, end users, students, others

Page 57: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

57

Some General Lessons• Focus on defining the problem carefully • Out of the Box thinking• Big Data: Don’t think of it as a single very large dataset • Repurpose and combine different types of data• Exploit the granularity of data especially the spatial and

temporal features: Machine learning and network science

• Extracting Signal from Noise

Page 58: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

Good News

58

McKinsey in 2015: predicted that by 2020 the number of data science jobs in the United States alone will exceed 500,000, but there will be fewer than 200,000 available data scientists to fill these positions. Globally, demand for data scientists was projected to exceed supply by more than 50 percent by 2020.

IBM today: Annual demand for the fast-growing new roles of data scientist, data developers, and data engineers will reach nearly 700,000 openings by 2020.

Page 59: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

59

CONCLUSION

• PARADIGM SHIFT• BIG DATA HAS A LOT OF HIDDEN VALUE• LET’S LEVERAGE IT USING AI TO CREATE A

BETTER WORLD!

Page 60: Leveraging Artificial Intelligence and Big Data to Create Value...Leveraging Artificial Intelligence and Big Data to Create Value Director, INSITE Center for Business Intelligence

60

QUESTIONS??

TEDx Talk:

http://tedxtucson.com/portfolio/sudha-ram/www.insiteua.org

Email: [email protected]: @sudharam