data science popup austin: for the internet of things, the more things the merrier
TRANSCRIPT
![Page 1: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/1.jpg)
DATA SCIENCEPOP UP
AUSTIN
For the Internet of Things, the More Things the Merrier
John AkredFounder & CTO, Silicon Valley Data Science
BigDataAnalysis
![Page 2: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/2.jpg)
DATA SCIENCEPOP UP
AUSTIN
#datapopupaustin
April 13, 2016Galvanize, Austin Campus
![Page 4: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/4.jpg)
FOR THE INTERNET OF THINGS, THE MORE THINGS THE MERRIER
Data Science Pop-up in AustinJohn Akred, CTO
13 April 2016
![Page 5: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/5.jpg)
© 2016 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. @SVDataScience5
Silicon Valley Data Science transforms business through data science and engineering.
![Page 6: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/6.jpg)
@SVDataScience6
OUR TEAM
![Page 7: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/7.jpg)
@SVDataScience7
mor
e =
bette
r?
https://pixabay.com/static/uploads/photo/2015/05/25/05/27/network-782707_960_720.png
![Page 8: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/8.jpg)
© 2016 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.8
The Internet of Things (IoT) is the network of physical objects—devices, vehicles, buildings and other items—embedded with
• electronics, • software, • sensors, and • network connectivity
that enables these objects to collect and exchange data.
WHAT MAKES A THING AN IOT THING?
Source: https://en.wikipedia.org/wiki/Internet_of_Things "Internet of Things Global Standards Initiative". ITU. Retrieved 26 June2015.
![Page 9: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/9.jpg)
@SVDataScience9
A connected thing can do useful stuff for us, sometimes really useful.
http://arstechnica.com/science/2016/04/er-docs-get-heart-rate-info-from-fitbit-save-patients-life/
![Page 10: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/10.jpg)
@SVDataScience10
An ecosystem of connected things can do useful stuff for us too.
https://jawbone.com/blog/napa-earthquake-effect-on-sleep/
![Page 11: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/11.jpg)
@SVDataScience11
Value of Connected Devices
Single Device$100s/year
Device Network50% aggregate
demand
![Page 12: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/12.jpg)
@SVDataScience12
Hard Failure: If the data source is broken, so is the app.
Stovepipe: One-to-one relationship from data source to product.
Multi-sourced: Redundancy of overlapping data sources makes your products more resilient.
Graceful Degradation: If a data source breaks, there is a backup and your app continues to function.Production data services
abstract the probabilistic integration of overlapping data sources. We call this model a Data Mesh.
Why more = better? DATA RESILIENCY
![Page 13: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/13.jpg)
@SVDataScience
![Page 14: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/14.jpg)
@SVDataScience14
• Commuter rail between San Francisco and San Mateo and Santa Clara counties ~30 stations
• 118 passenger cars• 60% >=30 years old• 2014 weekday ridership is 52,019 people daily• On-time performance is about 92%• No reliable real-time status information• API outage between April 5th and June 2nd
![Page 15: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/15.jpg)
@SVDataScience15
![Page 16: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/16.jpg)
© 2016 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. @SVDataScience16
HOW DO WE KNOW IF THE TRAIN IS ON TIME?
![Page 17: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/17.jpg)
© 2016 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. @SVDataScience17
MISSING DATA?The departure data:• mostly “on time”• when significant delays
occur, they often appear suddenly
• often missing >10% per day• ~1 minute resolution
![Page 18: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/18.jpg)
© 2016 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. @SVDataScience18
AUDIO
![Page 19: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/19.jpg)
© 2016 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. @SVDataScience19
VIDEO DETECTION - FRAME ANALYSISNo Train Detected Train Detected
Ra
w Im
ag
e
(+R
OIs
)R
ela
tive
M
otio
n
(+R
OIs
)
![Page 20: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/20.jpg)
© 2016 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. @SVDataScience20
VIDEO
![Page 21: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/21.jpg)
© 2016 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. @SVDataScience21
SOCIAL MEDIA AS SENSOR
Baseline
![Page 22: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/22.jpg)
© 2016 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. @SVDataScience22
CALAMITY DETECTION IS ACCURATE
![Page 23: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/23.jpg)
© 2016 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. @SVDataScience23 20
THE MOST IMPORTANT SIGNAL
Where is the train right now?
![Page 24: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/24.jpg)
© 2016 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. @SVDataScience24
PREDICTION MODEL: NEURAL NETWORK
neural network prediction residuals
previous delay residuals
![Page 26: Data Science Popup Austin: For The Internet of Things, The More Things the Merrier](https://reader031.vdocuments.net/reader031/viewer/2022030306/586e73201a28ab99598b5381/html5/thumbnails/26.jpg)
DATA SCIENCEPOP UP
AUSTIN
@datapopup #datapopupaustin