![Page 1: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/1.jpg)
1
Analytics for IoT: From Sensors to Decisions
Tom Dietterich
Distinguished Professor
Oregon State University
![Page 2: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/2.jpg)
2
The Usual View of IoT
Materials
Devices
Systems
Receiver Transmitter
420 µm
650 µm
1000 µm
550 µm
Networks
Σ DSP Processing
TransducerArray
Variable Length Delay Line
N Channels
Receive Beamformer Channels
TS
TS
TS
TS
TS
TS
TGA
ProcessingElements
∆Σ-M
∆Σ-M
∆Σ-M
![Page 3: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/3.jpg)
3
Sensors123RF Limited
![Page 4: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/4.jpg)
4
Spatio-Temporal Analytics Hierarchy
Sensors123RF Limited
Cleaned Data
StateVariables
Trajectories
Events & Activities
Models
![Page 5: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/5.jpg)
5
Leadership in AnalyticsMachine Learning, Data Mining, Data Science
Hector Cotilla-SanchezTom DietterichAlan FernXiaoli FernThinh NguyenRaviv Raich
Scott Sanner (joining April 1)
Prasad TadepalliArash TermehchySinisa TodorovicWeng-Keen Wong
![Page 6: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/6.jpg)
6
Step 1: Data Cleaning and Imputation
o Detect bad data values and broken sensors
o Interpolate good data values as needed
Sensors
Cleaned Data
Broken Sun
Shield
![Page 7: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/7.jpg)
7
Step 2: Estimate State Variables
123RF Limited
o Location of each customero Location of each employeeo Total time customer in storeo # of items
Sensors
Cleaned Data
StateVariables
![Page 8: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/8.jpg)
8
Step 3: Record trajectories
123RF Limited
o Trajectory of each customero Trajectory of each employeeo Trajectory of instrumented item
Sensors
Cleaned Data
StateVariables
Trajectories
![Page 9: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/9.jpg)
9
Step 4: Event and Activity Recognition
123RF Limited
o Customer enters/exits storeo Employee enters/exits storeo Customer waiting at help desko Customer is looking for itemo Customer picks up itemo Customer puts item in basketo Customer leaves store with
unpaid merchandise
Sensors
Cleaned Data
StateVariables
Trajectories
Events & Activities
![Page 10: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/10.jpg)
10
Step 5: Predictive Models
123RF Limited
o Predict customer demand per item
o Predict customer traffico Predict supplier delayso Predict wholesale and retail
price trends
Sensors
Cleaned Data
StateVariables
Trajectories
Events & Activities
Models
![Page 11: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/11.jpg)
11
Bridging from Sensing to Action
Alert Sensor Needs Repair
Sensors
Cleaned Data
StateVariables
Trajectories
Events & Activities
123RF Limited
![Page 12: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/12.jpg)
12
Bridging from Sensing to Action
Enter Store
DB Update:Increment Visit
Count
Sensors
Cleaned Data
StateVariables
Trajectories
Events & Activities
123RF Limited
![Page 13: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/13.jpg)
13
Bridging from Sensing to Action
Alert: Employee to greet
customer
Alert: Employee to help
customer find item
Alert: Cashier needed Alert: Possible
shoplifting
Coupon Offer to cell phone
Sensors
Cleaned Data
StateVariables
Trajectories
Events & Activities
123RF Limited
![Page 14: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/14.jpg)
14
Offline AnalyticsStore Layout
pinch pointshot spotsdead spots
Employee trainingconversion ratecustomer satisfaction
Inventory and staffingmissed sales because
customer could not find itemmissed sales because out
of stockpredictive inventory
managementpredictive staffingwhat predicts customer time
in store?
![Page 15: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/15.jpg)
15
Beyond Retail:Personalized Medicine
StateVariables
Trajectories
Events & Activities
Patient state (glucose, heart rate, EKG)Current location
Trajectory travelledGlucose history
Unsteadiness, falls, breathing difficultiesheart attack, strokeRunning, walking, climbing stairs
ActionsMedical devicesSmart walkers; Exoskeletons
ModelsNormal state variables, gaitNormal events and activities
![Page 16: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/16.jpg)
16
Smart Buildings
StateVariables
Trajectories
Events & Activities
Room occupancy, CO2 levelTemperature, humidity, lightingExterior weather
State history
Holidays, Special eventsRepair work, cold snap, heat waveEnergy price changes
ActionsHVAC automationAdjust mix of energy sourcesTime-shift predictable loads
Models Building temperature in responseto external weather, HVAC controls
![Page 17: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/17.jpg)
17
Analytics for aResearch-to-Market IoT Center
Data Quality ControlComputer VisionModelingUser Interface and User ExperienceSecurity and PrivacySystem Executive and Control
![Page 18: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/18.jpg)
18
Technology Needs: Data CleaningSensor diagnosis – Detect known sensor failure modesAnomaly detection – Detect novel sensor failures Imputation: learn and apply historical models to interpolate
missing or damaged dataData management
People:o Tom Diettericho Alan Ferno Weng-Keen Wongo Xiaoli Ferno Raviv Raicho Arash Termehchy
![Page 19: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/19.jpg)
19
Technology Needs: Computer Vision Tracking
Pinch points Dead regions Hot spot detection
Event & activity recognition walking, standing, bending over,
looking down/up picking up item, setting down
item, placing item in basket, placing item in
bag/backpack/pocket waiting, browsing, searching for
something successfully finding item frustration, impatience shopping “mode” (“on a specific
mission”, “browsing”, “long list”) Face recognition Item recognition
People:o Sinisa Todorovico Alan Fern
![Page 20: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/20.jpg)
20
Technology Needs:ModelingDiscovering Interesting Patterns in
Data Integration with External Data
Sources Web site visits Purchase History Third Party Customer Models, Social
Networks Shopping Apps
Optimizing Where and When Real-Time Analytics are Computed
Data Management Interactive Information Visualization
People:o Weng-Keen Wongo Xiaoli Ferno Ron Metoyero Eugene Zhango Scott Sanner
![Page 21: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/21.jpg)
21
Technology Needs:User Interface/User ExperienceEmployee cuing (handheld? ear piece? smart watch?)Customer interaction via smart phone and kioskLong-term customer relationshipLong-term employee relationship
People:o Margaret Burnetto Chris Scaffidio Martin Erwig
![Page 22: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/22.jpg)
22
Technology Needs:Cybersecurity & PrivacyEncryptionQuery-Specific Differential PrivacySoftware Quality and Testing Intrusion and Advanced Persistent Threat DetectionAnomaly Detection
People:o Rakesh Bobbao Amir Nayyerio Attila Yavuzo Mike Rosulek
o Danny Digo Alex Groceo Tom Diettericho Alan Ferno Weng-Keen Wong
![Page 23: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/23.jpg)
23
Technology Needs:Control Executive / Integration
All components of the system must coordinate to ensureexcellent experience for the customerexcellent experience for employeesminimize costs (power, bandwidth, analysis)
Algorithms for controlOptimizationPlanningReinforcement Learning
People:o Ted Brekkeno Alan Ferno Prasad Tadepallio Tom Diettericho Thinh Nguyeno Yue Zhang
![Page 24: Analytics for IoT: From Sensors to Decisions Tom Dietterich Distinguished Professor Oregon State University 1](https://reader033.vdocuments.net/reader033/viewer/2022051415/56649dc65503460f94aba2bc/html5/thumbnails/24.jpg)
24
Oregon State AdvantagesTightly-integrated School of Electrical Engineering and Computer ScienceMany EECS collaborationsConsistent Federal funding
Strong entrepreneurial cultureCASS: Center for Applied Systems and SoftwareClose ties to College of Business via the Division of
Engineering and Business
Easy routes to collaboration with industry