technical computing camp 2018

67
1 © 2015 The MathWorks, Inc. Are you ready for AI? Is AI ready for you? Gareth Thomas Technical Computing Camp 2018

Upload: others

Post on 24-Oct-2021

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Technical Computing Camp 2018

1© 2015 The MathWorks, Inc.

Are you ready for AI?

Is AI ready for you?

Gareth Thomas

Technical Computing

Camp 2018

Page 2: Technical Computing Camp 2018

2

Alexa –

Write my TCC

keynote for me

Page 3: Technical Computing Camp 2018

3

Alexa –

Play soothing jazz

Page 4: Technical Computing Camp 2018

4

Source: Gartner, Real Truth of Artificial Intelligence by Whit Andrews

Presented at Gartner Data & Analytics Summit 2018, March 2018

Page 5: Technical Computing Camp 2018

5

Source: Gartner, Real Truth of Artificial Intelligence by Whit Andrews

Presented at Gartner Data & Analytics Summit 2018, March 2018

Page 6: Technical Computing Camp 2018

6

Page 7: Technical Computing Camp 2018

7

Page 8: Technical Computing Camp 2018

8

Artificial Intelligence

The capability of a machine to imitate

intelligent human behavior

Page 9: Technical Computing Camp 2018

9

Artificial Intelligence

The capability of a machine to match or exceed

intelligent human behavior

Page 10: Technical Computing Camp 2018

10

Artificial Intelligence Today

The capability of a machine to match or exceed

intelligent human behavior

by training a machine to learn the desired behavior

Page 11: Technical Computing Camp 2018

11

There are two ways to get a computer to do what you want

Traditional Programming

COMPUTER

Program

Output

Data

Program

Data

Page 12: Technical Computing Camp 2018

12

There are two ways to get a computer to do what you want

Machine Learning

COMPUTERProgram

Output

Data

Page 13: Technical Computing Camp 2018

13

There are two ways to get a computer to do what you want

Machine Learning

COMPUTERModel

Output

Data

Artificial Intelligence Machine Learning

Page 14: Technical Computing Camp 2018

14

Are you ready for AI?

Data

Model

Output

Page 15: Technical Computing Camp 2018

15

Are you ready for AI?

Data

Model

Output

Page 16: Technical Computing Camp 2018

16

Are you ready for AI?

Data

Model

Output

Access Data

Analyze Data

Page 17: Technical Computing Camp 2018

17

Are you ready for AI?

Data

Model

Output

Access Data

Analyze Data

Develop

Deploy

Page 18: Technical Computing Camp 2018

18

Are you ready for AI?

EVERYTHING

ELSE

Data

Model

Output

Access Data

Analyze Data

Develop

Deploy

Page 19: Technical Computing Camp 2018

19

Are you ready for AI?

DevelopAnalyze DataAccess Data Deploy

Data

Model

Output

AI model

Modeling &

simulation

Algorithm

development

Page 20: Technical Computing Camp 2018

20

Develop

AI model

Modeling &

simulation

Algorithm

development

Are you ready for AI?

Data

exploration

Preprocessing

Analyze Data

Domain-specific

algorithms

Sensors

Files

Access Data

Databases

Deploy

Page 21: Technical Computing Camp 2018

21

Are you ready for AI?

Develop

Data

exploration

Preprocessing

Analyze Data

Domain-specific

algorithms

Sensors

Files

Access Data

Databases

Desktop apps

Enterprise

systems

Deploy

Embedded

devices

AI model

Modeling &

simulation

Algorithm

development

Page 22: Technical Computing Camp 2018

22

Do you need AI?

Page 23: Technical Computing Camp 2018

23

Page 24: Technical Computing Camp 2018

24

AI for Predictive Maintenance

• Measure the wear of each robot

• Predict and fix failures before they happen

• AI handles uncertainty and variability

Page 25: Technical Computing Camp 2018

25

Are you ready for AI if …

You’ve never used machine learning?

Page 26: Technical Computing Camp 2018

26

Page 27: Technical Computing Camp 2018

27

What is crispiness?

Crispy

Crushing Sound

+Crispy Enough

Soggy

=Crushing Force

Page 28: Technical Computing Camp 2018

28

Replicating human perception with machine learning

Technical University of Munich

Feature extraction Classification

Crispy

Crispy enough

Soggy

Data

Machine Learning Workflow

Page 29: Technical Computing Camp 2018

29

Replicating human perception with machine learning

Technical University of Munich

Classification Learner

Page 30: Technical Computing Camp 2018

30

Fresh

Soggy

SoggyFresh

Tru

e C

las

s

Predicted Class

93%

91%

91%

91%

89%

95%

Page 31: Technical Computing Camp 2018

31

Are you ready for AI if you’ve never used machine learning?

No experience required

Use apps to try out all possible models

Use domain expertise and familiar tools to prepare data

Page 32: Technical Computing Camp 2018

32

Are you ready for AI if …

You can’t identify features in your data?

Page 33: Technical Computing Camp 2018

33

Use deep learning to identify features automatically

Feature extraction Classification

Crispy

Crispy enough

Soggy

Data

Machine Learning Workflow

Page 34: Technical Computing Camp 2018

34

Use deep learning to identify features automatically

Feature extraction Classification

Crispy

Crispy enough

Soggy

Data

Machine Learning Workflow

Crispy

Crispy enough

Soggy

Deep neural network

95%

3%

2%

..

.…

Data

Deep Learning Workflow

Page 35: Technical Computing Camp 2018

35

Page 36: Technical Computing Camp 2018

36

Page 37: Technical Computing Camp 2018

37

Traditional Approach

• Geologists assess seven different metrics

• Can take hours to analyze one site

• Critical shortage of geologists

New Approach

• Use deep learning to automatically

recognize metrics based on images

• On-site evaluators decide with support

from deep learning

Page 38: Technical Computing Camp 2018

38

Efficient tunnel drilling with deep learning

Obayashi Corporation

Label each

sub-image

Split into

sub-images

Image

Weathering

Alteration

(1-4)

Fracture

Spacing

(1-5)

Fracture

State

(1-5)

3 3 2

4 1 1

2 3 2

3 3 2

⋮ ⋮ ⋮ ⋮

Page 39: Technical Computing Camp 2018

39

Efficient tunnel drilling with deep learning

Obayashi Corporation

AlexNetPRETRAINED MODEL

Ice cream Teapot Goose

Transfer learning

Custom Network

Page 40: Technical Computing Camp 2018

40

MATLAB Production Server

Efficient tunnel drilling with deep learning

Obayashi Corporation

Weathering alteration: 4

Fracture spacing: 3

Fracture state: 2

AlexNetPRETRAINED MODEL

Ice cream Teapot Goose

Transfer learning

87%

69%

89%

Custom Network

Page 41: Technical Computing Camp 2018

41

Are you ready for AI if you can’t identify features in your data?

Deep learningDeep learning in 5 lines of code

nnet = alexnet;

cam = webcam;

picture = snapshot(cam);

picture = imresize(picture,[227 227]);

label = classify(nnet, picture)

Page 42: Technical Computing Camp 2018

42

Are you ready for AI if you can’t identify features in your data?

Deep learning

Transfer learning

Page 43: Technical Computing Camp 2018

43

Are you ready for AI if you can’t identify features in your data?

Deep learning

Transfer learning

Automation and AI to label data

Point cloud semantic segmentation

Classification

Car

Truck

Ground

Background

Page 44: Technical Computing Camp 2018

44

Are you ready for AI if you can’t identify features in your data?

Deep learning

Transfer learning

Automation and AI to label data

Point cloud semantic segmentation

Classification

Car

Truck

Ground

Background

Page 45: Technical Computing Camp 2018

45

Are you ready for AI if …

If you don’t have the right data?

Page 46: Technical Computing Camp 2018

46

AI for Predictive Maintenance

• Measure the wear of each blade

• Predict and fix failures before they happen

• Can’t rely on failures in the field

Page 47: Technical Computing Camp 2018

47

Predictive maintenance with synthetic failure data with

MATLAB & Simulink

Simulink model

Page 48: Technical Computing Camp 2018

48

Predictive maintenance with synthetic failure data with

MATLAB & Simulink

Measured data

Inject failures

Refine model

Simulink model

Failure data

Failure conditions

Page 49: Technical Computing Camp 2018

49

Are you ready for AI if you don’t have the right data?

Generate data with simulations

Simulation environment for

reinforcement learning

Page 50: Technical Computing Camp 2018

50

Low-carbon homes

• Generate power with fuel cell and solar panels

• Store power in battery

• Buy power when needed; sell when extra

• Record data on environment and energy usage

Page 51: Technical Computing Camp 2018

51

Low-carbon homes

• Generate power with fuel cell and solar panels

• Store power in battery

• Buy power when needed; sell when extra

• Record data on environment and energy usage

Goals

• Minimize energy cost

• Use EV battery for additional storage

Page 52: Technical Computing Camp 2018

52

Optimizing home energy management system

Denso

HomeHome Energy Controller

Battery

command

Generated and consumed power

Stored energy

Page 53: Technical Computing Camp 2018

53

Optimizing home energy management system

Denso

HomeHome Energy Controller

Battery

command

Generated and consumed power

Stored energy

Electricity prices

Predicted

vehicle use

¥

Simscape Power SystemsModel predictive control

Mixed integer linear programming

Page 54: Technical Computing Camp 2018

54

Optimizing home energy management system

Denso

Develop

Data

Parallel

computing

1000 CSV Files

Access Data Deploy

PreprocessingClassification

Learner

Analyze Data

Page 55: Technical Computing Camp 2018

55

Optimizing home energy management system

Denso

Develop

Data

Simulink

Control

algorithms

Deploy

Optimization

Embedded

devices

Classification

Learner

Simscape Power

Systems

Parallel

computing

1000 CSV Files

Access Data

Preprocessing

Analyze Data

Page 56: Technical Computing Camp 2018

56

Optimizing home energy management system

Denso

Develop

Data

Simulink

Control

algorithms

Parallel

computing

1000 CSV Files

Access Data Deploy

Optimization

Preprocessing Embedded

devices

Classification

Learner

Analyze Data

Simscape Power

Systems

“The effort would have taken significantly longer if we had

used disparate tools.

[MATLAB] enabled our team of domain experts, who

lacked formal training in data science, machine learning,

and parallel computing, to incorporate all these areas in

our design process.”

Akira Ito and Ryu Matsumoto

Page 57: Technical Computing Camp 2018

57

Autonomous

Primary

Page 58: Technical Computing Camp 2018

58

Page 59: Technical Computing Camp 2018

59

Autonomous

Primary

Page 60: Technical Computing Camp 2018

60

++

Host computer ProsthesisProcessing laptop

EMG

Drummer

Music

Exceeding human capabilities with a robotic drumming prosthesis

Georgia Tech Center for Music Technology

PID controller

AI algorithms

Page 61: Technical Computing Camp 2018

61

++

Host computer ProsthesisProcessing laptop

Microphone

EMG

Drummer

Music

Exceeding human capabilities with a robotic drumming prosthesis

Georgia Tech Center for Music Technology

PID controller

AI algorithms

Page 62: Technical Computing Camp 2018

62

Page 63: Technical Computing Camp 2018

63

Are you ready for AI if …

You’ve never used machine learning? Easy programming

Apps

Domain expertise to prepare data

Page 64: Technical Computing Camp 2018

64

Are you ready for AI if …

You’ve never used machine learning?

You can’t identify features in your data?

Easy programming

Apps

Domain expertise to prepare data

Deep learning identifies features for you

Transfer learning works with less data

Use AI to label data

Page 65: Technical Computing Camp 2018

65

Are you ready for AI if …

You’ve never used machine learning?

You can’t identify features in your data?

You don’t have the right data?

Easy programming

Apps

Domain expertise to prepare data

Deep learning identifies features for you

Transfer learning works with less data

Use AI to label data

Generate failure data with simulations

Simulate environment for reinforcement learning

Page 66: Technical Computing Camp 2018

66

With MATLAB and Simulink, you ARE ready for AI!

Page 67: Technical Computing Camp 2018

67