smart data webinar: machine learning (ml) adoption strategies

33
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved. Machine Learning Adoption Strategies Adrian Bowles, PhD Founder, STORM Insights, Inc. [email protected]

Upload: dataversity

Post on 13-Apr-2017

776 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Machine Learning Adoption Strategies

Adrian Bowles, PhDFounder, STORM Insights, Inc.

[email protected]

Page 2: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Machine Learning Adoption Strategies

ML Fundamentals - What is ML, what is it good for? Overview of the ML Market Getting Started

Page 3: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Machine Learning Adoption Strategies

ML Fundamentals - What is ML, what is it good for? Overview of the ML Market Getting Started

Page 4: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Machine Learning vs Predictive Analytics

Machine Learning: a discipline at the intersection of computer science, statistics, and psychology, that develops algorithms and systems capable of improving their performance based on experience with data, rather than predetermined rules or reprogramming.

Predictive Analytics: the use of statistical algorithms and a set of assumptions - the model - to identify the likelihood of future outcomes or missing values based on patterns in historical data.

Page 5: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Predictive analytics: the use of statistical algorithms and a set of assumptions - the model - to identify the likelihood of future outcomes or missing values based on patterns in historical data.

Linear regressionLogistic regression (categorical dependent variable)

Time-series analysisClassification treesDecision trees…

Historical Data

Predicted Data

Assumptions

Page 6: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Page 7: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Psychological Processes

Perception

Learning

Motivation

Learning in Context

Memory

Page 8: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

0. Foundation

Experience-Based

Learning1. Learn

2. Interact

3. ExpandIntegrate

Augmented/VirtualReality

Confidence-weightedReporting

Motivation

reflection

inference

Natural Cognitive Processes

deduction

Hypothesis Generation& Testing

reasoning

Natural Language Processing

Cloud

…Analytic

s

Data Management

Neu

rom

orph

icAr

chite

ctur

es Learning

Perception

A Framework for Cognitive Computing

Copyright (c) 2015-2016 by STORM Insights Inc. All Rights reserved.

Page 9: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Perception/NLP

Problem Solving & Learning

Simple: deterministic,

retrieve/calculate

Complex: probabalistic

hypothesize, test, rank, selectCreative:

discover, generate

OR

GA

NIZ

EDM

emor

y*

Input Class/Type Visual Text Image Aural Speech Music Cues Noise Informative Touch Temperature Tactile Texture Taste Smell

Response Types Visible (to the environment) Verbal/NL Text Behavioral (system changes) Haptics/Touch/Proprioception

Invisible Memory updates

*Corpus including data in taxonomies, ontologies, trees…

Perception

Page 10: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Natural learning approaches vary. Some can be simulated with code, for example mechanical theorem proving in formal logic. However, a true machine learning system must improve its performance based on experience with data, not by reprogramming.

reflectioninferencededuction

Learning

reasoning

Page 11: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

reinforcement

unsupervisedsupervised

Key approaches to MachineLearning

Page 12: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Key approaches to

reinforcement

MachineLearning

unsupervised

supervisedThe system is taught to detect or match patterns based on training data. Learning by example.

The system learns/develops strategies based on performance feedback.

An unsupervised learning system discovers patterns based on experience.

Page 13: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Key approaches to MachineLearning

supervisedThe system is taught to detect or match patterns based on training data. Learning by example.

Good for: Applications in which there is a large body of experience/evidence that can be codified into a training data set with question-answer pairs.Example: Medical diagnostics, matching symptoms to conditions.

Page 14: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Key approaches to

reinforcement

MachineLearning

The system learns/develops strategies based on performance feedback.

Good for: Applications in which there are too many variables to code, but where one can recognize good/bad behavior and reinforce/extinguish it.Example: A guidance system for an autonomous helicopter.

Page 15: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Key approaches to MachineLearning

unsupervised An unsupervised learning system discovers patterns based on experience.

Good for: Applications where detecting a change in behavior may be meaningful.

Example: Network intrusion detection.

Page 16: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

MachineLearning

deeplearning

Deep learning generally refers to a biologically-inspired approach to machine learning that leverages a collection of simple processing units - analogous to neurosynaptic elements - that collaborate to solve complex problems at multiple levels of abstraction.

These modern neural networks can support supervised, reinforcement, or unsupervised learning systems.

Page 17: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

A New Benchmark for Deep Learning

Page 18: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Machine Learning Adoption Strategies

ML Fundamentals - What is ML, what is it good for? Overview of the ML Market Getting Started

Page 19: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Human

Sensors/Systems

Input Output

Representative Machine Learning Vendors

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Metamind

IBM

Ersatz Labs

Scaled Inference

Microsoft

IP Soft

Numenta

Digital Reasoning

Google

Nervana Systems

BigML

Sentient Technologies

VicariousSkymind wise.io

DatoH2O

LoopAI Labs

AIBrainCycorp

NeurenceQuid

Skytree

Amazon

Cognitive Scale

Page 20: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Key Trend:

Open Source and ML

Page 21: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Key Trend:

Open Source and ML

Page 22: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Key Trend:

Open Source and ML

Page 23: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Key Trend:

Open Source and ML

Page 24: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Key Trend:ML as a ServiceBuild With APIs

IBM Watson Services on Bluemix

Page 25: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Key Trend:ML as a ServiceBuild With APIs

(c) Amazon

Page 26: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Key Trend:ML as a ServiceBuild With APIs

Page 27: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Machine Learning Adoption Strategies

ML Fundamentals - What is ML, what is it good for? Overview of the ML Market Getting Started

Page 28: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Getting Started…so many choices

People

Data scientist shortage

ML skills in demand

ProductsTechnology & Vendor Selection

Process

Choose a ML strategy

Page 29: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Perception/NLP

Problem Solving & Learning

Simple: deterministic,

retrieve/calculate

Complex: probabalistic

hypothesize, test, rank, selectCreative:

discover, generate

OR

GA

NIZ

EDM

emor

y*

Input Class/Type Visual Text Image Aural Speech Music Cues Noise Informative Touch Temperature Tactile Texture Taste Smell

Response Types Visible (to the environment) Verbal/NL Text Behavioral (system changes) Haptics/Touch/Proprioception

Invisible Memory updates

*Corpus including data in taxonomies, ontologies, trees…

Getting Started…

Page 30: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

What We Know

What We Want to Know

Page 31: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

What We Know

What We Want to Know

Tip: machinelearningmastery.com is a great resource for identifying an appropriate (set of) algorithm(s)

… Bayesian Linear Regression

Chi-squared Automatic Interaction Detection Classification and Regression Tree

Gaussian Naive Bayes Least-Angle Regression

Linear Regression Logistic Regression

Neural Network Regression Ridge Regression

Stepwise Regression Support Vector Machine

Insights?Data

Page 32: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Do you have data that can be used to train the system? Examples of the types of patterns you would like to detect? (Yes? Consider supervised learning approaches)

Are there too many variables to specify all the rules AND will you recognize good or bad outcomes or behavior? (Yes & Yes? Look into reinforcement learning strategies)

Are you looking for novel, or previously undetected relationships or patterns? (Yes? Consider unsupervised learning strategies)

Tips: You can mix and match learning strategies as necessary, and tune/combine algorithms to improve performance

Getting Started…

It’s All About the Data

Page 33: Smart Data Webinar: Machine Learning (ML) Adoption Strategies

For more information:

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

[email protected]

Twitter @ajbowles Skype ajbowles

If you would like to connect on LinkedIn, please let me know that you that you found me via the Smart Data webinar series.

Upcoming Webinar Dates & Topics

April 14 Getting Started with Streaming Analytics and the IoT

May 12 Emerging Data Management Options: Graph Databases

June 9 Advances in Natural Language Processing (NLP)