machine learning 101 - ilm · 2020. 4. 30. · application of artificial intelligence (ai) that...

41
Machine Learning 101

Upload: others

Post on 02-Jan-2021

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Machine Learning 101

Page 2: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without
Page 3: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without
Page 4: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without
Page 5: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without
Page 6: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

OutlineWhat is machine learning?

Importance of data

Learning types and algorithms

Examples and demo

Page 7: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

About meMark Kalal

Software development / technology solutions

[email protected]

@MarkKalal

Page 8: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

What is Machine LearningStatistics?

Artificial Intelligence?

Page 9: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without being explicitly programmed

Page 10: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Nand Kishor

Page 11: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

So what?Many benefits

◦ Speed of analyzing complex data, revolutionizing business and data processing

◦ Greatly increased memory handing and computational powers (past barriers to implementation)

Some concerns◦ Consequences, potential for misuse – intentional and non-intentional

◦ Opaque processing

Page 12: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

My computer suddenly started singing “Hello from the other side”!

Of course it did, after all …

It’s A Dell!

Page 13: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

It’s all about the data“Fuel” for machine learning

Data, data, and more data

Many useful things are being done

Page 14: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without
Page 15: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Banko and Brill, 2001

Page 16: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

“Big Data”Volume

Velocity

Variety

Page 17: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Where does it come fromSome you already have

◦ Database

◦ Logs

Some you can get◦ Web, public sources

(data.gov, kaggle.com/datasets)

◦ IOT sensors

Some you can ask for◦ Social media

◦ Anything a user can provide

Page 18: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

The journalist asked a programmer: “What makes bad code”? His reply?

No Comment!

Page 19: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Learning types

Page 20: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Supervised Learning – make predictions

Past data

learn predict

New data

Apple

Banana

Page 21: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Supervised LearningClassification

◦ Question or output is categorical, i.e. True/False

Regression◦ Question or output is a real or continuous value

Page 22: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Supervised LearningClassification

Simplilearn, 2018

Page 23: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Supervised LearningRegression

Simplilearn, 2018

Page 24: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Unsupervised Learning – finding hidden patterns

Input

segregate organize

Output

Page 25: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Unsupervised LearningClustering

◦ Groups things based on similarities between them, and differences between others

Association◦ Discovers relations or probability of occurrences within data

Page 26: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Unsupervised LearningClustering

Page 27: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Unsupervised LearningAssociation

Page 28: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Reinforcement Learning - Decisions based on rewards for past actions

learns

use feedback

good move

bad move

Page 29: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Algorithms

Page 30: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

AlgorithmsDecision Tree

◦ Represents data that is divided/”branched” by conditions (questions and answers)

Linear Regression◦ Represents and expresses the relationship between data with a line (X-Y grid)

Page 31: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Decision TreeWhat fruit is this? Grape? Apple? Banana?

Page 32: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without
Page 33: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Linear RegressionWhat does this house cost?

Page 34: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Linear RegressionWhat does this house cost?

Page 35: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

I walked down a street where the houses were numbered 64k, 128k, 256k, 512k, and 1mb

It was a trip down memory lane!

Page 36: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Machine Learning Lifecycle/PipelineStart with a question or problem

Collect data

Model

Train (and test)

Classify/Recommend/Predict

Re-train

Page 37: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Tools

Page 38: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

ML.Net Demo◦ Installation

◦ Data files and formats

◦ C# API

◦ Model Builder

◦ Sample apps and code

Page 39: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Summary✓What is machine learning

✓Importance of data

✓Learning types and algorithms

✓Examples and demo

Page 40: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

For more informationURList - https://www.theurlist.com/kalal-mdc-2019

ML.Net - https://dotnet.microsoft.com/apps/machinelearning-ai/ml-dotnet

Kaggle Datasets - https://www.kaggle.com/datasets

US open data - https://www.data.gov/

World Bank open data - https://data.worldbank.org/

Josh Gordon ML Recipes - https://www.youtube.com/watch?v=cKxRvEZd3Mw

Introduction to AI - https://www.coursera.org/learn/ai-for-everyone

This slide deck – https://github.com/mdkalal/ml101

Page 41: Machine Learning 101 - Ilm · 2020. 4. 30. · Application of artificial intelligence (AI) that provides systems the ability to learn and improve from “experience” (data) without

Thank you!Feedback welcome

Mark Kalal - [email protected]

@MarkKalal