machine learning for developers - pop-up loft tel aviv
TRANSCRIPT
![Page 1: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/1.jpg)
Machine Learning for DevelopersDanilo Poccia, Technical Evangelist
@danilop
![Page 2: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/2.jpg)
Batch
Report
Real-time
Alerts
Prediction
Forecast
![Page 3: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/3.jpg)
Predictions
![Page 4: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/4.jpg)
Data Predictions
![Page 5: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/5.jpg)
ModelData Predictions
![Page 6: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/6.jpg)
ModelData
BatchPredictions
Real-timePredictions
![Page 7: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/7.jpg)
Machine Learning
![Page 8: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/8.jpg)
SupervisedLearning
Machine Learning
UnsupervisedLearning
The task of inferringa model
from labeledtraining data
The task of inferringa model
to describehidden structure
from unlabeled data
![Page 9: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/9.jpg)
ClusteringUnsuperv
ised
Learning
![Page 10: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/10.jpg)
ClusteringUnsuperv
ised
Learning
![Page 11: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/11.jpg)
ClusteringUnsuperv
ised
Learning
![Page 12: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/12.jpg)
Regression
Binary Classification
Multi-class Classification
Supervise
d
Learning
![Page 13: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/13.jpg)
Validation
Supervise
d
Learning
![Page 14: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/14.jpg)
Training from Labeled DataSuperv
ised
Learning
Training
Validation
70%
30%
![Page 15: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/15.jpg)
Cross-ValidationSuperv
ised
Learning
![Page 16: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/16.jpg)
Be Careful of OverfittingSuperv
ised
Learning
![Page 17: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/17.jpg)
Be Careful of OverfittingSuperv
ised
Learning
![Page 18: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/18.jpg)
Be Careful of OverfittingSuperv
ised
Learning
![Page 19: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/19.jpg)
Better ModelSuperv
ised
Learning
![Page 20: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/20.jpg)
Better ModelSuperv
ised
Learning
![Page 21: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/21.jpg)
Adding a Test PhaseSuperv
ised
Learning
Training
Validation
Test
60%
20%
20%
![Page 22: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/22.jpg)
?Data Model
![Page 23: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/23.jpg)
Data Model
Resilient Distributed Datasets (RDDs)
Memory
Fast Processing
Large Quantity of Data
Disk
Hadoop
MapReduce
Spark
?
![Page 24: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/24.jpg)
Amazon EMRwith Spark (MLib)
Data Model
![Page 25: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/25.jpg)
<demo>...
</demo>
![Page 26: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/26.jpg)
Amazon EMRwith Spark (MLib)
Data Model
![Page 27: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/27.jpg)
Data Scientists“Scalability”
![Page 28: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/28.jpg)
AmazonMachine Learning
(Amazon ML)
Data Model
![Page 29: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/29.jpg)
Machine learning is the technology that automatically finds patterns in your data and uses them to make
predictions for new data points as they become available
Your Data + Machine Learning= Smart Applications
What is Machine Learning?
AmazonMachine Learning
(Amazon ML)
![Page 30: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/30.jpg)
Machine learning (ML) can help you use historical data to make better business decisions.
ML algorithms discover patterns in data and construct predictive models using these patterns. Then, you can use the models to make predictions
on future data.
What is Machine Learning?
AmazonMachine Learning
(Amazon ML)
![Page 31: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/31.jpg)
Integrated with AWS Services for Easy Data Access (Amazon S3, Amazon Redshift, Amazon RDS)
Data visualization and exploration
Model Evaluation and Interpretation Tools
Binary Attributes (Binary Classification) Categorical Attributes (Multi-class Classification)
Numeric Attributes (Regression)
Key Features
AmazonMachine Learning
(Amazon ML)
![Page 32: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/32.jpg)
Data Transformations
Modeling APIs
APIs for Batch and Real-time Predictions
Fully Managed
Pay per Use
Key Features
AmazonMachine Learning
(Amazon ML)
![Page 33: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/33.jpg)
AmazonMachine Learning
(Amazon ML)
Data Model
![Page 34: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/34.jpg)
AmazonMachine Learning
(Amazon ML)
Data Model
BatchPredictions
![Page 35: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/35.jpg)
AmazonMachine Learning
(Amazon ML)
Data Model
BatchPredictions
Real-timePredictions
![Page 36: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/36.jpg)
<demo>...
</demo>
![Page 37: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/37.jpg)
AmazonMachine Learning
(Amazon ML)
Data Model
BatchPredictions
Real-timePredictions
![Page 38: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/38.jpg)
Choose Where to Spend Your Time
![Page 39: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/39.jpg)
Pay Only For What You Use
![Page 40: Machine Learning for Developers - Pop-up Loft Tel Aviv](https://reader031.vdocuments.net/reader031/viewer/2022022123/589e30ec1a28ab5c128b67f3/html5/thumbnails/40.jpg)
Danilo PocciaTechnical Evangelit @danilop