from model to production · open neural network exchange [onnx] (github repo) send complaints...

10
FROM MODEL TO PRODUCTION Turning Microsoft Azure into data science platform Michał Żyliński Microsoft

Upload: others

Post on 24-Sep-2020

9 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: FROM MODEL TO PRODUCTION · Open Neural Network Exchange [ONNX] (github repo) Send complaints feedback to /dev/null Michal.Zylinski@microsoft.com Let me know if you’dbe interested

F R O M M O D E L TO P R O D U C T I O N

Tu r n i n g M i c r o s o f t A z u r e i n t o d a t a s c i e n c e p l a t f o r m

M i c h a ł Ż y l i ń s k i

M i c r o s o f t

Page 2: FROM MODEL TO PRODUCTION · Open Neural Network Exchange [ONNX] (github repo) Send complaints feedback to /dev/null Michal.Zylinski@microsoft.com Let me know if you’dbe interested

Model & ServePrep & Train

Databricks

HDInsight

Data Lake Analytics

Batch AI

Custom

apps

Sensors

and devices

Store

Blobs

Data Lake

Ingest

Data Factory(Data movement, pipelines & orchestration)

Machine

Learning

Cosmos DB

SQL Data

Warehouse

Analysis Services

Event Hub

IoT Hub

SQL Database

Analytical dashboards

Predictive apps

Operational reports

Intelligence

M I C R O S O F T A Z U R E D ATA S E R V I C E S AT G L A N C E

Business

apps

1001

SQLKafka

Page 3: FROM MODEL TO PRODUCTION · Open Neural Network Exchange [ONNX] (github repo) Send complaints feedback to /dev/null Michal.Zylinski@microsoft.com Let me know if you’dbe interested

D A T A S C I E N C E & A I C H A L L E N G E S

Accelerating adoption of AI by developers

Moving high-end developers into deep learning as non-traditional path to DS / AI dev

Page 4: FROM MODEL TO PRODUCTION · Open Neural Network Exchange [ONNX] (github repo) Send complaints feedback to /dev/null Michal.Zylinski@microsoft.com Let me know if you’dbe interested
Page 5: FROM MODEL TO PRODUCTION · Open Neural Network Exchange [ONNX] (github repo) Send complaints feedback to /dev/null Michal.Zylinski@microsoft.com Let me know if you’dbe interested

D A T A S C I E N C E & A I C H A L L E N G E S

Push scoring/inference to the event (edge, cloud, on-prem)

Growth of diverse hardware arms race across all form factors

Accelerating adoption of AI by developers

Moving high-end developers into deep learning as non-traditional path to DS / AI dev

Lack of open model standards and cross-framework collaboration

Page 6: FROM MODEL TO PRODUCTION · Open Neural Network Exchange [ONNX] (github repo) Send complaints feedback to /dev/null Michal.Zylinski@microsoft.com Let me know if you’dbe interested
Page 7: FROM MODEL TO PRODUCTION · Open Neural Network Exchange [ONNX] (github repo) Send complaints feedback to /dev/null Michal.Zylinski@microsoft.com Let me know if you’dbe interested

Azure Databricks

Page 8: FROM MODEL TO PRODUCTION · Open Neural Network Exchange [ONNX] (github repo) Send complaints feedback to /dev/null Michal.Zylinski@microsoft.com Let me know if you’dbe interested

Spark

SQL Server

Virtual machines

GPUs

Container services

NotebooksIDEs

Azure Machine Learning WorkbenchAzure Machine Learning Studio

SQL Server

Machine Learning Server

O N - P R E M I S E S

A Z U R E M A C H I N E L E A R N I N G

E D G E C O M P U T I N G

Azure IoT Edge

Experimentation and

Model Management

A Z U R E M A C H I N E L E A R N I N G S E R V I C E S T R A I N & D E P LO Y O P T I O N S

A Z U R E

Page 9: FROM MODEL TO PRODUCTION · Open Neural Network Exchange [ONNX] (github repo) Send complaints feedback to /dev/null Michal.Zylinski@microsoft.com Let me know if you’dbe interested

C A L L T O A C T I O N

▪ Open standards

▪ Open platforms

▪ Open source

Page 10: FROM MODEL TO PRODUCTION · Open Neural Network Exchange [ONNX] (github repo) Send complaints feedback to /dev/null Michal.Zylinski@microsoft.com Let me know if you’dbe interested

C A L L T O A C T I O N

▪ Learn more at:

▪ Microsoft Professional Program Data Science track (9 modules)

▪ Microsoft Professional Program Big Data track (10 modules)

▪ References (in order of appearance):

▪ Microsoft Team Data Science Process

▪ Azure Machine Learning Workbench

▪ Microsoft Machine Learning for Apache Spark (github repo)

▪ Open Neural Network Exchange [ONNX] (github repo)

▪ Send complaints feedback to /dev/null [email protected]

▪ Let me know if you’d be interested in deeper dive on this topics