[japan tech summit 2017] mai 003
TRANSCRIPT
![Page 1: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/1.jpg)
Microsoft Tech Summit 2017本情報の内容(添付文書、リンク先などを含む)は、Microsoft Tech Summit 2017 開催日(2017 年 11 月 8日 - 9 日)時点のものであり、予告なく変更される場合があります。
![Page 2: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/2.jpg)
まずはじめに
![Page 3: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/3.jpg)
Azure Machine Learning Studio
![Page 4: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/4.jpg)
もっと早いマシンを使いたい
Web Serviceにしかデプロイできない
![Page 5: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/5.jpg)
もっと早いマシンを使いたい
Web Serviceにしかデプロイできない
どの環境でも学習
どこでもデプロイ
コードでごりごり全フレームワーク
![Page 6: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/6.jpg)
どの環境でも学習
どこでもデプロイ
コードでごりごり全フレームワーク
![Page 7: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/7.jpg)
Azure Machine Learning
Workbench
A Z U R E M A C H I N E L E A R N I N G S E R V I C E S
VM (CPU/GPU)
Spark
Container Services
SQL Server
ML Server
ON-PREMISES
EDGEAzure IoT Edge
学習とデプロイの選択肢
AZURE学習履歴 &モデル管理サービス
![Page 8: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/8.jpg)
どの環境でも学習
どこでもデプロイ
コードでごりごり全フレームワーク
![Page 9: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/9.jpg)
言語
任意のフレームワークまたはライブラリに対応
使い慣れたツール
![Page 10: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/10.jpg)
![Page 11: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/11.jpg)
St George Island
![Page 12: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/12.jpg)
![Page 13: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/13.jpg)
学習ごとの履歴を管理学習履歴管理サービス
![Page 14: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/14.jpg)
![Page 15: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/15.jpg)
![Page 16: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/16.jpg)
![Page 17: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/17.jpg)
デプロイ&運用データの準備 モデルの学習
![Page 18: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/18.jpg)
デプロイ&運用データの準備 モデルの学習
Experimentation
Service
Model Management
Service
Azure Machine Learning Workbench
![Page 19: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/19.jpg)
![Page 20: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/20.jpg)
デプロイ&運用データの準備 モデルの学習
Experimentation
Service
Model Management
Service
Azure Machine Learning Workbench
![Page 21: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/21.jpg)
デプロイ&運用データの準備 モデルの学習
![Page 22: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/22.jpg)
データの準備
![Page 23: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/23.jpg)
![Page 24: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/24.jpg)
192.128.138.20 - - [16/Oct/2016 16:22:33 -0200] "GET /images/picture.gif HTTP/1.1" 234
343 www.yahoo.com "http://www.example.com/" "Mozilla/4.0 (compatible; MSIE 4)" "-"
log1 log2 log3 log4 log5 log6 log7
192.128.138.20 16/Oct/2016 16:22:33 -0200 GET images/picture.gif HTTP
IIS ログ
![Page 25: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/25.jpg)
デプロイ&運用データの準備 モデルの学習
![Page 26: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/26.jpg)
モデルの学習
![Page 27: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/27.jpg)
Local machine
Data Science VM
(CPU / GPU)
Spark on HDInsight
Azure Batch AI (Coming Soon)
ML Server
学習用の環境を自由に選べます
Workbench DOCKER
学習履歴管理サービス
![Page 28: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/28.jpg)
学習履歴管理サービス
# Import Azure ML Logger libraryfrom azureml.logging import get_azureml_logger
# Create a new instance of the loggerrun_logger = get_azureml_logger()
# log a valuerun_logger.log("key", value)
![Page 29: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/29.jpg)
![Page 30: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/30.jpg)
デプロイ&運用データの準備 モデルの学習
![Page 31: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/31.jpg)
デプロイ&運用
![Page 32: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/32.jpg)
DOCKER
VM (CPU/GPU)
Azure Container Service
Azure IoT Edge
(Coming Soon)
Microsoft ML Server
Spark clusters
どこでもデプロイ
AZURE ML
Services
モデル管理サービス
![Page 33: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/33.jpg)
Model Manifest
Image Service
バージョン管理をサポート
ロールバックが可能
![Page 34: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/34.jpg)
![Page 35: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/35.jpg)
![Page 36: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/36.jpg)
GUI でのドラッグ & ドロップ コードファースト
![Page 37: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/37.jpg)
どの環境でも学習
どこでもデプロイ
コードでごりごり全フレームワーク
![Page 38: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/38.jpg)
デプロイ&運用データの準備 モデルの学習
![Page 39: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/39.jpg)
![Page 40: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/40.jpg)
Microsoft Tech Summit 2017本情報の内容(添付文書、リンク先などを含む)は、Microsoft Tech Summit 2017 開催日(2017 年 11 月 8日 - 9 日)時点のものであり、予告なく変更される場合があります。
![Page 41: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/41.jpg)
![Page 42: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/42.jpg)
Session
IDTitle Time
HOL007 Azure Machine Learning で始めるデータ分析の第一歩 Day2 15:10 – 16:00
MAI004 AI ディープラーニング入門 Day2 09:00 – 09:50
MAI001 ディープラーニングの産業応用とそれを支える技術 Day1 13:55 – 14:45
![Page 43: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/43.jpg)
Session
IDTitle Time
HOL007 Azure Machine Learning で始めるデータ分析の第一歩 Day2 15:10 – 16:00
MAI004 AI ディープラーニング入門 Day2 09:00 – 09:50
MAI001 ディープラーニングの産業応用とそれを支える技術 Day1 13:55 – 14:45
![Page 44: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/44.jpg)
■ http://aka.ms/mina-ai
■ http://aka.ms/psdc-ai
https://azure.microsoft.com/en-us/overview/machine-learning/
http://aka.ms/aml_deep_dive
![Page 45: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/45.jpg)
![Page 46: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/46.jpg)
➢ Data store
- File system - Azure Blob
- SQL Database
➢ File Types
- Delimited Files (CSV, TSV, TXT)
- Fixed Width - Plain Text
- Excel - Json
- Parquet
➢ Sampling Strategy
- Top N - Random N
- Full file - Random %
Ingest and sample
![Page 47: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/47.jpg)
Understanding Data
![Page 48: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/48.jpg)
Inspectors
➢ Column statistics : Numeric
➢ Histogram
➢ Value Counts
➢ Box Plot
➢ Scatter Plot
➢ Time Series
➢ Map
![Page 49: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/49.jpg)
AI Powered Spreadsheets
![Page 50: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/50.jpg)
Transparent compute
![Page 51: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/51.jpg)
コラボレーションと Git
➢再現性 = 各実験提出時の git コミット
➢ 各実験の実施はコミットであるため、特定の時点のプロジェクトに復元できる
VSTS アカウント AML の実験アカウント
VSTS プロジェクト ワーク
Git リポジトリ
Git リポジトリ
Git リポジトリ
AML プロジェク
ト
AML プロジェク
ト
AML プロジェク
ト
ユーザーが両方の場所でアクセス許可を必要とする
![Page 52: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/52.jpg)
Microsoft ML Spark
CNTK Java Bindings OpenCV Java Bindings Spark core
Scala API
PySpark wrappers
Wrapper
generation
Pre-trained DNN models
![Page 53: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/53.jpg)
Notebook integration
![Page 54: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/54.jpg)
Promote & download # setup environment
az ml env setup
-l <location>
-n <environment name>
# set environment
az ml env set
-g <resource-group>
-n <environment name>
# Create modelmanagement account
az ml account modelmanagement create
--name <modelmanagement name>
--resource-group <resource-group>
--location <region>
# deploy model
az ml service create realtime
-m <path to .link file>
-f <scoring script>
-r <runtime (spark-py|python)>
–n <webservice name>
![Page 55: [Japan Tech summit 2017] MAI 003](https://reader034.vdocuments.net/reader034/viewer/2022051710/5a6478bb7f8b9a2c568b4635/html5/thumbnails/55.jpg)