Azure AI+IoT

204

Microsoft Tech Summit 2017

Agenda

UI

Microsoft Tech Summit 2017

- Satya Nadella

OUR GOAL IS TO DEMOCRATISE A.I.TO EMPOWER EVERY PERSON

AND EVERY ORGANISATION

TO ACHIEVE MORE

(SERVICES)

(APPLICATIONS)

Mail, Office, Dynamics 365

Cortana, Bots

(AGENTS)

CortanaMachine learning & advanced analytics

Bot framework

Cognitive Services

(INFRASTRUCTURE)Azure

CPU/GPU at scale

FGPA

MICROSOFT AI

UI

Microsoft Tech Summit 2017

UI

1

2

3

4

5

6

7

8

9

10

Monthly Mobile UsageSource AppAnnie 2016

106

24x7

UI & BOTS

Microsoft Tech Summit 2017

AI

AI

Microsoft Tech Summit 2017

Microsoft Tech Summit 2017

L4: Business Planning

D

evic

e A

gen

t

Azure IoT Gateway

Azure IoT Hub

(device provisioning)

Stream Analytics Event Hubs Service Fabric

(Actors)Functions

CRM PLM ERP SCM

Data Factory DocumentDB SQL DatabaseData lake store

HD InsightData lake

Analytics

Cognitive

Services

Bot

Framework

SaaS ApplicationsSaaS

Remote

Monitoring

Predictive

Maintenance

Pre/Post

Vehicle Sales

Logic Apps API Integration BizTalk Services

Dashboards Mixed Reality Interactive Speech

Customer

Engagement

Wearables Gestures

Azure Time

Series Insights

Str

eam

An

aly

tics

on

Ed

ge

Machine

Learning

DMS

Bot framework

LUIS

Backend Services Database

IoT Hub

Microsoft Azure

Cognitive Services

Car Gateway App

Cortana

Microsoft Tech Summit 2017

Direct Line Protocol

SDK

HTTPAI

https://docs.botframework.com/en-us/restapi/directline3https://docs.botframework.com/en-us/restapi/directline3/swagger.json

Goals

.

Bot

Bot Controls

LUIS

Query over database via

Azure Search

Form

FillingQnA

C#

Customers

Business Logic

& DataBot Connector

Direct Line

What?

Channels MS

Azure Bot Service,

WebchatSDK

Why?

Card UI

SDK

Channel

Bot Builder

Channel

Cortana

Bing

Skype for Business

UI

Platform

Bot

Intelligence

I M P R O V E M E N T S E V E R Y W H E R E !

O N E B O T

M U L T I P L E C A N V A S E S

Custom Skills

Memory / Profile

Speech

Business Bots

Bot Directory

Bots in Bing Search

LOB Bots

IT Managed

Integrated Auth

O P E N F R A M E W O R K

M U L T I P L E C A N V A S E S

Microsoft Teams Skype Android iOS

-

DirectLine

WebChat

Cortana

-SDK -LUIS

SSML

(Cortana, Bing Speech, Custom Speech

Recognition)

D E E P I N T E G R A T I O N

A C R O S S T H E B O T F R A M E W O R K

Microsoft Tech Summit 2017

: Cortana, Direct Line, Web Chat

Bot

"This is the text that will be displayed."

"This is the text that will be spoken."

await

Cortana

Cortana

Cortana

Cortana

- e.g.

Cuisine

- e.g.

Cortana

Android, iOSWindows Devices

(CortanaSDK)

Cortana Skills Kit

Cognitive ServicesLUIS

Bot FrameworkCortana Channel

Skill

Bot

Framework

Bot Builder SDK

Bot

Cognitive

Services (LUIS)

Cortana

channel

Bot

Cortana skill

Cortana-

Skill

Cortana

Microsoft Tech Summit 2017

HTTP

-Language Understanding Intelligence Service (LUIS)

What hotels do you recommend

for Seattle

Im looking for a hotel in Seattle

Find me hotels in Seattle

LU.

Find me a motel in Seattle

{entities: [

{entity: flight_delays,type: Topic

}],intents: [

{intent: FindNews,score: 0.99853384

},{

intent: None,score: 0.07289317

},{

intent: ReadNews,score: 0.0167122427

},{

intent: ShareNews,score: 1.0919299E-06

}]

}

Find the latest on delayed flights

L A N G U A G E U N D E R S T A N D I N G

Microsoft Tech Summit 2017

Azure IoT Hub

VPN/ExpressRoute

OPC, HTTP, CoAP,

SDK

IoT Edge

AMQP

/

SDK

/

SDK

AMQP, MQTT, HTTPS

- - Dashboards- -

CoAP, AllJoyn, OPC,

CoAP, AllJoyn, OPC,

IoT Hub

Microsoft Azure

Azure IoT Hub

IoT Hub

ID

IoT Hub

/

C2D

D2C

IoT Hub

C2D,ack

(hot and cold path)

D2C

Twin

Twins

IoT HubIoT hub

?

Learn more: https://aka.ms/azureiotgetstarted

https://aka.ms/azureiotgetstarted