data culture series - keynote - 27th jan, london

63
DATA CULTURE SERIES – 27 th Jan 2015

Upload: jonathan-woodward

Post on 18-Jul-2015

328 views

Category:

Technology


3 download

TRANSCRIPT

Page 1: Data Culture Series -  Keynote - 27th Jan, London

DATA CULTURE SERIES – 27th Jan 2015

Page 2: Data Culture Series -  Keynote - 27th Jan, London

? Who is using Data to drive the future of their business?

Page 3: Data Culture Series -  Keynote - 27th Jan, London

? Who is using Predictive Analytics / Machine Learning yet?

Page 4: Data Culture Series -  Keynote - 27th Jan, London

It Started with

Data Culture

Page 5: Data Culture Series -  Keynote - 27th Jan, London

Core to Vision

Start Justin

Digital Work & LifeExperiences

Page 6: Data Culture Series -  Keynote - 27th Jan, London

Data…Driving the Experience

Page 7: Data Culture Series -  Keynote - 27th Jan, London

UK Economy - data dividend

Page 8: Data Culture Series -  Keynote - 27th Jan, London

Data Culture Series

Data Culture Exec

Session

Data Culture

Summit

Data Culture

Un-Conference

4 events; 60 customersCXO Level

10 events; 800-1000 customersPower User, Analyst, Architect, Developer, DBA

Data Scientist

6 events; 300 customersPower User, Analyst

Data Culture

Deep-Dive2 events; 100 customersPower User, Analyst

NEW

NEW

Page 9: Data Culture Series -  Keynote - 27th Jan, London

Data Culture Summit

Page 10: Data Culture Series -  Keynote - 27th Jan, London
Page 11: Data Culture Series -  Keynote - 27th Jan, London

Date Location

24 February LEEDS Data Culture series

24 March EDINBURGH Data Culture series

8 April BIRMINGHAM Data Culture series

12 May READING Data Culture series

19 May LONDON Data Culture series

More dates added shortly…..

Page 12: Data Culture Series -  Keynote - 27th Jan, London

#DataCulture

Interact & Post questions for the Panel

Page 13: Data Culture Series -  Keynote - 27th Jan, London

UK Business Lead for Data Insights

13

Jon Woodward : Connect & Follow

13

@JLWoodward

www.linkedin.com/in/jonathanwoodward

#DataCulture

PowerBI

APS

AzureML

DocumentDB

Search

EventHub

Stream Analytics

Hadoop

Page 14: Data Culture Series -  Keynote - 27th Jan, London

Time Location

10:30 – 11:30 KeynoteAnthony Saxby – Data PlatformSteve Dunbar – IOT

11:30 – 12:30 Big Data - CARDIFF

Data Science - PARIS

Business Intelligence - BRUSSELS

Data Insights - AMSTERDAM

Azure Data Services - PRAQUE

Immersion Tracks - Overview

12:30 – 13:15 Lunch & Expo

13:15 – 16:30 Immersion (as above) Immersion Hands on

15:00 - 15:15 Break & Expo

15:15 - 16:30 Immersion (as above) Immersion Hands on

16:30 – 17:00 Panel and Close

17:00 Finish

Page 15: Data Culture Series -  Keynote - 27th Jan, London
Page 16: Data Culture Series -  Keynote - 27th Jan, London
Page 17: Data Culture Series -  Keynote - 27th Jan, London

Steve Dunbar

IoT Commercial Director

From the Edge to Analytics

Create the Internet

of Your Things

Page 18: Data Culture Series -  Keynote - 27th Jan, London

Customer perspective: the Internet of Things is complex

It’s bigSo many devices and so much data

It’s noisy

So many opinions

It’s confusing

So many possible decisions

Should we

wait?

How (where)

do we get

started?

Who can

really help

us?

Do we need

to start over?

What

technology

do we need?

B5075212

Page 19: Data Culture Series -  Keynote - 27th Jan, London

“ ”

The network of physical

objects that contain

embedded technology to

communicate and interact

with their internal states or

the external environment.

Source: Gartner

Page 20: Data Culture Series -  Keynote - 27th Jan, London

Components

and devices are

inexpensive

Connectivity is

pervasive

Development is

easy

Economic

benefits are

enormous

New scenarios

fuel demand

Forward-leaning businesses and individuals are

connecting their things today to create new kinds of value

Page 21: Data Culture Series -  Keynote - 27th Jan, London

Industry Type of Savings Savings over 15 Years (USD)

Commercial Aviation 1% Fuel Consumption $ 30B

Internet of Things Opportunities

GE, Industrial Internet, A European Perspective, Pushing the Boundaries of Minds and Machines

GE, Industrial Internet: Pushing the Boundaries of Minds and Machines

Energy (Gas) 1% Plant efficiency gain $ 66BHealthcare 1% System efficiency gain $ 63B Freight Transport (Rail) 1% System efficiency gain $ 27BOil and Gas 1% Improvement in Capital Utilization (Exploration and Development)

$ 90B

Page 22: Data Culture Series -  Keynote - 27th Jan, London
Page 23: Data Culture Series -  Keynote - 27th Jan, London

What are “your things”?

These are things that

empower and enable

your people.

They allow you to

connect with customers

and business partners.

They are critical

components that help

power your business.

23

You have DATAYou have THINGS

Transactional

data

ERP

data

CRM

data

Document/

meta data

Public

data

Social

data

Devices

Analytics and business

intelligence tools

Cloud and network-

enabled infrastructure

Sensors

Page 24: Data Culture Series -  Keynote - 27th Jan, London

Other Enterprise

“Things”

…And connect to

other “things”

across your

Enterprise

Microsoft Services for IoT

Services that allow you to easily

connect and manage all your

devices and data; and transform

insights into action

Industry Devices

The devices and services you need

Connected Windows

devices that enable your

people with consistent,

compelling, and intuitive

experiences

Point of

Service Devices

Specialized

Devices

Thin

Clients

Handhelds

Self Checkout

Stations

Kiosks

Digital

Signs

Automation

Devices

Smart

Phones

Slates/

Tablets

PCs/

Laptops

Vending

Machines

Kinect

Servers

Diagnostic

Equipment

Remote Medical

Monitors

Logic

Controllers

Security

POS

Terminals

ATM

Chips

Applications

and Portals

Sensors

Other Devices

Power BI

for Office 365

Line-of-Business

Services

M2M

Services

Cloud

Services

Intelligent Systems Service

Data and BI Services

HDInsight

Page 25: Data Culture Series -  Keynote - 27th Jan, London

The right strategy

Generate new

insights to

create new

business value

Combine the

data you

already collect

Expand by adding new devices, assets, services, and data

Utilize services

and the cloud

to jumpstart

your efforts

Start by

connecting the

devices and LoB

assets you

already have

Page 26: Data Culture Series -  Keynote - 27th Jan, London

IoT represents a big opportunity

Transportation Utilities Government Other

$92 B $472 B $160 B $132 B $156 B $100 B $301 B $877 B

Transportation Utilities Government Other

$154 B $913 B $326 B $313 B $325 B $201 B $570 B $1.79 T

$4.59T

$2.29T

Page 27: Data Culture Series -  Keynote - 27th Jan, London

CHALLENGE SOLUTIONS BENEFITS

Royal Caribbean International, the second-

largest cruise company in the world with 22

ships that sail to more than 270 destinations,

wanted to improve food safety and insight

into customer behavior on its innovative new

Oasis-class ships.

Royal Caribbean deployed a solution from

Agilysys and ParTech that connects Windows

Embedded devices including 325 POS

terminals, 50 tablets, and 300 digital signs

with back-end servers running Microsoft SQL

Server and Windows Server. Thirty-five

handheld devices connect to existing

equipment to increase efficiency in food

inspection processes.

• Integrates data from POS, tablets, signage,

TV, photo gallery, and ticketing systems

• Automates alerts for cooler malfunction

• Reduces time to complete checklist and

generate temperature compliance reports

• Cuts temperature check times by 60%

The Internet of Your ThingsIntelligent Systems in action - Retail

ROYAL CARIBBEAN CRUISE LINE

www.InternetofYourThings.com

Page 28: Data Culture Series -  Keynote - 27th Jan, London
Page 29: Data Culture Series -  Keynote - 27th Jan, London

Microsoft’s View

Page 30: Data Culture Series -  Keynote - 27th Jan, London

V

The Microsoft cloud supports any device

. . .

datadeveloper

Page 31: Data Culture Series -  Keynote - 27th Jan, London

Vehicle Tracking Device Cameras Power Meter Load Meter Smoke Fire Alarms Humidity Sensor Flow Meter Occupancy Sensor Temperature Sensor

INTELLIGENT DEVICES Machine Controller

Vehicle Tracking Smart Grid General Equipment Retail Kiosk Fire Detection Healthcare Smart Building Automation Digital Advertising Smart Home Automation

Automotive Retail Industrial Healthcare Security & Surveillance Energy Smart Home Smart Cities

Collect

Instrument apps

Deliver events to analytics service

Receive and store many live data streams

Analyze

Real-time and historical analysis of event streams

Aggregations, pivots and patterns

Consume

Publish analytics in a consumable format

Inform and Influence

Make better decisions

Microsoft Azure IoT services

M2M GatewayNETWORK

Page 32: Data Culture Series -  Keynote - 27th Jan, London

Azure services for IoT

Page 33: Data Culture Series -  Keynote - 27th Jan, London

Producers Event Ingestion Storage Transformation Presentation & action

Event Hubs

(Service Bus)SQL Database Azure ML Azure Websites

Heterogeneous

client agents

Table/Blob

StorageHD Insight Mobile Services

Intelligent

Systems ServiceDocumentDB Stream Analytics Power BI

External Data

Source

External Data

SourceCloud Services External Services

{ }

Page 34: Data Culture Series -  Keynote - 27th Jan, London

Predictive

Maintenance

that enable you to

change your

business…

HDInsight Power BI

Machine Learning

Command and Control

You have devices

on the network

edge…

Plant Floor

Things

Supply Chain

ThingsBack Office

Things

Basic Sensors Intelligent Devices

that provide you

data…

SQL Databases

Blob Storage

Table Storage

External Storage

DocumentDB

that you

understand, apply

rules, models and

more…

Command and

Control

Event Hubs (Service Bus)

Page 35: Data Culture Series -  Keynote - 27th Jan, London

Process

Efficiency

Cost

Reduction

IoT is all about

providing INSIGHTS

Develop

New Business

Models

Page 36: Data Culture Series -  Keynote - 27th Jan, London

Recommenda-

tion engines

Advertising

analysis

Weather

forecasting for

business planning

Social network

analysis

IT infrastructure

and web app

optimization

Legal

discovery and

document

archiving

Pricing analysis

Fraud

detection

Churn

analysis

Equipment

monitoring

Location-based

tracking and

services

Personalized

Insurance

Predictive analytics should address the likelihood of something happening in the future, even if it is just an instant later…

Page 37: Data Culture Series -  Keynote - 27th Jan, London
Page 38: Data Culture Series -  Keynote - 27th Jan, London
Page 39: Data Culture Series -  Keynote - 27th Jan, London

Connect new and existing

devices using open-source

agents or gateway

technologies

Store machine-generated

data with data from other

sources in the cloud

View data, administer

devices, and configure

rules, alerts, and other

actions using out-of-box

or custom portals

Mine insights from your

data to find gaps and

opportunities to make

better decisions and realize

new business value

Drive InsightsAnalytics ToolsCloud and infrastructure

Devices and

assets

10101010011000110101010111010011010101010100110111011110111001010100001101010101110100110101010111010011101010101011010011010101010101001101100010101111010011101010101011011110100111

10101010011000110101010111010011010101010100110111011110111001010100001101010101110100110101010111010011101010101011010011010101010101001101100010101111010011101010101011011110100111User

input

AlertsSensors Gateway

Agent

ADevices

Value

StreamInsights

Power BI

HDInsight

Azure Machine

Learning

Customer

portal

Page 41: Data Culture Series -  Keynote - 27th Jan, London

• Read about Microsoft’s commitment to IoT on the IoT blog, at http://blogs.microsoft.com/iot/

• Learn about Microsoft’s point of view, the Internet of Your Things, at www.Microsoft.com/Internetofyourthings

• Learn about some of the Azure IoT Services available today, such as Machine Learning and HDInsights

• Stay informed by signing up for the Internet of Your Things newsletter at www.InternetofYourThings.com

• Attain the Intelligent Systems competency to take advantage of specific partner benefits

• Sign up for a free Microsoft Azure trial at www.Microsoft.com/Azure

Page 42: Data Culture Series -  Keynote - 27th Jan, London
Page 43: Data Culture Series -  Keynote - 27th Jan, London

Modernising your Data Platform

Anthony Saxby

Cloud Data Platform Lead

Microsoft UK

Page 44: Data Culture Series -  Keynote - 27th Jan, London

Big data

26BBy 2020, IoT will include 26B units, creating large quantities of data & generating >$300B in revenue for IoT suppliers

Mobility Apps Cloud

>50% More than half of information workers across 17 countries report using 3+ devices for work

25%one quarter of external app implementation spending will be on mobility, cloud, analytics, & social, by 2016

~50%nearly half of total IT spend will be cloud-related by 2020

Devices: “Info Workers Will Erase Boundary Between enterprise And Consumer Technologies.” Forrester Research. August 30, 2012

Apps: Gartner: “Predicts 2013: Business Impact of Technology Drives the Futures Application Services Market.” Nov. 21, 2012

Big data: Paraphrased from "The Impact of the Internet of Things on Data Centers." Gartner Research, Feb 27, 2014

Cloud: “Prepare For 2020: Transform Your IT Infrastructure And Operations Practice.” Forrester Research. Oct. 24, 2012

Page 45: Data Culture Series -  Keynote - 27th Jan, London

Cost Agility

Service Levels

Page 46: Data Culture Series -  Keynote - 27th Jan, London

Performance

CPU Performance Flattening OutDecreasing Cost of Memory$/GB of Memory

1

10

100

1,000

10,000

100,000

1,000,000

19

90

19

91

19

92

19

93

19

94

19

94

19

95

19

96

19

97

19

98

19

99

20

00

20

00

20

01

20

02

20

04

20

05

20

07

20

08

20

09

20

11

US$

/GB

0

1

10

100

1,000

10,000

100,000

1,000,000

10,000,000

1970 1975 1980 1985 1990 1995 2000 2005 2010

46

Page 47: Data Culture Series -  Keynote - 27th Jan, London

Drive Real-Time Business with Real-Time Insights

Over 100x query speed and

significant data compression with

In-Memory ColumnStore

Up to 30x faster transaction

processing with In-Memory OLTP

Greater

performance

with In-Memory

Analysis Services

Billions of rows

per second with

PowerPivot

In-Memory for

Excel

47

Faster InsightsIN-MEMORY ANALYTICS

Faster QueriesIN-MEMORY DW

Faster TransactionsIN-MEMORY OLTP

Page 48: Data Culture Series -  Keynote - 27th Jan, London
Page 49: Data Culture Series -  Keynote - 27th Jan, London

The entire DB doesn’t need to be In-Memory

10xFaster performance

In-Memory FlexibilityKey Benefits

Minimize capex as

data volumes grow

Access In-Memory and

on-disk with a single query

Don’t need to rewrite

entire appwith

scalability and

reduced

operating

costs

Exponential

growth

On-Disk

Application

Warm and

hot data

Cold DataSingle Query

49

Page 50: Data Culture Series -  Keynote - 27th Jan, London

In-Memory

OLTP

35x faster

performanceGames

No locks

and latches

“SQL Server 2014 has no

lock and latch problem,

meaning it can increase

CPU usage up to 90 percent.

What was even more

surprising was that it

ensured seamless handling

of all requests without an

error, even when CPU usage

exceeds 90 percent.”

- Lee Sangbong, Deputy Chief,

CJ E&M Database Team

Page 51: Data Culture Series -  Keynote - 27th Jan, London

Key Benefits

Quickly explore massive

data volumes

Dramatically compress data

Over 100x faster query

performance

Accelerated Analytics with In-Memory

“It can take up to 3 hours to aggregate

data from billions of table rows….

(Now) it takes 45 minutes to update

the index, and then reports can be run

on-demand with sub-second response.”

- Kevin Cornett, Stein Mart

Faster time to insights

Advanced data

compression

In-Memory

ColumnStore Advanced Analytics

with InMemory

51

10,800xfaster queries

340x faster queries

2,400xfaster queries

Page 52: Data Culture Series -  Keynote - 27th Jan, London

PH

YS

ICA

L H

AR

DW

AR

E L

AY

ER

DATACENTRE A

PH

YS

ICA

L H

AR

DW

AR

E L

AY

ER

SQL 2000

SQL 2000

SQL 2005SQL 2005 ClusterSQL 2008r2

SAN (High I/O Capacity)

DATACENTRE B

SQL 2005 Cluster SQL 2000 SQL 2000

SAN (High I/O Capacity)

SQL 2005

SQL 2005

SQL 2008r2 SQL 2008r2

SQL 2012 BI

Timeline

2004200520062008200920102012

SQL 2000OracleSQL 2012 BISQL 2012 Enterprise

SQL 2012 BISQL 2012 Enterprise

Page 53: Data Culture Series -  Keynote - 27th Jan, London

Virtualisation Overhead ReducingProven SQL Server performance on an enterprise-class hypervisor

0

0.2

0.4

0.6

0.8

1

0

200

400

600

800

1000

4 8 16 32 64

Avera

ge T

ran

sacti

on

Resp

on

se T

ime (

Sec)

Tra

nsa

cti

on

s/S

ec

Virtual Processors Per VM

Hyper-V Virtual CPU Scalability

with OLTP Workloads

Enterprise Strategy Group

Tested an existing SQL Server 2012 OLTP workload that was previously vCPU limited

Increased Scale & Performance

With Hyper-V’s support for 64 vCPUs per VM, testing showed a 6x performance increase, with a 5x improvement in transaction response time.

2,870 SQL Server batch requests per second were recorded during the 64 vCPUtest. Microsoft documentation states “over 1,000 batch requests per second indicate a very busy SQL Server”

0

500

1000

1500

2000

2500

3000

3500

4 8 16 32 64Batc

h R

eq

uest

s/S

ec

Virtual Processors Per VM

Hyper-V Enabled SQL

Batch Request Scalability

0

200

400

600

800

1000

1200

1400

1600

Physical Virtual

Tra

nsa

cti

on

s/S

ec

Hyper-V OLTP Workload Analysis

The 2 tests showed just a 6% difference between the brokerage application running on physical vs. virtual

Page 54: Data Culture Series -  Keynote - 27th Jan, London

APPAPP APP

VM IO

Random IO

But… HDD-based system are

optimized for sequential IO

VM VM VM

“IO Blender” effect

Virtualizing/consolidating

randomizes IO

Flash Storage removes this

constraint allowing greater

density levels and

guaranteed performance

Page 55: Data Culture Series -  Keynote - 27th Jan, London
Page 56: Data Culture Series -  Keynote - 27th Jan, London

Virtualisation Use Case

• Performance problems due to slow SAN

• Wanted to use Always-on replication with Private Cloud

Page 57: Data Culture Series -  Keynote - 27th Jan, London

Hybrid Cloud Data Platforms

57

Page 58: Data Culture Series -  Keynote - 27th Jan, London

Migrate Existing SQL Server Apps

58

Key Benefits

Low TCO for existing apps

New Migration Wizard

Familiar development tools

“We could just pick up our SQL

installs, move them over to Azure

VMs, and pick up where we left off."

Adam Salvo, Trek O

PT

ION

1

OP

TIO

N 2

VH

D

Data

base

P2V

V2V

Fast, easy

scalability

Cut IT hosting costs by

$15Kper month

Page 59: Data Culture Series -  Keynote - 27th Jan, London

SQL Server Develop & Test in the Cloud

59

Key Benefits

Reduce project overhead

Speed time to market

Secure, redundant source

code

“Telenor saved 70% on test,

development and demo that could be

turned off when finished to minimize

their capital outlays,”

Marius Pedersen, Telenor Group

70% savings

Ready in hours, not weeks

Noresource

limits

SQL Server Dev Tools On-Premises

Development Work Stations

SQL Server

On-Premises

Deploy

SQL Server in a

Windows Azure

Virtual Machine

Test

TFS in Windows Azure

Page 60: Data Culture Series -  Keynote - 27th Jan, London

On-premise network

Backup and DR in the Cloud

60

Key Benefits

Reduce CAPEX & OPEX

Low RTO disaster recovery

Speed global BI reporting

“Recovery times have dropped from

minutes to seconds… We’re seeing

almost no data loss.”

Recover in

seconds

Significant

costreductions

Windows Azure

Secondary replica

Run backups

Domain controller

Primaryreplica

Asynchronous commit

Run BI reports

VPN tunnel (Windows Azure Virtual Network)

Secondary replica

Synchronous commit

Page 61: Data Culture Series -  Keynote - 27th Jan, London

Create Hybrid Apps

61

Key Benefits

Reduce CAPEX & OPEX

Improve isolation of

internal assets

Greater global reach

“We now have the capacity to add a

lot more players and operators while

not losing any application

responsiveness”

Thomas Pullen, BetOnSoft

Improved availability & scalability

10xthe workload

with real-time

analytics

In-House Data Center

Azure-Hosted

Marketing Apps

Offloaded

BI Workloads

Metrics &

Monitoring Apps

Metrics

Databases

Viral Marketing

Databases

OLTP DB

AlwaysOn Primary

AlwaysOn Synchronous Replicas

Readable Secondaries

Windows Azure

Azure-Hosted

Marketing Apps

SQL Server 2012 AlwaysOn Cluster

Page 62: Data Culture Series -  Keynote - 27th Jan, London

Complete and consistent data platform

Page 63: Data Culture Series -  Keynote - 27th Jan, London

Explore the latest in SQL ServerVisit www.microsoft.com/sql to learn more about our latest innovations

Evaluate SQL Server 2014Get hands on – visit Microsoft’s TechNet evaluation center and

evaluate SQL Server 2014 today!

Evaluate Windows Server 2012 R2Get hands on – visit Microsoft’s TechNet evaluation center and

evaluate Windows Server 2102 R2 today!Microsoft Azure