moving your data to the cloud

Moving Data to the Cloud

Adwait Ullal

Moving Data to the Cloud

Who Am I Adwait Ullal

.NET Enterprise Architect Azure evaluation for a financial services firm Current position: Senior Software Architect at Digital Air

Strike

Contact info adwait.ullal@gmail.com http://www.adwait.com/ Twitter: @adwait

Moving Data to the Cloud

Audience Data Architects Enterprise Architects Solutions Architects Anyone interested in governance

Moving Data to the Cloud

Agenda Cloud landscape PaaS Components Storage Components Regulatory, Legal & Audit issues Technologies to use Big Data Relational database Integration Operations & Change Management Performance, Billing tips

Cloud Overview

Three Layered Cake

Infrastructure As A Service

Platform As A Service

Software As A Service

Platform As A Service

Components

Storage

Services (Authentication, Service Bus)

Compute

Storage

Components Queues Blobs Tables SQL Azure

Moving Data to the Cloud

Before You Move Regulatory issues

SOX PCI-DSS HIPPA Other industry or government regulations

Data Location/Breach legislation Storing EU data in the US State govt. data breach regulations

Moving Data to the Cloud

Before You Move Privacy issues

Storing PII? Encrypting PII If so, Key Management

Audit requirements Backup & recovery Tip

Consult your legal, audit depts.

Moving Data to the Cloud

Before You Move Remodel the physical model?

Stay with relational Use Big Data

Relational Does the provider offer relational? Limitations

Big Data Impact on applications, analytics

Moving Data to the Cloud

Big Data structures Azure

Blobs (unstructured) Scoped by container

Tables (semi structured, suitable for storing state) Scoped by PartitionKey, RowKey, TimeStamp

Queues Drives

How do these relate to your model Do you still need a relational DB to keep indexes

Moving Data to the Cloud

SQL Understand the limitations

Schema design Replication SSIS Analytics Reporting Integrated authentication

New Features Federation

Moving Data to the Cloud

Integration On-premise

Azure Connect WCF Sync Framework for replication

Moving Data to the Cloud

Integration Third party

Service Bus WCF File Transfer

Moving Data to the Cloud

Integration File Transfer

No FTP server in Azure Use blobs for file transfers

Replication Sync Framework

Moving Data to the Cloud

Operations Backups Database Monitoring

Support Mechanism

Change Management Who is responsible Is it SOX compliant

Moving Data to the Cloud

Performance & Billing considerations Understand how charges accumulate for

Storage access Bandwidth

Mitigation Collocate storage and compute resources Caching, global or local

Moving Data to the Cloud

Moving Data to the Cloud

T H A N K

Y O U