microsoft cloud data warehouse modernization on …...dw (teradata & oracle) with azure sql dw...

25
Microsoft Cloud Data Warehouse Modernization on Azure Ajit Kalura [email protected]

Upload: others

Post on 25-Apr-2020

17 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

Microsoft Cloud Data Warehouse Modernization

on AzureAjit [email protected]

Page 2: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

2 © Informatica. Proprietary and Confidential.© Informatica. Proprietary and Confidential.

Think BIGStart Small

Scale Fast

Our Data-Driven Digital Transformation Approach

Page 3: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

3 © Informatica. Proprietary and Confidential.3 © Informatica. Proprietary and Confidential.

Why Informatica for Azure?

200+Pre-built connectivity to

on-premises & cloud data sources

10xFaster to locate the

right data

17Microsoft product

integrations

"We wanted a vendor who would partner with us on our cloud journey. Informatica was willing to walk by our side. Moreover, they were committed to

our goals and making sure we achieved our desired outcomes.”

-- Ravi Ginjupalli, Senior Director, BI Analytics, Kelly Services

Page 4: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

4

Data Management Solutions For Microsoft

Power BIAzureBig Data /

Data Lakes

Intelligent Cloud Services

PowerCenter

Data Quality

SQL Data Warehouse and SQL Database Connectors

Power BI - Sales Management for SFDC Template

Microsoft Dynamics CRM, AX, GP, NAV Connectors

Dynamics

Big Data Management

Enterprise Information Catalog

Intelligent Data Lake

Data Lake and Blob Storage Connectors

Page 5: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

5 © Informatica. Proprietary and Confidential.

The Complete Cloud Data Management Journey

Where is the data I need to bring to Azure?

Can I rely on data I’m bringing to

Azure?

Discover

Cleanse

Master

Govern

Transformational Business

Outcomes

Secure

Only Informatica can help youovercome all of these data challenges to accelerate your journey to Azure

How can I protect my high

risk data?

How do I make sense of

overlapping and conflicting data?

How do I keep track of data across Azure and on-

premises?

How do I get data to Azure?

Populate

Page 6: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

6 © Informatica. Proprietary and Confidential.

Azure “On-Ramp”

Jumpstartingthe Cloud DataWarehousing Journey

Page 7: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

7 © Informatica. Proprietary and Confidential.7 © Informatica. Proprietary and Confidential.

Why Cloud Data Warehousing?

On-PremiseEDW

• Fast Reporting/Analytics• Inflexible

• Fast Reporting/Analytics• Flexible

Cloud Data Warehouse

• Flexible• Slower Reporting/Analytics

Hadoop/Big Data Architecture

Page 8: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

8 © Informatica. Proprietary and Confidential.8 © Informatica. Proprietary and Confidential.

Faster time to valueIncreased productivity

Reduced risksLower TCO

10x increase in customer

data sets that can be effectively handled vs. on-

premises

5mins to spin up

petabyte scale clusters and near real time data

availability

158% ROI with on-

premises migration

99.9% SLAs for the

fully managed service

Accelerating Time-to-market with a Modern

Data Warehouse

Page 9: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

9 © Informatica. Proprietary and Confidential.9 © Informatica. Proprietary and Confidential.

Beginning the Journey to Cloud Data Warehousing

3) Lift-and-Shift

DB DB DB

EDW

2) Extend

DB DB DB

EDW

1) Prototype

DB DB DB

EDW

New data consumption endpoint, could be an app or BI/Analytics

Existing data consumption endpoint, could be an application or BI/Analytics

Page 10: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

10 © Informatica. Proprietary and Confidential.10 © Informatica. Proprietary and Confidential.© Informatica. Proprietary and Confidential.

An American Office Staffing andWorkforce Solutions Company

• Think Big: Strategic initiative to become a modern data-driven company.

• Start Small: Initial project to replace on-premises DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture.

• Scale Fast: Leverage Informatica’s iPaaSIntelligent Cloud Services to quickly start moving data. Next step is to expedite analytics by mastering data to have a single version of the truth for employees and customers.

Cloud/Hybrid

Page 11: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

11 © Informatica. Proprietary and Confidential.11 © Informatica. Proprietary and Confidential.

Solution Architecture

Load CDC datafrom Oracle in toAzure SQL DW

Intelligent Cloud Services (IICS)

AzureSQL DW

Secure Agent

Business/On premise

Page 12: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

12 © Informatica. Proprietary and Confidential.12 © Informatica. Proprietary and Confidential.

The Solution for EDW Offloading to Azure….

+ +Data Integration& Management

Cloud DataWarehouse

DataCatalog

Page 13: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

13 © Informatica. Proprietary and Confidential.

Understand your data landscape withmachine learning-based,data asset discoveryand visibility

© Informatica. Proprietary and Confidential.

Page 14: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

15 © Informatica. Proprietary and Confidential.15 © Informatica. Proprietary and Confidential.

Enterprise Data Catalog on AzureMetadata Integration & Data Lineage

Key Features:

• End to end data lineage ad transparency

• Auto ingest metadata across the enterprise

• Catalog and classify metadata attributes for

business user access

• Business user friendly navigation interface

• Out of the box integration of technical metadata

with other Informatica solutions

Benefits:

• Capture, identify, and explain where data used ,

originates from, how it changes from source to

report

• Eliminate costly one-off, manual workarounds to

document metadata information for business

use.

Data Stewards

EnterpriseData

Catalog

Page 15: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

Enterprise Data Governance for Everyone

How can IT enable business discover data assets with verified data quality and traceability?

Data Architect

How can I discover, understand and trust data required for my analysis?

Data ConsumerData Steward

How can I manage metadata for key enterprise data assets?

How do I assess and manage quality through the data’s lifecycle

Data Governance Office

How can we implement data governance standards, facilitate change programs, monitor compliance?

How can I ensure data managed within application and supporting processes deliver

value to the business?

Data Owner

Axon EDC

EnterpriseData

Catalog

Page 16: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

Business & Technical Lineage Automation

Conceptual

Physical

Informatica

Axon

Enterprise

Information

Catalog

Docum

ent/E

nfo

rce

Valid

ate

/Recom

mend

Business

SME

Enterprise

Architect

EnterpriseData

Catalog

Page 17: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

19 © Informatica. Proprietary and Confidential.19 © Informatica. Proprietary and Confidential.

AI-Assisted Cataloguing

Conceptual Model

Discovery Models

Informatica Axon

EnterpriseInformationCatalog

De

fine

Data Set

Data Domain

Composite Domain

Data Domain

Data Domain

Dis

co

ver

AttributeAttributeAttribute

EnterpriseData

Catalog

Page 18: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

Best-in-classself-service data integration,synchronization, and management

20 © Informatica. Proprietary and Confidential.

Page 19: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

Intelligent Cloud Services on Azure

• Industry-leading cloud integration platform as a service (iPaaS)

• Cloud data integration, cloud app and process integration, API management

• Intuitive wizard-driven data integration GUI

21 © Informatica. Proprietary and Confidential.

Page 20: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

Informatica is the “On-ramp”to Azure SQL DW

• Connectivity to all on-premises data warehouse vendors

• Intelligent cataloging to make it easy to locate data to be moved to the cloud

• Best-in-class data integration capabilities

• Rapidly identify dependencies to develop a rock solid migration strategy

Solution Components

Secure Agent

Enterprise Data Catalog (EDC)

Intelligent Cloud Services (IICS)

Azure SQL DW

On-Premises EDW

Available via the Azure Marketplace

22 © Informatica. Proprietary and Confidential.

Page 21: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

23 © Informatica. Proprietary and Confidential.23 © Informatica. Proprietary and Confidential.

New! Industry leading iPaaS – Informatica Intelligent Cloud Services now Native on Azure

• Accelerate data-driven digital transformation with enterprise-class data & application integration for Azure

• Simplify data warehouse modernization to Azure with AI-driven data discovery

• Seamless access with Azure Login

Page 22: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

24 © Informatica. Proprietary and Confidential.

DEMO

Page 23: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

One Data Management Partner.

Many Journeys.

Cloud/Hybrid

Data Governance

360 Engagement

Next Generation Analytics

Page 24: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS

2626

Informatica is ready to be yourpartner for the Azure journey

www.informatica.com/azure

Page 25: Microsoft Cloud Data Warehouse Modernization on …...DW (Teradata & Oracle) with Azure SQL DW to have a more agile, flexible analytics architecture. •Scale Fast: Leverage Informatica’siPaaS