architecting your data lake with sap on aws

22

Upload: others

Post on 28-Jan-2022

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Architecting your data lake with SAP on AWS
Page 2: Architecting your data lake with SAP on AWS

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Architecting your data lake with SAP on AWS

KK Ramamoorthy

E N T 3 1 0 - R

Principal Solutions Architect

Amazon Web Services

Page 3: Architecting your data lake with SAP on AWS

Data is everywhere

Data

every 5 years

There is more data than people think

15years

live for

Data platforms need to

1,000xscale

>10xgrows

Page 4: Architecting your data lake with SAP on AWS

Everyone needs access to data

There are more people accessing data

And morerequirements for making data available

Data scientists

Analysts

Business users

Applications

Secure Real-time

Flexible Scalable

Page 5: Architecting your data lake with SAP on AWS

Data lakes provide seamless access to data

Data lakes provide:

Relational and non-relational data

Scale-out globally

Diverse set of analytics and machine learning tools

Work on data without any data movement

Designed for low-cost storage and analytics

OLTP ERP CRM LOB

Data warehouse

Business

intelligence

Data lake

1001100001001010111001

0101011100101010000101

1111011010

0011110010110010110

0100011000010

Devices Web Sensors

Catalog

Machine

learning

DW queries Big data

processingInteractive Real-time

Page 6: Architecting your data lake with SAP on AWS

Things to consider when integrating with SAP data

“What” and “why” before “how”

Volume and performance requirements

Data context

Buy vs. build

License requirements

Total cost of ownership

Page 7: Architecting your data lake with SAP on AWS

Data extraction options from SAP ERP/BW

ABAP Stack

Tables/Views/Queries

IDOCs

Function Modules / BAPIs

CDS Views

Amazon S3

Data

Extractors/

Data Sources

SAP SLT

SAP supported

targets

(e.g. HANA)

Data orchestrators

SAP DataHub

Application level extractors

3rd party adapters

SAP Data Services

AWS Glue

SAP S/4HANA, ECC, CRM, BW

Database

Oracle SQL HANA ...

AWS Glue/AWS Lambda

AWS Glue/AWS Lambda

Operational

Data

Provisioning

(ODP)

OD

ata

3rd party adaptersAWS Glue/

AWS Lambda

Database level extractors

Page 8: Architecting your data lake with SAP on AWS

Database-level extraction

Database

Oracle SQL HANA ...

AWS Glue/AWS Lambda

Third-party adaptersAmazon S3

Key considerations

Page 9: Architecting your data lake with SAP on AWS

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Page 10: Architecting your data lake with SAP on AWS

Application-level extraction

ABAP stack

Function modules/BAPIs

AWS Glue/AWS Lambda

Third-party adaptersAmazon S3

Key considerations

IDocs

Tables/views/queries

SAP Data Services

Page 11: Architecting your data lake with SAP on AWS

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Page 12: Architecting your data lake with SAP on AWS

Operational data provisioning (ODP) based extraction

ABAP Stack

CDS Views

AWS Glue/AWS Lambda

SAP DataHub

Amazon S3

Key Considerations

Data sources /

Data extractors

ODP

OD

ata

SLT

Page 13: Architecting your data lake with SAP on AWS

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Page 14: Architecting your data lake with SAP on AWS

SAP Landscape Transformation (SLT)-based extraction

Database

Oracle SQL HANA ...

SAP-supported targets

(e.g. SAP HANA)

SAP Data HubAmazon S3

Key considerations

SLT

Custom ABAP code (BADIs)

AWS Glue/

AWS Lambda

Page 15: Architecting your data lake with SAP on AWS

End-to-end enterprise analytics with SAP data

S/4 Hana, ECC, BW

Finance Supply chain

...

Non-SAP applications

AWS IoT

Operational reporting &

embedded analytics

End-to-end enterprise analytics

Machine learning

Amazon

SageMaker

Amazon

Forecast

Amazon

Personalize

Amazon

Textract

Amazon

Transcribe

Amazon

Translate

Amazon

Rekognition

Amazon

Lex

Analyze

Amazon Redshift

Amazon Athena

Amazon Elasticsearch

Service

Consume

Amazon QuickSight

SAP S/4 HANA (SDA)

Kibana

SAP Fiori apps

AWS Lake Formation

Extract & transform

AWS Glue

AWS Lambda

Store

Amazon S3

Amazon S3 Glacier

AWS Glue Data Catalog

Page 16: Architecting your data lake with SAP on AWS

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Page 17: Architecting your data lake with SAP on AWS

Related sessions

ENT310 – Architecting your data lake with SAP on AWS (Builders Session; 4 times)

ANT204 – How Amazon leverages AWS to deliver analytics at enterprise scale

ANT218 – Data lakes and data integration with AWS Lake Formation

ANT206 – Leadership session: Trends with data lakes and analytics

Page 18: Architecting your data lake with SAP on AWS

Resources

SAP on AWS blog – https://aws.amazon.com/blogs/awsforsap/

SAP IDoc integration with Amazon Simple Storage Service (Amazon S3) –

https://amzn.to/2MMrQhJ

Run federated queries to an AWS data lake with SAP HANA – https://amzn.to/2IUSF1U

AWS Transfer for SFTP for SAP file transfer workloads – https://amzn.to/2BcWvz8

Page 19: Architecting your data lake with SAP on AWS

AWS Professional Services

Skills and experience from AWS

experts to supplement your team

AWS Training and Certification

Build cloud fluency across your

organization, develop skills, and validate

expertise

AWS Managed Services

Offload day-to-day AWS infrastructure

management and operation

AWS Support

Go beyond reactive break-fix with

proactive support programs

AWS IQ

A marketplace of AWS

Certified third-party experts

AWS customer enablementMigrate and build faster in the cloud

APN Partners

A global network of APN Partners

with deep AWS expertise

Page 20: Architecting your data lake with SAP on AWS

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

AWS Training and Certification for the enterpriseResources to help your organization build cloud skills and achieve business objectives

Cost savings

(TCO)

Staff

productivity

Operational

resilienceBusiness

agility

Digital training Classroom training AWS Certification Enterprise resources Talent pipeline

Comprehensive skill development plan for broad cloud fluency

Visit aws.amazon.com/training/enterprise

Page 21: Architecting your data lake with SAP on AWS

Thank you!

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

KK Ramamoorthy

[email protected]

Page 22: Architecting your data lake with SAP on AWS

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.