architecting your data lake with sap on aws
TRANSCRIPT
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Architecting your data lake with SAP on AWS
KK Ramamoorthy
E N T 3 1 0 - R
Principal Solutions Architect
Amazon Web Services
Data is everywhere
Data
every 5 years
There is more data than people think
15years
live for
Data platforms need to
1,000xscale
>10xgrows
Everyone needs access to data
There are more people accessing data
And morerequirements for making data available
Data scientists
Analysts
Business users
Applications
Secure Real-time
Flexible Scalable
Data lakes provide seamless access to data
Data lakes provide:
Relational and non-relational data
Scale-out globally
Diverse set of analytics and machine learning tools
Work on data without any data movement
Designed for low-cost storage and analytics
OLTP ERP CRM LOB
Data warehouse
Business
intelligence
Data lake
1001100001001010111001
0101011100101010000101
1111011010
0011110010110010110
0100011000010
Devices Web Sensors
Catalog
Machine
learning
DW queries Big data
processingInteractive Real-time
Things to consider when integrating with SAP data
“What” and “why” before “how”
Volume and performance requirements
Data context
Buy vs. build
License requirements
Total cost of ownership
Data extraction options from SAP ERP/BW
ABAP Stack
Tables/Views/Queries
IDOCs
Function Modules / BAPIs
CDS Views
Amazon S3
Data
Extractors/
Data Sources
SAP SLT
SAP supported
targets
(e.g. HANA)
Data orchestrators
SAP DataHub
Application level extractors
3rd party adapters
SAP Data Services
AWS Glue
SAP S/4HANA, ECC, CRM, BW
Database
Oracle SQL HANA ...
AWS Glue/AWS Lambda
AWS Glue/AWS Lambda
Operational
Data
Provisioning
(ODP)
OD
ata
3rd party adaptersAWS Glue/
AWS Lambda
Database level extractors
Database-level extraction
Database
Oracle SQL HANA ...
AWS Glue/AWS Lambda
Third-party adaptersAmazon S3
Key considerations
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Application-level extraction
ABAP stack
Function modules/BAPIs
AWS Glue/AWS Lambda
Third-party adaptersAmazon S3
Key considerations
IDocs
Tables/views/queries
SAP Data Services
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Operational data provisioning (ODP) based extraction
ABAP Stack
CDS Views
AWS Glue/AWS Lambda
SAP DataHub
Amazon S3
Key Considerations
Data sources /
Data extractors
ODP
OD
ata
SLT
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SAP Landscape Transformation (SLT)-based extraction
Database
Oracle SQL HANA ...
SAP-supported targets
(e.g. SAP HANA)
SAP Data HubAmazon S3
Key considerations
SLT
Custom ABAP code (BADIs)
AWS Glue/
AWS Lambda
End-to-end enterprise analytics with SAP data
S/4 Hana, ECC, BW
Finance Supply chain
...
Non-SAP applications
AWS IoT
Operational reporting &
embedded analytics
End-to-end enterprise analytics
Machine learning
Amazon
SageMaker
Amazon
Forecast
Amazon
Personalize
Amazon
Textract
Amazon
Transcribe
Amazon
Translate
Amazon
Rekognition
Amazon
Lex
Analyze
Amazon Redshift
Amazon Athena
Amazon Elasticsearch
Service
Consume
Amazon QuickSight
SAP S/4 HANA (SDA)
Kibana
SAP Fiori apps
AWS Lake Formation
Extract & transform
AWS Glue
AWS Lambda
Store
Amazon S3
Amazon S3 Glacier
AWS Glue Data Catalog
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Related sessions
ENT310 – Architecting your data lake with SAP on AWS (Builders Session; 4 times)
ANT204 – How Amazon leverages AWS to deliver analytics at enterprise scale
ANT218 – Data lakes and data integration with AWS Lake Formation
ANT206 – Leadership session: Trends with data lakes and analytics
Resources
SAP on AWS blog – https://aws.amazon.com/blogs/awsforsap/
SAP IDoc integration with Amazon Simple Storage Service (Amazon S3) –
https://amzn.to/2MMrQhJ
Run federated queries to an AWS data lake with SAP HANA – https://amzn.to/2IUSF1U
AWS Transfer for SFTP for SAP file transfer workloads – https://amzn.to/2BcWvz8
AWS Professional Services
Skills and experience from AWS
experts to supplement your team
AWS Training and Certification
Build cloud fluency across your
organization, develop skills, and validate
expertise
AWS Managed Services
Offload day-to-day AWS infrastructure
management and operation
AWS Support
Go beyond reactive break-fix with
proactive support programs
AWS IQ
A marketplace of AWS
Certified third-party experts
AWS customer enablementMigrate and build faster in the cloud
APN Partners
A global network of APN Partners
with deep AWS expertise
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Training and Certification for the enterpriseResources to help your organization build cloud skills and achieve business objectives
Cost savings
(TCO)
Staff
productivity
Operational
resilienceBusiness
agility
Digital training Classroom training AWS Certification Enterprise resources Talent pipeline
Comprehensive skill development plan for broad cloud fluency
Visit aws.amazon.com/training/enterprise
Thank you!
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
KK Ramamoorthy
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.