Session1: SAP HANA and Big Data

Dr. Bjarne BergAssociate professor Computer Science

Lenoir-Rhyne University

Introduction

2

The introductory session will look at the topic of big data and new computer capabilities with much faster in-memory data processing.

We will look at how the explosion in data growth is changing the way in which data is collected, analyzed, transmitted, and stored.

We will also explore how SAP HANA is transforming system landscapes, data warehousing, ERP processing, and real-time data access.

The session ends with a live demo of SAP HANA and BusinessObjects dashboards and reporting.

Session Agenda

3

• Introduction• Why Change to In-Memory Processing?• The Early Solutions• SAP HANA an Introduction• Demo • New Innovation and Interesting Usages• The Future and Big-Data Trends• Questions and Answers

The Creation of Big Data

4

90% of all digital information was created in the last 3 years.

By 2020 we will have 5,600 GB of data for every person on earth (incl. pictures, movies and music).

That is 40 Zettabytes!

The Issue: How do we store the big data and how can we access it faster?

Where is the data Located and What Drives the Growth?

5Source: WipPro, 2013

Data is Created Everywhere

6

Every day we create 25,000,000,000,000,000,000 bytes of data!(that is 25 quintillion bytes).

Total number of hours spend on facebook each month: 700 Billion

Data sent and received by mobile platforms and phones: 1.3 Exabytes

Number of emails sent each day: 2.5 Billion

Data processed by Google each day: 2.4 Petabytes

Videos uploaded to YouTube each day: 1.7 million hours

Data consumed by each world’s household each day: 357 MB (growing fast)!

Number of tweets send each day: 50 Million

Number of Products sold on Amazon each hour: 263 Thousand

Who Benefits the Most of Big-Data Access?

7

Source: University of Texas

Why In-Memory Processing?

8

FocusImprovement20131990

216 Addressable Memory

2614x52.27MB/$

0.02MB/$

Memory

6083x304.17MIPS/$

0.05MIPS/$

CPU

Technology

620MBPS

5MBPS

Disk Data Transfer

124x

1000 x100Gbps

100Mbps

Network Speed

264 248x

Source: 1990 numbers SAP AG, 2013 numbers, Dr. Berg

Disk speed is growing slower than all other hardware components, while the need for speed is increasing.

Source: BI Survey of 534 BI professionals, InformationWeek,

Why Change to In-Memory Processing?

9

• An History Lesson:• File systems were created to manage hard disks• Relational Databases were made to manage file stems• Application Servers were created to speed up

applications that ran on a database.

• Therefore:• Hard drives are DYING!• Relational databases are DEAD (they just don’t know it!)• Application Servers will become less important

Session Agenda

10

• Introduction• Why Change to In-Memory Processing?• The Early Solutions• SAP HANA an Introduction• Demo • New Innovation and Interesting Usages• The Future and Big-Data Trends• Questions and Answers

The Death of Storage and Access Technology is Normal

11

The Rate of Change – Disruptive Technologies

12

• Moore’s Law in technology:• Processing Speed will double every 18 month

• Paradigm shifts:• SAP HANA queries are executed 400-900 times faster than on

relational databases

The rate of change in Paradigm Shifts is much faster than the incremental

changes and a much lower cost

Session Agenda

13

• Introduction• Why Change to In-Memory Processing?• The Early Solutions• SAP HANA an Introduction• Demo • New Innovation and Interesting Usages• The Future and Big-Data Trends• Questions and Answers

SAP HANA — In Memory Options• SAP HANA is sold as an in-memory appliance. This means that both Software and Hardware are included from the vendors

• Currently you can buy SAP HANA solutions from Cisco, Dell, Fujitsu, IBM, NEC, Hitachi and HP

• The future of SAP HANA is to replace relational databases of ERP and data warehouses and run these on the in-memory platform

Source SAP AG,

SAP HANA has radically changed the way databases operate and make systems

dramatically faster.

SAP HANA — In Memory Options

Hardware Memory

128GB 256GB 512GB 1024GB

Cisco C260 X X

Cisco C460 X X

Cisco B440 X X+

Dell R910 X X X X

Hitachi CB 2000 X X X

NEC Express 5800 X X X+

Fujitsu RX 600 S5 X X X

Fujitsu RX 900 S2 X X+

HP DL 580 G7 X X X

HP DL 980 G7 X X

HP BL 680 X X X X+

IBM x3690 X5 X X X

IBM x3950 X5 X X X+

There are currently 7 different certified HANA hardware vendors with 13 different products.

Some boxes can be used as single nodes with others are

intended for scale-out solutions for large multi-node systems

The Hardware – IBM Example

SAP HANA — Available Special Applications• New Applications has been built that run on SAP HANA in-memory

processing and you can also build your own

ERP

Database

HANA

Virtual Data Marts

Applications

Databases

Virtual Data Marts

Virtual Data Marts

Virtual Data Marts

BI Solutions

Files

This provides much tighter integration with the source system (less data latency) and much faster query response time for high-volume analysis

Applications developed by SAP1. Planning & consolidation2. Customer revenue performance mgmt3. Predictive segmentation & targeting4. Trade promotion management5. Merchandise & assortment planning6. Sales & operations planning (SOP)7. Demand signal repository8. Profitability analysis 9. Dynamic cash management10.Strategic workforce planning11.Smart meter analytics (power companies)12. and much more…

SAP BusinessObjects Dashboards for Enterprise Management

Dashboards can be built using the SAP BusinessObjects Dashboards tool that takes advantage of the sub-second speed of HANA.

18

SAP Dashboards Example — Flexibility

• Graphs can be displayed many ways• Navigation can be done and saved as “scenarios

SAP Dashboards — Mobile Example

• Dashboards are most useful when compared to something

• This dashboard is relative to a business plan

• Notice that all graphs can be displayed many ways and that color coding is consistent across dashboards

It is all about getting fast performance when accessing high volumes of data

Formatted Number based Dashboard Example

Dashboards can also be highly formatted and static with little user interaction

The In-Memory capabilities of HANA allows managers to see all financials in one-place in hyper-fast speed..

Operational Dashboards for Line Managers

•Dashboards can be operational

•This dashboard focus on billing disputes and is used to monitor closing of cases

•The users of this dashboard are clerks in the billing office, not executives

22

With HANA – Real-time operational dashboards can by pushed to managers everywhere

Link of HANA data to Maps and News Feeds

• Dashboards are most useful when shared with others

• Power users can create great departmental dashboards that can be shared inside smaller organizational units

23

In this dashboard, the data is merged with Google maps and external news feeds. This makes the dashboard much more interactive and interesting.

Session Agenda

24

• Introduction• Why Change to In-Memory Processing?• The Early Solutions• SAP HANA an Introduction• Demo • New Innovation and Interesting Usages• The Future and Big-Data Trends• Questions and Answers

BI Workspaces and Modules

BI Workspaces allows you to link many SAP BI tools in the same area, without the need to jump between them. In this workspace, we have 6 Objects with 4 different technologies.

25

New Innovation in Medical Field for Big Data

26

CAT scans and X-Rays create an large amount of data that doctors have to review and access

HANA can store this and provide high volume and provide almost instant access to hundreds of Terabytes of data

X-Ray of Cancer Patient

CAT Scan of Tumor Patient

New Big-Data Innovation in Safety and Security

27

• Thousands of hours of video is taken at airports, banks, casinos, borders and other sensitive areas

• Facial recognition software can identify wanted criminals

• SAP HANA can store that data and process the information

New Big-Data Innovation – Weather and Fishery tracking

28

Tracking whether and execute predictive models require significant number of data points with high data volume

Modeling resources such as fisheries and specie movements also require significant data volumes and data points on catch information across the globe

New Big-Data Innovation – Company War Rooms

29

• In a multi-national company, data is created and consumed everywhere.

• With SAP HANA you can create a corporate war-room to track customer demand, shipments, marketing success and business intelligence

This picture is from Sprint phone company’s war-room to track usage and transition issues during system

mergers and product launches.

New Big-Data Innovation – Pollution Tracking

30

• Geo data from pollution, data modeling and tracking creates hundreds of Terabytes.

• SAP HANA can assist in storing and retrieving this data

With Predictive modeling and data visualization you can build sophisticated models on HANA. You

can even use the R-statistical library

New Big-Data innovation – Scientific Discovery

31

• The super collider center CERN, creates over one PetaByte every second it operates.

The new Spectre R telescope of Russia has 1000 times higher resolution than Hubble, generating billions of bytes of data.

Session Agenda

32

• Introduction• Why Change to In-Memory Processing?• The Early Solutions• SAP HANA an Introduction• Demo • New Innovation and Interesting Usages• The Future and Big-Data Trends• Questions and Answers

The Future and Big-Data Trends

33

Big data is being generated from micro and macro levels.

From human DNA for each person to the content of billions of stars in galaxies.

Internet usage Map by protocol

Computer based human interaction is getting more common and generating terabytes of data each second

A Map on the Whole Internet

Big-Data is only get more prominent. – can computers keep up?

The Future and Big-Data Trends – More Imaging

34

Companies will start accessing data visually instead of by numbers and text.

A data explosion visualized – Micro loans made

Users will have on-demand access to all

movies, songs, information in sub-

second speed

Demo 1: HANA Performance with 426 million rows

Demo 2- Live BOBJ on HANA

Summary

37

• SAP is a highly innovative company• We are removing hard drives and relational databases• Processing is going to in-memory• SAP HANA can do all this today• First we will move all data warehouses to HANA, then all

ERP systems• HAHA is much more than ECC and SAP BW (current tools)• HANA is a paradigm shift with lower operating costs• HANA is available today and is being implemented at

hundreds of companies in regular industries right now.

Questions and Answers

Dr. BergBergb@lr.edu