oracle big data technológiák - ad...

27

Upload: phungtuong

Post on 08-Mar-2018

219 views

Category:

Documents


3 download

TRANSCRIPT

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Oracle Big Data technológiák a felhőben is

Fekete Zoltán Principal sales consultant 2016. április 6.

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

3

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Oracle Brings Business Value to Big Data

Enterprise-Grade Capabilities

Discover and Predict – Fast

Govern and Secure All Data

Simplify Access to All Data

Performance Integration Availability Scalability Manageability

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

The Big Picture – Oracle Big Data Management System SO

UR

CES

DATA RESERVOIR DATA WAREHOUSE

Oracle Database

Oracle Industry Models

Oracle Advanced Analytics

Oracle Spatial & Graph

Big Data Appliance

Apache Flume

Oracle GoldenGate

Oracle Event Processing

Cloudera Hadoop

Oracle Big Data SQL

Oracle NoSQL

Oracle R Distribution, ORAA4H

Oracle Big Data Spatial and Graph

Oracle Database

In-Memory, Multitenant

Oracle Industry Models

Oracle Advanced Analytics

Oracle Spatial & Graph

Exadata

Oracle GoldenGate

Oracle Event Processing

Oracle Data Integrator

Oracle Big Data Connectors

Oracle Data Integrator

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | 6

Integrating Data Reservoir and Data Warehouse

DATA RESERVOIR DATA WAREHOUSE

Oracle Loader for Hadoop

B Copy to BDA

Query in-place with Big Data

SQL

New: Oracle Table Access for

Hadoop

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Oracle Big Data Appliance: Standard és moduláris

7

Starter Rack: 6 node, össz.: 18 node

Elastic: node-onként bővíthető

Akár 18 rackig egyszerűen

összekábelezhető

Lekörözi a DIY clustereket:

Bekerülési költség kisebb

Gyorsabb bevezetés

Nagyobb teljesítmény

Skálázhatóbb

Exadata kapcsolat

Enterprise Manager framework

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Big Data Appliance X6-2 ÚJ!!!

Sun Oracle X5-2L Servers with per server: • 2 * 22 Core (2.2GHz) Intel Xeon E5-2699 v4 Processors

• 256 GB DDR4-2400 Memory, upgrade to 768 GB

• 96 TB Disk space (12 x 8 TB)

Included Software (4.4): • Oracle Linux 6.7

• Oracle Big Data SQL 3.0*

• Cloudera Distribution of Apache Hadoop 5.5.x – EDH Edition

• Cloudera Manager 5.5.x

• Oracle R Distribution

• Oracle NoSQL Database CE

8

* Oracle Big Data SQL is separately licensed

HC

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Oracle Big Data Appliance kiforrott, bizonyított, költséghatékony megoldás

“Oracle Big Data Appliance is an excellent choice for customers looking to work with the full suite of Cloudera’s leading Hadoop-based technology. It’s more cost-effective and quicker to deploy than a DIY cluster.”

⁻ Mike Olson, Cloudera founder, Chief Strategy Officer, and Chairman of the Board

9

Source: ESG White Paper

21% Cost Savings

33% Faster Time

to Value

Lower Costs

Faster to Implement

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Big Data Appliance – Core Design Principles

10

Operational Simplicity

• Consistently High Performance • Remove Bottlenecks

• Full Stack Install and Upgrades • Simplified Operations / Management

• Cluster Growth • Node Migration

• Always Highly Available • Always Secure • Latest Hardware Technologies for Hadoop and Spark

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Successful Big Data Systems Grow From Cluster Install with HA to Large Clusters to Dealing with Operational Issues

11

Day 1

• 12 node BDA for Production • Hadoop HA and Security Set-up • Ready to Load Data

RCK_1

Full install with a single command: ./mammoth –i rck_1

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Successful Big Data Systems Grow From Cluster Install with HA to Large Clusters to Dealing with Operational Issues

12

N N Example Service:

Hadoop Name Nodes

Day 1

RCK_1

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Introducing Oracle Big Data SQL 3.0

13

Massively Parallel SQL Query across Oracle, Hadoop and NoSQL

Oracle Database 12c

Offload Query to Exadata Storage Servers

Small data subset quickly returned

Hadoop & NoSQL

Offload Query to Data Nodes

SQL

data subset

SQL

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Apply Advanced Security on Hadoop & NoSQL

14

Same security policies apply to Hadoop & Relational

Oracle Database 12c

Small data subset quickly returned

Hadoop

Redacted data

subset

SQL

JSON data unconverted

in Hadoop

JSON

Customer data in Oracle

DBMS_REDACT.ADD_POLICY( object_schema => 'txadp_hive_01',

object_name => 'customer_address_ext',

column_name => 'ca_street_name',

policy_name => 'customer_address_redaction',

function_type => DBMS_REDACT.RANDOM,

expression => 'SYS_CONTEXT(''SYS_SESSION_ROLES'',

''REDACTION_TESTER'')=''TRUE'''

);

• Redaction

• Virtual Private Database

• Fine-grain Access Control

Oracle Big Data Appliance

2X Faster than

Do-It-Yourself1

Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause

the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For more complete information visit http://www.intel.com/performance. Tests document performance of

components on a particular test, in specific systems. Differences in hardware, software, or configuration will affect actual performance. Consult other sources of information to evaluate performance as you consider your purchase. For more complete information about performance and benchmark results, visit

http://www.intel.com/performance. 1 - Configurations were compared by using the Big Data Benchmark for BigBench.Oracle* Big Data Appliance configuration included 6 nodes comprised of: Intel® Xeon® CPU E5-2699 v3 (HT enabled) with 128 GB DDR4, 12 X 4TB HDD, Infiniband network (1 connection) observed max

throughput 24 Gb/sec, Oracle* Linux Enterprise 6, and CDH* 5.4.4 with modified configuration. DIY cluster configuration included 6 nodes comprised of: Intel® Xeon® CPU E5-2699 v3 (HT enabled) with 128 GB DDR4, 1 x 64GB SSD for OS, 12 X 4TB HDD, 10Gb network (1 connection), CentOS* 6.6, CDH* 5.3.3 with

minimal changes.

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Oracle Big Data Momentum: Customers around the World

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Oracle Big Data Cloud Service

• Starter Pack – 6 nodes, additional nodes

• 6 nodes with: 32 OCPU, 256 GB RAM, 48 TB storage per node.

• Big Data Connectors, Big Data Spatial and Graph,

• Oracle Data Integrator EE, ODI EE Advanced Big Data Option

• Dedicated instances in the Oracle Cloud, featuring 40 Gb/sec InfiniBand fabric inside Big Data Cloud Service and Database Cloud Service -- Exadata Edition.

• Simplified operations, and automated lifecycle management though a single command utility of the entire stack

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Oracle Big Data Cloud Service

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Service Status and Details

19

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Service Status and Details

20

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | 21

NoETL Engine 100% Native Data

Transformation Data

Integrator Big Data

Preparation

GoldenGate

Data Quality

Data Service Integrator

Metadata Management

Non-invasive CDC, Realtime streaming

data delivery

Profile, Cleanse, Match, and

Remediate Data

Prepare, Secure, Enrich and Publish Unstructured Data

Catalog, Trace and View Models across

the Enterprise

Federate Data Across DBs, Services

and Applications

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | 22

Big Data Preparation Cloud Service

Data Preparation Designed for data domain experts,

not programmers Focused on cleansing, enriching and

transforming unstructured business data

Operationalize data flows into ETL or BI

Key Benefits Easy to get started with browser

based application Better recommendations engine.

Machine learning with semantic technologies

Integrated into Oracle Cloud

Oracle’s Solution: Big Data Preparation Cloud Service (BDP) Prepare Data for Operational Workloads

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | 23

Oracle Big Data Preparation Core Capabilities Publish

• On Demand or

Scheduled • Source / Target

Definition • Restful APIs • Event Driven

Govern and Monitor

• Dashboards • Automated Alerts

• Reusable user policies • System Controls

• Security • Stats & Metrics

Ingest

• Import & Ingest • Detect Schema • Cleanse, Normalize

& De-duplicate • Detect & Mask

Sensitive Data

Enrich

• Profile • Annotate • Data Classification • Semantic

Enrichments • Extractions

• Unified solution to prepare unstructured data

• Simple to use tooling designed for non-programmers

• Unique technology approach combines Machine Learning (ML) with Natural Language Processing (NLP) engine

• Powered by Apache Spark, Hadoop, and UIMA

• Cloud operated from the Oracle Public Cloud

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

Oracle Big Data Spatial and Graph

Property Graph for Analysis of:

• Social Media relationships

• Internet of Things interactions

• Cyber-Security

Spatial Analysis Features for:

• Location Data Enrichment

• Proximity and containment analysis

• Preparation of digital map and imagery data sets

24

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | 25

CyberSecurity Modeling / Internet of Things

• Property graph model

• Dynamic construction of IP network

• The graph includes metadata as well as events/enriched data

• Extensible by other data source (add properties, relations)

• Search – Text search on graph DB proprieties

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |

További információ: Linkek, anyagok, videók, virtuális gép

• https://cloud.oracle.com/bigdata

• https://cloud.oracle.com/bigdatapreparation

• https://cloud.oracle.com/bigdatadiscovery

• https://cloud.oracle.com/nosqldatabase

• Oracle Big Data: https://www.oracle.com/bigdata/, Oracle Big Data Light VM letöltés

• Data Warehousing, Engineered Systems, Business Analytics

• Information Management and Big Data A Reference Architecture

Videók:

• Oracle Big Data csatorna, Oracle Big Data Discovery csatorna

• Oracle Data Integrator Getting Started Series, Oracle GoldenGate

• Oracle Advanced Analytics, Using SQL Pattern Matching with Big Data Lite VM