danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •data intensive processing...

32

Upload: others

Post on 29-May-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns
Page 2: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

<Insert Picture Here>

Exadata Database Machine

Alexsander Siqueira - Solution Architect Manager

Page 3: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

Exadata Database Machine

• Best Machine for Data Warehousing

• Best Machine for OLTP

• Best Machine for Database Consolidation

© 2010 Oracle Corporation 3

Page 4: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

• Launched in Fall 2008

• Seeing rapid adoption in all geographies and industries

Exadata in the Marketplace

© 2010 Oracle Corporation 4

Page 5: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

Exadata X2-2 Hardware Architecture

Database Grid

• 8 compute servers (1U)

• 2 Intel Sockets

Storage Grid

• 14 storage servers (2U)

• 2 Xeon CPUs per server

• 100 TB High Speed disk, or336 TB High Capacity disk

• 5 TB PCI Flash

• Data mirrored across storage servers

Scaleable Grid of industry standard servers for Compute and Storage

• Eliminates long-standing tradeoff between Scalability, Availability, Cost

InfiniBand Network

• Redundant 40Gb/s switches

• Unified server & storage net

© 2010 Oracle Corporation 5

Fully Redundant

Page 6: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

Start Small and GrowField Upgradeable

Full Rack

Half Rack

Balanced Incremental Scaling for OLTP and DW

Quarter Rack

© 2010 Oracle Corporation 6

Page 7: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

Scale to 8 Racks by Just Adding CablesFull Bandwidth and Redundancy

© 2010 Oracle Corporation 7

2368 Compute Cores

2.6 Petabytes Uncompressed Storage

Page 8: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

© 2010 Oracle Corporation 8

Balanced and Optimized

• Custom systems do not achieve full performance

• Component imbalance, misconfiguration, bottlenecks

• Exadata is engineered and optimized end-to-end

• Double-digit GB/sec transfers from disk to database

• DB libraries optimized with firmware, drivers, OS, network

• Years of tuning

• Move I/T talent to higher value business needs

• Not designing, tuning, maintaining hardware configsOptimized

End-to-End

Page 9: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

Keys to Speed and Cost Advantage

© 2010 Oracle Corporation 9

Exadata Hybrid Columnar Compression

Exadata Intelligent Storage Grid

Exadata Smart Flash Cache

Page 10: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

• Data Intensive processing runs in Exadata Storage Grid

• Filter rows and columns as data streams from disks (112 Intel Cores)

• Example: How much product X sold last quarter

• Exadata Storage Reads 10TB from disk

• Exadata Storage Filters rows by Product & Date

• Sends 100GB of matching data to DB Servers

• Scale-out storage parallelizes execution and

removes bottlenecks

Exadata Intelligent Storage GridMost Scalable Data Processing

© 2010 Oracle Corporation 10

Page 11: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

© 2010 Oracle Corporation 11

Exadata Intelligent Storage

• Exadata storage servers also run more complex operations in storage

• Join filtering

• Incremental backup filtering

• I/O prioritization

• Storage Indexing

• Database level security

• Offloaded scans on encrypted data

• Data Mining Model Scoring

• Smart File Creation

• 10x reduction in data sent to DB servers is common

Exadata Intelligent Storage Grid

Page 12: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

Exadata Hybrid Columnar CompressionHighest Capacity, Lowest Cost

© 2010 Oracle Corporation 12

• Data is organized and compressed by column

• Dramatically better compression

• Speed Optimized Query Mode for Data Warehousing

• 10X compression typical

• Runs faster because of Exadata offload!

• Space Optimized Archival Mode for infrequently accessed data

• 15X to 50X compression typical

Qu

ery

Faster and Simpler

Backup, DR, Caching, Reorg, Clone Benefits Multiply

Page 13: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

© 2010 Oracle Corporation 13

Exadata Smart Flash CacheExtreme Performance OLTP

• Exadata has 5 TB of flash

• 56 Flash PCI cards avoid disk

controller bottlenecks

• Intelligently manages flash

• Smart Flash Cache holds hot data

• Gives speed of flash, cost of disk

• Exadata flash cache achieves:

• Over 1 million IO/sec from SQL (8K)

• Sub-millisecond response times

• 50 GB/sec query throughput

Page 14: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

Unified Hardware, Specialized Software

© 2010 Oracle Corporation 14

• Exadata enables a single hardware architecture for all database needs

• Massively parallel hardware, InfiniBand, & Flash are best for all DB applications and workloads

• Enables Strategic building block approach to IT

• Domain specialization is in software, not hardware

• Oracle offers the most sophisticated specializations

• Analytics.

• OLAP, Statistics, Spatial, Data Mining, etc.

• Warehousing

• Flexible Partitioning, Bitmap Indexing, Join indexing, Materialized Views, Result Cache

• Data

• Relational, XML, Objects, Secure Files

• OLTP, Security, HA

Data Mining

OLAP

ETL

Page 15: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

Metrics

© 2010 Oracle Corporation 15

Page 16: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

16

• Fastest Disk Throughput

• Much Faster with Flash

• 50 TB of data fits in Flash

• Using 10x Query Compression

• Effective Query Throughput on

compressed data is even higher

• Hundreds of GB/sec

© 2010 Oracle Corporation

Teradata2580

NetezzaTwinFin 12

ExadataV2

Query ThroughputGB/sec Uncompressed Data

Single Rack

Flash

Disk

Faster than DW Appliances 50 GB/sec!

Page 17: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

17

• Exadata is fastest

• and scales with more racks

• Storage Arrays already can’t

deliver disk bandwidth

• No extra bandwidth from Flash

• No CPU offload

• No Columnar Compression

• No InfiniBand

© 2010 Oracle Corporation

Storage Data Bandwidth(Uncompressed GB/sec)

Fla

sh

More Bandwidth than High-End ArraysD

isk

ExadataV2

50 GB/sec!

1 RackMultiple Racks

Page 18: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

© 2010 Oracle Corporation 18

Extreme Performance OLTP

5X More I/Os than

1000 Disk Enterprise

Storage Array

• Best random I/O performance

• Exadata has 5 TB of PCI flash

• Exadata flash cache achieves:

• Over 1 million IO/sec from SQL (8K)

• Sub-millisecond response times

Page 19: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

More Data Capacity

© 2010 Oracle Corporation 19

Exadata V210x Compression

Teradata 25801.3x Compression

Netezza TwinFin2x to 4x Compression

EMC VMAX3x Oracle Compression

Systems with Equal User Data

All with Largest Disks, Best Compression

Page 20: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

20

DBFS - Scalable Shared File System

© 2010 Oracle Corporation

• Database Machine comes with DBFS shared Linux file system

• Shared storage for ETL staging, scripts, reports and other application files

• Files stored as SecureFile LOBs in database tables stored in Exadata

• Protected like any DB data – mirroring, DataGuard, Flashback, etc.

• 7+ GB/sec file system I/O throughput

• 5 TB/hour data loading using DBFS and parallel load

ETL Files in DBFS

Load into database using External Tables

ETL

More File Throughput than High-End NAS Filer

Page 21: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

New Top-of-the-Line

System

© 2010 Oracle Corporation 21

Page 22: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

02468

101214161820

2005 2006 2007 2008 2010

Sun Fire x4800

• Most Compact Enterprise SMP

in Market

• 5 Rack Units

• 64 Intel Xeon 7500 EX Cores

• 8 Sockets

• 1 TB Memory

• 128 Dimms

• 8 40Gb/sec InfiniBand Ports

• 8 10Gb/sec 10g Ethernet Ports

7500

Relative Intel 4-socket chip performance

Page 23: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

Top-of-the-Line Addition to Exadata Family: X2-8

Database Grid

• 2 64-core Intel EX Servers

• 2 TB Memory

• Choice of

• Oracle Linux Unbreakable Enterprise Kernel

• Solaris 11 Express

Storage Grid

• Same Storage Grid as Exadata X2-2

• CPUs updated to latest 6-core Xeon

Scale-Out Grid of Large SMP Servers – Best of Both Worlds

Network

• Redundant 40Gb/s Infiniband

• 10 Gb Ethernet to Data Center

Page 24: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

Best Machine for Database Consolidation

© 2010 Oracle Corporation 25

• Exadata serves as farm/cloud for

databases

• Large memory enables many databases

to be consolidated

• Extreme performance for complex

workloads that mix OLTP, DW, batch,

reporting

• I/O and CPU resource management

isolates workloads

ERP

CRM

Warehouse

Data Mart

HR

Page 25: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

Complete Family Of Database MachinesFor OLTP, Data Warehousing & Consolidated Workloads

• Quarter, Half, Full and Multi-Racks • Full and Multi-Racks

Oracle Exadata X2-8Oracle Exadata X2-2

Page 26: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

New Software

Updates

Database 11.2.0.2

Exadata 11.2.2.1

© 2010 Oracle Corporation 27

Page 27: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

Main Goal: Stability and Robustness

• Main focus over last year has been fixing and fine-tuning

• Working with dozens of customers deploying everything from

multi-hundred TB warehouses, to stock trading systems, to

business apps like E-business suite, Siebel, and PeopleSoft

• DB Machine bundle patches approximately every other month

• Full stack testing – Exadatda, DB, ASM, Clusterware, OS

• September release of DB patchset 11.2.0.2, Exadata 11.2.2.1

• No architectural changes, lots of fixes and point improvements for

performance, robustness, diagnostics, management, and security

Page 28: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

Roadmap

• Hardware

• Exalogic

• Architecture is stable. Will track component updates

• Chips, memory, disks, flash, etc.

• We allow mixing of servers across generations

• Software

• Solaris 11 Express x86 on Database Nodes

• Exadata Smart Flash Log – lower latency log writes

• Write-back flash Cache

• Remote Syslog Auditing for Storage

• Snapshots on DB Server local disks

• Snapshot Oracle Home before making changes

Page 29: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

Exadata Summary

• Best for OLTP

• Smart Flash Cache

• 1 Million I/Os per Second

• Best for Warehousing

• Intelligent Scale-Out storage

• 10x faster queries

• 10x Data Compression

• Best for Consolidation

• Terabytes of Memory

• Mix OLTP, DW, batch,

reporting in single machine

• Complete Ready-to-Run

System

• Full database encryption

with near zero overhead

• Runs all Oracle Applications

unchanged

Page 30: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns
Page 31: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

SGA

Cenário Proposto – OracleProcessamento de Consultas em um Ambiente Convencional

Storage Array

Oracle Database

Grid1Cliente pede A

# * $ # & @ &

% * @ & @ ^ #

% @ * & A @ $

^ { ] $ # % A2

Cliente pede B

3

Cliente pede A

B

B

Page 32: danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing runs in Exadata Storage Grid •Filter rows and columns

Memória Operacional

SGA

A A

A A

Cenário proposto – OracleArquitetura Exadata - Cache especializado para a área de trabalho

Exadata Storage Disks

Oracle Database

Grid1Cliente pede A

2Cliente pede B

3Cliente pede A

B B

B B

A A

A A

B B

B B

A A

A A

# * $ # & @ &

% * @ & @ ^ #

% @ * & A @ $

^ { ] $ # % AB

B