extending virtualized oraclerac with emc and vmware

8/10/2019 Extending Virtualized OracleRAC With EMC and VMware

1/33

Copyright 2012 EMC Corporation. All rights reserved.

Extending VirtuaOracle RAC AcroData Centers:True Active-Active Availability Distance

Sam Lucido, EMCKannan Mani, VMware Inc.,


2/33


Agenda

Customer Challenges

What is Oracle Real ApClusters (RAC)

What happens when afails using Oracle RAC

Transparent Applicatio

What is the single poinfailure with Oracle RAC


3/33


Customer Challenges1. Application and database availability Many m

critical systems demand 5 nines (99.999%) of upt

Per year no more than 6 minutes of unplanned dow2. Revenue Impact of unplanned downtime

Independent auditing of the revenue impact relateunplanned downtime can range from 10s of thousamillions of dollars per 24 hours of outage

3. Broad application availability availability of thentire application stack and not just the database

4. Rapid Provisioning and Greater Uptime Newnodes are provisioned in minutes and vSphere HA with RAC provides greater Uptime


4/33


What Is Oracle Real Application Cl

10 GbE Switch

Physical RAC Nodes

SAN Network

RAC

In

terconnect

SAN Storag

Database Listener

Database Listener

Database Listener

Real Application Clusters

(RAC)Is the federation ofservers to provide thefollowing benefits:

Fault Tolerance

Scalability

Manageability

Rolling Upgrades

Most customers useOracle RAC for faulttolerance and scalability


5/33


Stretched Oracle RAC Recovery Ty

10 GbE Switch

Physical RAC Nodes

SAN Network

RAC

Interconnect

b

Database Listener

Database Listener

Database Listener

If A Server Fails..

A service called, Clusterwarereports a change in clusters

membership pool

In-flight transactions arerestarted on surviving nodes

Database scalability andperformance could temporarily bereduced do to the loss of a serverin the cluster

Recovery involves reconfiguring

the RAC node back into thecluster


6/33 Copyright 2012 EMC Corporation. All rights reserved.

Stretched Oracle RAC and Fault Tol

10 GbE Switch

Physical RAC Nodes

SAN Network

RAC

Int

erconnect

SAN Sto

Database Listener

Database Listener

Database Listener

Oracle RAC Increases Uptime

Each node in a RAC grid actively

services database sessions

Transparent Application Failover

(TAF) is an Oracle Call Interface

(OCI) that provides these failover

types:

SELECT: recovery of an database

transaction to a surviving node

SESSION: failover of a sessionto a surviving node

While TAF can recover or failover

there might be an associated

delay

Applications must be designed to

use the OCI API to use TAF



Stretched Oracle RAC:

What is the Single Point of Failure?However unlikely a storage arrayfailure represents a totalapplication outage

*Exception: ASM stretch mirroring

Redundancy At Most Every Layer

NIC

NIC

NIC

NIC

NIC

NIC

10 GbE Switch

Physical RAC NodesSAN Network

RACInterconnect

SAN

Layer of redundancy:

Physical Federation of servers into

RAC nodes

Use of NIC bonding andteaming

Software

Duplication of RAC servicesacross all nodes



How Does EMC VPLEX Address TheChallenges?

A Hardware And Software Solution

Both within and between datacenters

Even across two physically separate sites

Simplify Oracle RAC deployment

Solution is transparent to RAC and other applications

Turn off ASM protection, keep voting disk on virtual volume

Certified by Oracle

EMC worked with Oracle to certify this mutual solution

Enables Dynamic Workload Availability

Active / Active database and application access across datacenters

With virtualization the capability to non-disruptively move virtual m



The Oracle Voting

Oracle RAC Voting Disk on V



EMC VPLEX Stretched Oracle RACMetro Resiliency With Synchronous Access Anywhere

Site ARAC

Interconnect

LAN Backbone LAN Backbon

VPLEX Witness3rd Domain

Same VirtualVolume

VPLEXInterconnect

VPLEX Witness provides

failure resiliency viastorage monitoring

Is a requiredcomponent forextended OracleRAC on VPLEX

Virtual volume issynchronouslyreplicated over VPLEXinterconnect

Oracle RAC managesnodes acrossinterconnect



Stretched Oracle RAC Without EMC

Site A SitRACInterconnectLAN Backbone LAN Backbone

Third site for voting diskusing NFS or iSCSI

A Voting Disk is a shareddisk device or file usedto determine nodeavailability (establishesquorum) and resolvesplit-brain scenarios:All nodes write to the

voting disk (check in)Must be stored in a raw

partition or regular filein a clustered filesystem like ASM

Prebra



Stretched Oracle RAC With EMC VP

Site A SitRACInterconnectLAN Backbone LAN Backbone

VPLEX Witness

Same VirtualVolume

VPLEXInterconnect

With VPLEX place the voting disk othe virtual volume

VPLEX Witnessprevents splitbrain syndrome

SimplifiedDatabase

Architecture

O l V ti Di k R d



Oracle Voting Disks: Recommenda

Oracle Clusterwarevoting disks withVPLEX Witness Required Should reside on

VPLEX virtual volumesand not in anindependent 3rd

domain VPLEX Witness

provides split-brainprotection

Oracle Clusterwaredeployment Create a unique disk

group for OracleClusterware files(+GRID)

The +GRID disk groupwill benefit from using

Normal or Highredundancy

Relatively small if noother database files

All othe Use ext

redundbased Rshould protectmembe



VMware Virtualiz

Oracle RAC On VPLEX

O l R l A li ti Cl t (RAC) VM V


15/33

Oracle Real Applications Clusters (RAC) VMware V

15

O l RAC S h D l t P Ch t


16/33

Oracle RAC on vSphere Deployment Process Chart

16

Oracle RAC Deployment Process on VMware vSphere - VMFS

CreateRAC

Database

InstallO

racle

RAC

InstallOracleGrid

Infrastructure

Crea

teOracleRAC

VirtualMachine

Create First Oracle RAC VM

(VMORARAC1)

Add VMFS VMDKOS and

Oracle Binary

Add two NICPublic and

Interconnect and set to

VMXNET3

Install GOS, VMware

Tools and configure

Device Persistent

Configure NTP client,

Storage and Networking

on all ESX servers

NOW

Save the VMORARAC1 VM

as Template

Install and Configure

VMware ESXi 5.0

Create Three Nodes

Clone from Template

Install and Configure

Oracle Grid Infrastructure

Add Shared Disks

following VMware KB -

1034165

Change SCSI type to

Paravirtual. Add and

configure CRS/ Voting

Disks and format disks

using fdisk

Change Host Name and

assign new IP address

Complete Oracle RAC

Deployment on VMware

Create Custom Oracle RAC

Database

Create and Add DAT,

REDO VMDKs D isks to

all RAC VMs. Change

SCSI type to Paravirtual

Format added VMDKs

using fdisk on Node 1 Create ASM Disk groupsfor DATA and REDO

Install Oracle RACBinares

Configure NTP Service

on GOS

RAC N d S h F t M ti f M i


17/33

RAC Node on vSphere Features vMotion for Mai

17

RAC N d S h Aft M i t


18/33

RAC Node on vSphere After Maintenance

18

Benefits of Oracle Databases on VMware


19/33

Performance

Rapid Provisioning

I/O is not an issue

Scale up and out

Streamline activation, deployment, and validation of s

Avoid manual configuration errors

Server Consolidation Fully utilize hardware

Maintain application isolation

Workload Management

Business Continuity

High Availability vMotion, HA, DRS

Without clustering or RAC

vCenter Site Recovery Manager

Hardware reduction at failover site

Benefits of Oracle Databases on VMware

Zero downtime maintenance

Migrate live databases


20/33


Oracle Redo LogLatencyOracle RAC On VPLEX


21/33


Oracle Database: Writing to the Re

DatabaseTransactions

LGWR(Log writer)

Database

OnlineRedo Logs

WriteAcknowledgement

ARCn(Archive writer)

ArchivelogfileArchive

logfileArchivelogfile

Database: LogThe Oracle dacommit transaupdate or deleacknowledgemreceived from

logs


22/33


Oracle Online Redo Log LatencyDatabase

Transactions

LGWR(Log writer)

Database

OnliRedo

WriteAcknowledgement

LOCAL Storage REMOTE

*Redo log write latency = longest amount of time it takes toacknowledge a write in remote storage

EMC VPLEX Metro


23/33


Round Trip TimeThe Differentiators

1 2msRound trip time

(RTT)

Ideal For OracleStretch RAC

3msRound trip time

(RTT)

Possible For DatabasLow Transactional v

4 - 5msRound trip time

(RTT)

All EMC provensolutions use a

network latency of2ms or less

The recommendation for VPLEX Metro is no more than 5ms RTTlatency over the wide area network. VPLEX Metro is certified for 5m

RTT with Extended Oracle RAC.

VPLEX M t With St t h d O l


24/33


Tests Overview

OLTP wo

70% rea 2 RAC no

2 RAC no

VPLEX ainterconndistance

Increaseadded no& 64 driv

*EMC VPLEX MCertified

VPLEX Metro With Stretched Oracl

0

5000

10000

15000

20000

25000

1 2 3 4

Distance: 0 km(baseline)

Distance: 100km (1ms RTT)

Number of RAC Nodes

Tra

nsactionRate

Of O d d l


25/33


Importance Of Write Order FidelityConsistency GroupsWrite order fidelity and deterministic I/O continuation

All database LUNs (ie, Oracle data, control and log files) require pre

write-order fidelityto maintain data integrity, and therefore shoulplaced in a single consistency group together.

1

2 23


26/33

F il S i VPLEX R ili


27/33


Failure Scenarios: VPLEX ResiliencSolution Physical RAC Virtual RAC Physical Single

Instance

Loss of a server(unplanned)TAF Manual restart orautomated if using

HA

Dependent on BootFile Systemreplication

Loss of a server (planned) Manual restart atsurviving site

Live Migration Dependent on BootFile Systemreplication

Loss of VPLEX Witness IO continues and Witness transparently rejoin

Loss of storage array TAF TAF + ColdMigration orautomated if usingHA

Dependent on BootFile Systemreplication

No loss of database access in these scenarios. Possible impact on scalability and performance until syst

O l S t F VPLEX O Li


28/33


Oracle Support For VPLEX On Linu

O l S t f VPLEX U i
http://www.oracle.com/technetwork/database/enterprise-edition/tech-generic-linux-new-086754.html


29/33


Oracle Support for VPLEX on Unix

RAC on vSphere History
http://www.oracle.com/technetwork/database/clustering/tech-generic-unix-new-166583.html


30/33


RAC on vSphere - History Milestones

Oracle support statement extension11.2.0.2Fall 201

MyOracleSupport.com Note 249212.1

For Oracle RAC, Oracle will only a

Service Requests as described in th

Oracle RAC 11.2.0.2 and later relea

Release of the Oracle Databases on VMware - RAC De

Guide Jan 2011

30

l O l


31/33


Transformation Cloud

Up to 3XPerformanceat Less Cost

40% MoreOracle CPUPer Server

80% FasterProvisioning

Backup With30x LessStorage

Tested, Proven Results

EMC Proven Solutions For OracleOracle Runs Faster And More Efficiently On EMC and V

Visit Online Oracle at EMC Comm


32/33


Visit Online Oracle at EMC Comm

http://www.emc.com/everythingoracle

Blogs, Polls, Events and Videos: One place for all EMC Oracle s

FindEMCE

xperts,

Tradesh

owsand

learnmore

aboutvirtualizin

gOracle

Search here!
http://www.emc.com/everythingoraclehttp://www.emc.com/everythingoraclehttp://www.emc.com/everythingoraclehttp://www.emc.com/everythingoraclehttp://www.emc.com/everythingoracle


33/33

extending virtualized oraclerac with emc and vmware

Documents