eci sparc

Introducción a Oracle’s Enterprise Cloud Infrastructure with SPARC T5 Servers

Fran NavarroPrincipal Sales Consultant

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.The development, release, and timing of any features or functionality described for Oracle’s products remain at the sole discretion of Oracle.


Agenda

Oracle’s Cloud Strategy

Oracle’s Optimized Solution for Private Cloud

Enterprise Cloud Infrastructure Solution

Examples and Best Practices


Challenges in Moving to Private Cloud Infrastructure

• Maintaining security and availability

• Delivering on-demand access to compute Infrastructure

• Orchestration and automation needed for load-balancing and self-healing

• Deployment of mission critical applications

• Building and operating private cloud infrastructure can be expensive


Cloud Drivers

$Green

Reduce time to Market

Change IT Cost

Structure

Reduce Complexity RMS

TopPlan

RDW

MAS

RDM

RDM

RDM

MAS(Tandem)

RTE(Z)Tandem

AIM

SalesAudit

TMS

Sorter

PeopleSoft(FMS)

PeopleSoft(HR)

Stores Stores Stores Stores Stores

Credit Switch

CreditAuthorizer

Tandem(Fine

Jewlry)

BusinessWarehouse

EJ

Aspect

ReconNet

EquityEdge

BlueBird

Planalytics

Scale on Demand

Optimizing test/dev

environmentsMetering and Chargeback

Virtualization

Strategic

Tactical


Flexible Adoption – Roadmap to Cloud

Private Cloud

• Self-service• Auto-scaling• Metering &

Chargeback• Capacity planning

Public Cloud

• Specialized• Shared• Standardized

Hybrid Cloud

• Federation across public & private clouds

• Interoperability• Cloudbursting

Traditional Silos Consolidated

• Physical• Dedicated• Static• Heterogeneous

• Virtual• Shared platform

& shared infrastructure

• Dynamic• Standardized

platform & infrastructure

Start with consolidation • Extend to private cloud • Use public cloud where appropriate


Enterprise Platform: Complete Choice in Cloud

Applications

Cloud Platform

Cloud InfrastructureC

loud

M

anag

emen

t

Common Infrastructure Services

Platform Services

Application Services

Social Services

Private Cloud ProductsDeployed in Your IT

Public Cloud ServicesDeployed in Oracle Cloud


Enterprise Platform: Oracle Private Cloud

Oracle Enterprise Manager

• Business-Driven Application Management

• Cloud Lifecycle Management

• Cloud Stack Management

Applications

Platform as a Service

Infrastructure as a Service

Oracle Fusion Middleware

Oracle Database

Oracle VM Server for SPARC, Oracle Solaris Zones


Build a Private Cloud: More ChoiceFrom Best in Class to Engineered Systems

Best-of-Breed Products Oracle Optimized Solutions Engineered Systems


Oracle Optimized SolutionsComplete Solutions to Address a Broad Range of Customer Needs

Full StackFull StackTestingTesting

APPLICATION

Storage

Servers

OS and Virtualization

Database

Middleware

Applications


SuperCluster

Oracle’s Engineered Systems PortfolioLeadership in the converged infrastructure market

ExalogicExadata

Oracle Virtual Compute Appliance

NEW!

DBaaS PaaS DBaaSPaaSIaaS IaaS


The Oracle Virtual Compute Appliance

Pre-built system, ready to use with minimal setup

Removes the integration risk for deploying infrastructure

Integrated application provisioning with pre-built templates

Fully virtualized system with built in software defined networking for ultimate flexibility

From Power on to production in about an hour


Integrated Software Defined Networking

Wire Once Infrastructure• Connect any VM dynamically to any IO resource• Prewired for simplicity, add compute nodes on demand

Increased Application Flexibility• Deploy and grow applications as your needs change• Dramatic improvement in app to app communication

Software Upgradable System• Appliance features added as SW, no HW changes needed• System managed as a singe resource to patch and upgrade


Oracle Virtual Compute Appliance X3-2Software Overview

Server Virtualization

and

Guest OSes


and

Guest OSes



Oracle VM Server Virtualization•All major x86 operating systems

•Oracle Linux •Oracle Solaris

•Microsoft Windows

Oracle Virtual Compute Appliance controller• Oracle VM Manager

• Oracle SDNNetworking

Networking

Automation & Management

Automation & Management• Oracle Fabric Manager


Oracle Virtual Compute Appliance X3-2Hardware Specifications Overview

Fabric Interconnect

Fabric Interconnect

Fabric Interconnect

Fabric Interconnect

Compute

Nodes

Compute

Nodes

Compute Nodes

Compute Nodes

Mgmt NodesMgmt Nodes

Management Storage

Management Storage

InfiniBand expansion

InfiniBand expansion

Ethernet switch

Oracle Sun X3-2 Servers• 2 to 25 nodes• CPU: Up to 400 cores / 800 threads aggregate• Memory: Up to 6.4TB aggregate• Only 3 cables per server, fully redundant

• Oracle Sun X3-2 Servers

• Oracle Sun X3-2 Servers

Oracle Sun ZFS Storage Appliance 7320• Redundant controllers, RAID storage

• Oracle Fabric Interconnect F1-15

• Oracle Fabric Interconnect F1-15

• Oracle Switch ES1-24• Oracle Sun Data Center InfiniBand Switch 36

• Oracle Sun Data Center InfiniBand Switch 36

Netw

orkin

gN

etwo

rking

Man

agem

ent

Man

agem

ent

Four 4x10GbE

40Gb/s S

erver-to-Server

Network

Storage


Oracle Optimized Solution for Enterprise Cloud Infrastructure


Patch regression

tests

Load/stress tests

Performance and scalability

tests

Real world workload

tests

Sizing and configuration optimizations

Faultinjection

tests

Faultinjection

tests

Optimizations Across the Development CycleEngineered, Tested, and Proven from Apps-to-Disk

Interoperability tests

Interoperability tests

End to end functional validation

End to end functional validation

Early development

tests

Early development

tests

Identify integration

opportunities

Identify integration

opportunities

Full Stack OptimizationsOne Engineering Team


New ⎮ SPARC T5 Servers

Improves the price/performance leadership established by SPARC T4– 2x Throughput improvement

– 20% Clock frequency increase

– 4x Increase in overall scalability

Over 15 World Record Benchmarks with Oracle Applications Expands the range of SPARC T-Series servers

– Ranging from 4-core (Netra) and 8-core (T4) to 16-core (T5) servers

– Increase socket scalability to 8-sockets (32 128 cores)➠

Longer lifecycle for SPARC T4 Servers– SPARC T4-1, T4-1B, T4-2, T4-4, and Netra SPARC T4-1 will have extended

lifecycles

Next Generation SPARC T-Series Systems


SPARC T-Series Servers

Scalable– SPARC T4 and T5 processors support single and multi-threaded

applications

– Deploy multi-tier apps and database solutions

Integrated– Built-in, no-cost virtualization capabilities

– Seamless management services

Secure– Integrated Crypto-Acceleration

– Military grade O/S Security

Ideal for a Wide Range of Applications


Sun ZFS Storage Appliance: Extremely Scalable

DescriptionA scalable, intelligent set of storage products running common software resulting in the economical management of large amounts of data with ease of deployment and simplified management. Addresses a wide spectrum of scalability, density, performance, and availability requirements.

Workloads Unstructured data, throughput oriented applications, mid-scale transaction and sequential processing, working data sets which fit in cache.

Use Cases File sharing, web storage, consolidation of virtualized environments requiring multiple data services, consolidation and backup/archival, streaming video/media, development environments.

3.3-177 TB 432 TB 2.59 PBSun ZFS Storage 7120 Sun ZFS Storage 7420Sun ZFS Storage 7320


Oracle Solaris 11: First Fully Virtualized OSReduce costs. Increase agility. Infrastructure as a Service.

Server

Web Tier

Application Tier

Database Tier

Network

Storage

Finance Dataset

HRDataset

SalesDataset


Virtualize with Oracle

Oracle VM Server for SPARC

Up to 128 Virtual SystemsLive MigrationBuilt-in, no costMultiple OSsP2V EnhancementsDynamic, Low-overhead

Oracle VM Server for SPARC

Up to 128 Virtual SystemsLive MigrationBuilt-in, no costMultiple OSsP2V EnhancementsDynamic, Low-overhead

Oracle Solaris Zones

Thousands of PartitionsSolaris Resource ManagerSolaris 8 and 9 ContainersSolaris 10 ZonesBuilt-in, no costDynamic, Low-overhead


Thousands of PartitionsSolaris Resource ManagerSolaris 8 and 9 ContainersSolaris 10 ZonesBuilt-in, no costDynamic, Low-overhead

Complete Virtualization

SPARC Hypervisors OS Virtualization


Optimized for SPARC / Oracle Solaris

Isolated OS and applications in each logical (or virtual) domain

Firmware-based hypervisor

Each logical domain runs in dedicated CPU thread(s)

SPARC Hypervisor

T-SeriesServer

Oracle VM Server for SPARCThe Virtualization Platform combining the best of Oracle Solaris and SPARC for Your Enterprise Server Workloads


VM Type Use Case Recommendations

Use OVM domain based VM’s where the following are most important

– Native Oracle Solaris 11 or Oracle Solaris 10 OS is desired

– Max. uptime with Live Migration, HA clustering

Move a running domain to another host with no downtime

– Relatively powerful VM’s with dedicated resources are desired

Maximum 16 LDoms per node recommended

For performance, recommendations use 1 CPU core per Domain as a minimum

– Disk intensive applications recommended in Primary domain with shared NFS based storage or SAN LUNs for best performance

– Where heavy environment patching and configuration required for an App

Each Domain can have its own kernel and does not depend on other domains/zones patch levels

– Where dedicated resource allocation (CPU, RAM, Disk) required for SLA’s

– Maximum environmental separation of OS instances (Security)

– Access all available disk storage options Local, NFS, iSCSI, or SAN based virtual disks

Oracle VM Server for SPARC Domains


Oracle Solaris 11: Server VirtualizationSelf Service IT Administration

• High density consolidation

• Strict, secure multi-tenancy

• Rapid multi-system deployment

Web Tier

Application Tier

Database Tier

• Dedicated data, network

• Delegated administration

• Built in load balancing

• Highly available clustered zones, VMs

• Migration of VMs

15x lower virtualization overhead vs VMware

4x lower latency vs. KVM


VM Type Use Case Recommendations

Use Oracle Solaris Zone based VM’s where users need

– Customers are deploying images extracted from older Oracle Solaris 8, 9 or 10 environments

“Branded Zones” allow images of Oracle Solaris 8,9 or 10 systems to be imported

– Highly granular resource management available

Access to slices of shared CPU’s and on demand access to available memory

Ideal for very lightweight/occasional workloads

– Near Zero performance overhead from virtualization

Even lower virtualization overheads than OVM for SPARC

– Highest consolidation of ‘lighter’ applications

Consolidation as high as 128 Zones is feasible per SPARC T4-2 / 256 zones for SPARC T5-2

– Allows simplification of Kernel Patching compliance enforcement

Zones share kernel patch levels with the Global Zone

Simplifies zone management processes and compliance issues

– iSCSI/SAN storage recommended for Zone image storage

Zones are not supported running from an NFS mounted filesystem



• Virtualization Management• Oracle VM SPARC Domains and Zones

• Configuration Management • Patch OS, Update Firmware,Configuration Compliance

• Operating System Analytics

• Maintainence• Health Checks, Remote Management, Phone Home

Oracle Enterprise Manager Ops CenterComplete Management for Oracle Hardware, OS & Virtualization


Solution Architecture Overview Oracle Optimized Solution for Enterprise Cloud Infrastructure for SPARC

++ + ++

ZFS StorageSun Network 10GbE Switch 72p

Sun ZFS Storage Appliance

Half Rack Full Rack


Accommodating the Increased need to Control

– Power/Run Control of Physical & Virtual

– Software Life Cycle Mgmt/Patching

– Resource Awareness and Penetration

– Remote Provisioning of Server/Storage/Network/VMs

– 4 Possible OS Versions

– 2 Virtualization Technologies

– Shared and Boundary Resource Models

Highly Dense Compute Solution

ECI on SPARC - Standard Configuration

• 10 x SPARC T5-2 servers in a 42 RU rack• 2,560 threads@ 3.6GHz• 5TB of RAM• 400Gbps of 10gbE bandwidth• 80 PCIe slots• Sun ZFS Storage Appliance (60TBs+)• up to 320 x 8 thread/16GB RAM VMs

• up to 2,560 x 1 thread/2GB RAM VMs

30

Rack Layout Half Rack Configuration

GbE Management Switch10GbE ToR Switch #210GbE ToR Switch #1

SPARC T4-1 OC12 Server

7320 ZFSSA Storage Cluster Heads

ZFSSA Storage Shelf

SPARC T5-2 Virtualization node #1





• Standard HW Configuration– 1 x SPARC T4-1 OC12 server– 1 x 48 port Mgt Switch– 1 x 7320 Storage

• 2 x Heads• 1 x storage tray

– 5 x SPARC T5-2 virtualisation hosts– 2 x 15KVA Single phase PDUs

31

Rack Wiring10GbE Wiring

QSFP to SFP+ cable ToR-Server wiring

• ToR #1• Cable 1 – QSFP port 1

1. 7320 Head #1- port 1

2. 7320 Head #2- port 1

3. SPARC T4-1 OC12- port 1

4. - not used

• Cable 2 – QSFP port 21. SPARC T5-2 #1-1-1

2. SPARC T5-2 #1-2-1

3. SPARC T5-2 #2-1-1

4. SPARC T5-2 #2-2-1


2. SPARC T5-2 #3-2-1

3. SPARC T5-2 #4-1-1

4. SPARC T5-2 #4-2-1

• Cable 4 – QSFP port 4*1. SPARC T5-2 #5-1-1

2. SPARC T5-2 #5-2-1

3. - not used

4. - not used

• ToR #2• Cable 5 – QSFP port 1

1. 7320 Head #1- port 2

2. 7320 Head #2- port 2

3. SPARC T4-1 OC12- port 2

4. - not used


2. SPARC T5-2 #1-2-2

3. SPARC T5-2 #2-1-2

4. SPARC T5-2 #2-2-2


2. SPARC T5-2 #3-2-2

3. SPARC T5-2 #4-1-2

4. SPARC T5-2 #4-2-2

• Cable 8 – QSFP port 4*1. SPARC T5-2 #5-1-2

2. SPARC T5-2 #5-2-2

3. - not used

4. - not used

KEY : SPARC T4-2 #1-1-1 = Server 1, PCI card 1, Port 1(top)*Option to replace “QSFP to 4 x SFP+” Cables 4 & 8 with 4 x “SFP+ to SFP+” cables

Cab

le 4

C

able

3

Cab

le 2

Cab

le 1

Cab

le 5

Cab

le 6

Cab

le 7

Cab

le 8

32

Rack WiringManagement 1GbE Harness

1G

bE

Ma

na

ge

me

nt

Ha

rne

ss

• ILOM connected via NETMGT port

• 18 ports used on GbE Management Switch• ILOM NET MGT for

platform discovery and management

• NET0 for OS provisioning and monitoring

• Remaining 30 ports available for other uses


SPARC T5-2 Mid-Range Server

Compute– 2 SPARC T5 16-core 3.6GHz CPUs

– Up to 32x DDR3 DIMMs, up to 512GB memory

I/O and storage– 6x 2.5” SAS 3.0 or SSD drives

– 8x PCIe 3.0 slots

– 4x 10GbE ports

Availability and management– RAID 0/1

– Redundant, hot-plug fans and power supplies

– Oracle Integrated Lights Out Manager Service Processor

2-Socket Data Center Consolidation & Back-Office Server

Copyright © 2013 Oracle Corporation 34

Oracle SPARC PortfolioSPARC T-Series Servers

Higher Performance Bigger Data Greater Application Consolidation

SPARC T4-1B8-cores T4-1B /256GB Memory

SPARC T4-18-cores @ 2.85GHz

256GB Memory


512GB Memory

SPARC T4-432-cores @ 3GHz

1TB Memory


2TB Memory


4TB Memory


512GB Memory

SPARC T5-1B16-cores T5-1B512GB Memory


Infrastructure Software

Operating System• Oracle Solaris 11 native

• Solaris 11 Zones• Solaris 10 Zones

• Oracle Solaris 10 native• Solaris 10 Zones• Solaris 8 & 9 Zones

Virtualization• Oracle VM Server for SPARC (2.1+) Domains• Oracle Solaris Zones (including Branded

Zones)

Management• Oracle Enterprise Manager Ops Center 12c

Management• Oracle Enterprise Manager 12c (for Full

Cloud Features)

Clustering• Oracle Solaris Cluster (for true HA)• Oracle Clusterware (for Oracle Database)

Database• Oracle Database • Other databases

Middleware• Oracle WebLogic Server (FMW)• Other Middleware SW

Applications• Oracle, ISV and customer applications

qualified on Oracle Solaris 8, 9, 10 or 11

Base Software StackOptional Software


Examples and Best Practices


Self-Service Private IaaS for Dev/TestCaseStudy

Scope/Scale:• 2600+ physical servers with

over 10,000+ VMs

• 4,000+ developers submitting 45,000+ jobs

Results:• Develop wait time reduced

from weeks to <1 hour

• People required reduced from 12 to1

• Server utilization – 80+% overall, 90+% peak

• 75% less power and space


Retail Customer Legacy Configuration

(2) SF T5240

(8) SF V240

(2) SF280R

(1) SF V210

(1) SF V880

(2) SF V490

(1) SF V220R

(6) SF V480R


New Cloud Infrastructure

Site ASite A Site BSite B


How is the hardware usedMedium Configuration, 5 x SPARC T5-2, 7320, 1 Tray

10GbE ToR Switch #210GbE ToR Switch #1

7320 ZFSSA Storage Cluster Heads

ZFSSA Storage Shelf





2 X T4-2, OVM for SPARC Pools

2 X T4-2, Solaris Zones Pools

ZFSSA Zone & Domain image store

10GbE

}}

}}

Up to 32Domains

Up to 256 Zones

Up to 256 Shares/LUNs



T4-2 Node 3T4-2 Node 3 T4-2 Node 4T4-2 Node 4

Half Rack with HA ExampleConsolidation use case Resources don’t need to be evenly split between DB & Apps LDoms CPU and memory can be migrated between Domains as required… live. Automatic resource allocation rules to migrate Domains within the Server Pools Software HA via Oracle Solaris Cluster for apps, Clusterware for DB

SPARC T5-2 Node 2 (16C/256G)SPARC T5-2 Node 1(16C/256G)SPARC T5-2 Node 1(16C/256G)

DB

2C/12G

Solaris 11

DB 11gR2

Apps

4C/8G

Solaris10

Siebel

ISV app

DB

2C/12G

Solaris 11

DB 11gR2

Apps

4C/8G

Solaris 10

Siebel

ISV app

Node 1-4 = “VMpool”

“VMpool” sharedstorage on NFS/LUNsallowing live-migrations

Within each Node, mayDynamically allocate

resources between VM’s16Cores available, 6 used

256GB available, 20G used


Database + Oracle Solaris Apps deployment use case Entire nodes dedicated to each stack in this example

Spare nodes or resources can be held for migration and recovery actions

More flexible pool member configs for optimized storage and network for DB or Apps etc…

Allowing better separation of application types to specific pools

T4-2 Node 4T4-2 Node 4T4-2 Node 3T4-2 Node 3T4-2 Node 2T4-2 Node 2T4-2 Node 1T4-2 Node 1

Full Rack with HA Example

SPARC T5-2 Node 3SPARC T5-2 Node 3

Solaris 11

DB 11gR2


Apps LDom

Solaris10

Siebel

ISV app


Apps LDom

Solaris10

Siebel

ISV app


Solaris 11

DB 11gR2

Solaris 10 LDOMs Solaris 10 LDOMs Node 1-4 = “DBpool”Node 5-8 = “APPpool”

“DBpool” specific storageConfig for DB performance

“APPpool” specific Network Config for APP connectivity

Live-migrate within poolsDR resources in nodes for

HA and headroom


Oracle Enterprise Manager Ops. Center 12Navigation Panel- All assets visible here- Expandable and sortable- Frequently refreshed- Status visible at a glance

Job Status Bar- Tracks Jobs- In Progress- Succeeded- Partially Succeeded- Stopped- Failed- Deleted- Scheduled- Last Job status- Expands for more detail- Drill down multiple steps

Currently Selected…- Current Object Options- Tabbed headline scroll - Asset properties/status

Actions menu bar- Context Sensitive- Expandable- Scrolls for rich objects

Pop-up Windows- In Context Detail- Staged Dialogue boxes- Alerts- Etc…


Typical Workflow Within Ops Center 12cFresh Asset Discovery

1. Update library with latest Patches/firmware/OS images/Templates from MOS/Local repository

2. Discover new T5-2 platform asset via its ILOM SP

3. Locate/Create OS Deployment profile and plan

4. Apply Deployment plan to discovered asset

5. Allocate asset to appropriate Asset Pool

New VM Deployment

1. Deploy a new VM (Zone or Domain) into the Pool

Migrate VM within a Pool

1. Select the VM for migration

2. Select a target platform In the pool to migrate to

3. Migrate (automatically Live Migrates Domains and Cold Migrates Zones)


Typical Workflow

New VM Deployment

Deploy a new VM (Zone or Domain) into the Pool

Specify VM parameter Specify OS parameters Deploy

Migrate VM within a Pool Select the VM for migration Select a target platform in the pool Migrate (automatically Live Migrates

Domains and Cold Migrates Zones)

Typical Workflow Within OC12


Services Overview

Pre-production (Readiness)Pre-production (Readiness)

Production (On-going Operations)Production (On-going Operations)

Services include:Workshops, Installation, Configuration Reviews, Production Readiness, Go-Live Support etc.

Services include:Configuration, Performance, Production Diagnostic, and Patch Reviews

Go

Liv

e


Services for Pre-production Environments

•Review technical and availability requirements

•Risk Analysis

•Businesscontinuity review

•Transition recommendations

•Test planning and control activities

•Pre-production testing

•Go Live Systems support

•Global deployment methodologies

•Installation and configuration

•Project management of entire solution

Sample Activities:

Sample ServicesPre-production (Readiness)Pre-production (Readiness)


Services for Production Environments

•Risk mitigation, project controland issue management

•Documentation and knowledge transfer

•Proactive guidance

•Dedicatedsupport team

•Configuration and performance reviews

•Recommendations for on-going optimization

Sample Activities:

Sample Services Production (On-going Operations)Production (On-going Operations)


Enterprise Cloud Infrastructure on SPARCTop Reasons for Investing in Oracle ECI for SPARC

Better TCO Better 5 year TCO than IBM 740 P7+ and HP DL380 G8

Performance Over 15 World Record T5 SPARC Benchmarks demonstrate leading application performance

Compatibility Preserves investment in software to avoid costly and complex migrations

Solutions Better value from Oracle integration & faster deployments

Management Visibility and management through the entire software and hardware stack

Service ACS/OC can accelerate time to service with Installation, Configuration, Migration and Support

Roadmap Exciting path to future performance gains and additional Cloud functionality

Security No-cost integrated software and hardware features

Single Vendor Easier to deal with one company


“The Oracle Optimized Solution for Enterprise Cloud Infrastructure provides a customizable solution that can be tailored specifically for our clients running Oracle systems. If customers are running Oracle software and they are moving to the cloud, this is the solution they should be using because true to form, ‘Oracle runs better on Oracle.’”

Don SwansonCEOdcVAST

Copyright © 2013 Oracle Corporation 51

Oracle Solution CenterOracle Solution Center Oracle Optimized SolutionsOracle Optimized Solutions Oracle Systems Webcast Center

Oracle Systems Webcast Center

Resources

Ready to Get Started with an Onsite Workshop or Assessment?Ready to Get Started with an Onsite Workshop or Assessment?

oracle.com/osc oracle.com/optimizedsolutions oracle.com/goto/SystemsWebcast

Call Your Oracle Sales Consultant or Authorized Oracle Partner

Join the Twitter Conversation - hashtag: #SPARCJoin the Twitter Conversation - hashtag: #SPARC


http://oracle.com/optimizedsolutions

Learn More About Oracle Optimized SolutionsAccess To Webcasts, Videos, Whitepapers, Blogs, and More

eci sparc

Technology

oracle cloud

oracle andor

private cloud infrastructure

oracle solaris zones

cloud drivers

sole discretion of oracle

public cloud services

service infrastructure