consolidation through virtualization

CONSOLIDATION THROUGH VIRTUALIZATION

Pavel AnniProduct Marketing ManagerSun Microsystems, SEE region

DC Utilization & Complexity 2007

Virtualization - the (only) way to increase Efficiency & do 'More with Less'

Average Utilization35% 15% 5%

High OPEX: Complexity & Overhead caused by redundant DC ComponentsHigh CapEX: Resources are only 20% utilized (Source: Gartner)

1/1/1 Deployment leads to Server Sprawl, Low Utilization, Redundancy & Complexity

N Instances of an Application

will bring

N redundant OS Instances

and

N additional Servers

into your DC !

ServerServer

OS InstanceOS Instance

App. InstanceApp. Instance

1/1/1 Deployment ... ... Effects

... and add significantly to DC Cost - TCA (CapEX) as well as TCO (OpEX)

The root of the problem

Dat

a C

ente

r Man

agem

ent

Server

OS

Application

Service

Storage

Client

Dev

elop

erNE

TWO

RK

DatabaseDatabaseAppServer

MailServer

AppServer

Average server utilization between 5 to 15%

Server sprawl is hard to manage. Deployment takes too much timeSingle

application per server

Why Consolidate?Development servers Test servers Production servers

Infrastructure serversFreeBSD

FreeBSD

Why Consolidate?

Web Web ServerServer

Email Email ServerServer

DNS DNS ServerServer

App App ServerServer

DB DB ServerServer

One application per server

Increasing operational and

mangement costs

Dir Dir ServerServer

Average utilization rate is 5%-20%

Sun Confidential: Sun Employees and Authorized Partners Only

Why don't we run all applications on one server?• Applications will compete for CPU, Memory, I/O• Applications will compete for system resources

> specific files: logs, temporary file, configuration etc.> devices: network ports

• Lack of security isolation• Lack of fault isolation• Different OS requirements

> versions, patch levels, configs

Different virtualization technologies to solve different problems

IT Megatrend 'Virtualization'

● Press● Virtualization Articles double Y/Y, now #1, Security #2 (Source.:Heise Online, Computerweek Online)

● Analysts● THE Topic 2006: IDC + Forrester + Gartner + D.H. Brown + Morgan Stanley + ....

● Customers (Source: IDC)● 75% of large companies (5000+ employees) are in process of deploying a virtual servers● 45% of new server purchases in CY2006 are expected to be virtualized● In 2009 1m+ server will be virtualized annually ~15B$ TAM (HW, SW and Services)● Virtualized server Business: 172,000 units in 2004, 1,209,000 units in 2009, i.e. CAGR of 47.7%. ● Virtualized system images in partitions: 778,000 in 2004 , 5,107,000 in 2009, i.e. CAGR of 45.7%. ● Unix images CAGR of 34.7%., Windows images CAGR 51.4% , Linux images CAGRs of 55.3%

System Virtualization CategoriesHard Partitions Virtual Machines OS Virtualization Resource Mgmt.

Server

OS

App

> Very High RAS> Very Scalable> Mature Technology> Ability to run different

OS versions

> Very scalable and low overhead

> Single OS to manage> Ability to live migrate Apps> Cleanly divides system and

application administration> Fine grained resource

management

> Very scalable and low overhead

> Single OS to manage> Fine grained resource

management

> Ability to live migrate an OS

> Ability to run different OS versions and types

> De-couples OS and HW versions

Multiple OS's Single OSTrend to flexibility Trend to isolation

Sun Solaris OS VirtualizationMinimum Overhead & Redundancy, Maximum OpEX Reduction,

Hard Partitions Virtual Machines OS Virtualization Resource Mgmt.

Server

OS

App

Server Virtualisation OS Virtualization

SMP: DynamicSystem Domains

CMT: logical Domains

Solaris Containers

Solaris Containersfor Linux

Solaris 'Flying'Containers

Solaris ResourceManager

VMware

Xen

SPARC x64 Solaris 10 Solaris 8+

Solaris Resource Manager Increasing CPU utilization through CPU shares

App AApp A20%20%

App B33% App CApp C

14%14%

App DApp D33%33%

App AApp A 30%30%

App B50%

App CApp C20%20%

App A (3 shares)

App B (5 shares)

App C (2 shares)

App D (5 shares)

Solaris Resource Pools

• CPUs can be assigned to application or group of applications

• Granularity: > 1 CPU core for UltraSPARC IV+ or x64 > 1 virtual CPU (hardware thread) for UltraSPARC T1, up

to 32

• Administrator can set pool boundaries> min 2 CPUs, max 8 CPUs> CPUs will be distributed according to workload > sum of max can be more than total number of CPUs

Resource Management

• Benefits:> low overhead> great flexibility, automated resource reassignment> can assign [virtual] CPUs (hardware threads in

UltraSPARC T1) or CPU shares

• Drawbacks:> Lack of isolation (security, faults, filesystems)

• Recommended:> if applications can coexist (don't access the same file for

writing etc.)> if no security isolation requirements

Sun Solaris OS VirtualizationMinimum Overhead & Redundancy, Maximum OpEX Reduction,


Server

OS

App

Server Virtualisation OS Virtualization



Solaris Containers




VMware

Xen


Solaris Containers for Virtualization

Server

OS

ApplicationStrong isolation between App and System

Administrators

Very lightweight and scales with

any Solaris system

OS Virtualization built into the kernel

CalendarServer

Database WebServer

Isolating Operating Environments: files, processes, users, network

Solaris 10 ContainersReview

network device

(hme0)

storage complex

global zone (v1280-room3-rack12-2; 129.76.4.24)

web zone

zone root: /zone/web

crypto project(ssl)

remote admin/monitoring

(SNMP, SunMC, WBEM)

platform administration

(syseventd, devfsadm, ifconfig, metadb,...)

proxy project(proxy)

core services

(inetd, rpcbind, sshd, ...)

network device

(ce0)

zone management (zonecfg(1M), zoneadm(1M), zlogin(1), ...)

Ap

plic

atio

nE

nvi

ron

me

nt

Virt

ua

lP

latf

orm

hme0

:2

ce0:

2

zcon

s

/usr

zoneadmd

database zonezone root: /zone/mysql

dba users proj(sh, bash, prstat)

system project(inetd, sshd)

hme0

:3

ce0:

3

zcon

s

/usr

network device

(ce1)

global zone root: /

audit services(auditd)

security services(login, BSM)

ce0

ce1

cons

ole

/usr

default pool

(1 CPU; 4GB)

system services(patrol)

mysql project(mysqld)

60

web service project(Apache 1.3.22)

app users proj(sh, bash, prstat)

jes project(j2se)

system project(inetd, sshd)

60

0

20

15

10

5

70

20

10

pool1 (7 CPU; 3GB), FSS

hme0

:1

ce0:

1

zcon

s

/usr10

app_server zone

zone root: /zone/app

pool2 (4 CPU; 5GB), FSS

zoneadmdzoneadmd

Solaris Containers + CMTApache 1.3 Apache 2.0

Mail

8 Cores = 32 Hardware threads

Solaris 10

'Flying'

Container(App. Migration)

OS Virtualization across

System Boundaries

Solaris Containers

• Benefits> Strong security isolation> Software fault isolation> Can be copied and moved between servers> Low overhead> Only one OS instance to manage

• Drawbacks> No hardware isolation

• Recommended> Development, test, production (but not on the same

server)

Sun x64 Server VirtualizationThe Multi OS Choice


Server

OS

App

Server Virtualization OS Virtualization


CMT: Logical Domains

Solaris Containers




VMware

Xen


VMware ESX: Windows Virtualization

Server

OS

Application

Server

ApplicationMailServer

WebServer

FileServer

Solaris, Linux and Windows

support

Integrated Control Domain and Hypervisor

Sun Fire x64 Servers

Increasing Server Utilization through Hardware virtualization

Sun Fire X460050+ VM in 4 RU

• CPU/Memory> 8 AMD Opteron CPUs > Single- or Dual-Core> 128 GB RAM

• I/O> 2x PCI-X, 6x PCI-E Slots> 4x Gigabit Ethernet Ports> 4x SAS 2.5” HDD, DVD

• Availability> redundant Power supply (n+1)> redundant Fan > RAID 0,1

• Management and OS> IPMI 2.0, HTTP, remote KVMS over

10/100 Ethernet Port> Solaris (pre-installed), Linux,

Windows, and VMware

Suns HighEnd x64 Systems – perfect for Virtualization

51 : 1

1 Sun Fire X4600

• Virtualized 1 app per server• Simplified management• Much less rack space• Power consumption and

heat savings

2 Racks of Installedx86 Servers

(Older Models)

VWware Virtual Machines

• Benefits> Real hardware emulation> Several OS instances> Different OSs can be installed> Resource management> VMotion

• Drawbacks> Hardware overhead> Administrative overhead

• Recommended> Windows/Linux consolidation (but not on the same system

Xen: Sun Fire x64 Virtualization

Server

OS

Application

Solaris stability and functionality enhances Xen

MailServer

WebServer

FileServer

Leverage Xen community Hypervisor

Solaris, Linux and Windows

support


● Predictive Self- Healing● Dtrace● Security

Sun SPARC Server VirtualizationThe Ultimate in RAS & Security, various Solaris SPARC Versions, ideal for Solaris 10 Containers


Server

OS

App




Solaris Containers




VMware

Xen


Server Virtualization: Logical Domains

• A hardware virtualization solution for T1000, T2000 and Netra T2000 and future CMT processors

• Partitions a single physical system into one or more fully isolated “logical domains”

• Enables fine-grained “physical to virtual” resource mapping and physical resource sharing

• Physical resource can be dynamically reassigned without impact on running OS images

• Exploits CMT properties for effective, efficient partitioning

WorkloadsWorkloads

LogicalLogicalDomain 1Domain 1

LogicalLogicalDomain nDomain n......

GuestGuestOSOS

ImageImage

GuestGuestOSOS

ImageImage

GuestGuestOSOS

ImageImage

LogicalLogicalDomainDomainManagerManager

LogicalLogicalDomain 0Domain 0

HypervisorHypervisor

Physical / Virtual ResourcesPhysical / Virtual Resources(CPUs, LANs, Storage, OS Images, Patches, Firmware)(CPUs, LANs, Storage, OS Images, Patches, Firmware)

ServiceServiceProcessorProcessor

Logical Domains: UltraSPARC CMT Virtualization

Server

OS

ApplicationMailServer

WebServer

FileServer

Solaris or Linux Control Domain

Ultra lightweight

Hypervisor in the firmware

Solaris or Linux guest domains

Sun Fire CoolThreads Servers

Sun SPARC CMT: Virtualized by Design

Memory PCI-Express I/O

L2 Cache

Crossbar Switch

CPU

#1

CPU

#2

CPU

#3

CPU

#4

CPU

#5

CPU

#6

CPU

#7

CPU

#8

Container 1Webserver

Container 2Appserver

Container 3Database

● CMT = SMP System on a Chip● SPARC SMP Style Partitioning: ● LDoms -> efficient HW Partitioning● Solaris 10 Container -> finegrained

SW Partitioning● Unmatched Efficiency for multiple

UNIX Services in one system● Today: Network centric Unix Svcs.● Tomorrow: Data centric Unix Svcs.

● Unbeatable in Price/Performance

Solaris Logical Domains (LDoms)

• Benefits> Several OSs on one machine (on one chip!)> Low overhead> Solaris or Linux> Can be dynamically adjusted

• Drawbacks> Hypervisor – single point of failure> Administrative overhead

• Recommended> If you have to have different patch levels or versions of

Solaris

Dynamic System Domains: UltraSPARC SMP Virtualization (since 1997)Virtualization Technology for ultimate Security & Availability

Dynamic System Domains

• Benefits> 100% HW (!) Isolation> Dynamic Reconfiguration> Zero Overhead> No Downtime, No Reboot

• Drawbacks> Finest Granularity is Boards (will be 1 CPU in the next

generation)

• Recommended> If no real-time flexibility is needed (twice a day is OK)> If customer has Solaris 8 or 9

Server Virtualization: Reduce CapEx

ServerServer



Virtualized ServerVirtualized Server(providing virtual Systems for OS Instances)(providing virtual Systems for OS Instances)





ServerServer



ServerServer



ServerServer



......

......N

N

N

N

N

1

Less Servers, highly utilized ... - Available for all professional System Platforms

OS Virtualization: Reduce CapEX+OPEX ...

ServerServer



ServerServer

OS InstanceOS Instance(providing virtual OS Containers for App. Instances)(providing virtual OS Containers for App. Instances)

App. InstanceApp. Instance App. InstanceApp. Instance

ServerServer



ServerServer



ServerServer


App. InstanceApp. Instance ......N

N

N

N

1

1

Solaris 10 Containers: Less OS Instances to maintain & Less Servers, highly utilized !!

Server plus OS Virtualization

ServerServer

ServerServer(providing virtual Systems for OS Instances)(providing virtual Systems for OS Instances)

ServerServerServerServerServerServer


App. InstanceApp. InstanceN

N+M

1+1 OS InstanceOS Instance(providing virtual OS Containers(providing virtual OS Containers

for App. Instances)for App. Instances)

N

N

Application X

1

ServerServerServerServerServerServerServerServer


App. InstanceApp. InstanceM

M

M

Application Y

App.App.InstanceInstance

...... App.App.InstanceInstance

Application Y

OS InstanceOS Instance(providing virtual OS Containers(providing virtual OS Containers

for App. Instances)for App. Instances)

App.App.InstanceInstance

...... App.App.InstanceInstance

Application X

Minimal Maintenance & Overhead for OS Instances, optimal Utilization of ServersFull Resource Flexibility on Server & OS Level

Suns System Virtualization Options

Inst (A)

OS (A)

Sys (A)

Inst (A)

OS (A)

Sys (A)

Inst (A)

OS (A)

System (A)

Inst (A)

OS (A)

Inst (A)

System (A)

Inst (A)

OS (A)

Inst (A)

System (A)

Inst (A)

OS(A)

Inst (A') Inst (A')

OS(A')No Virtualization✗ OS Overhead✗ Low Utilization

Sun & Others

Sun only

Sun only

Server Virtualization✔ SPARC SMP: Dyn. Domains (1998)✔ other UNIX/RISC: l/v/xPARs (2000)✔ x86/64: VMWare (2004), XEN (2006)✔ SPARC CMT: LDOMs (2006)

OS Virtualisation✔ Solaris 10 Container (x86/64, SPARC)

Server & OS Virtualization✔ Solaris 10 Container✔ good on HighEnd x86/64 (VMWare, XEN)✔ very good on CMT (LDoms, 9/2006) ✔ perfect on HE SPARC SMP (Dynamic Domains)

4 Ways to run 2 Instances of an App 'A' - most efficient Solutions are Sun-only

The Ideal Virtualization Platforms

10+ Years Binary Compatibility20+ Years System Compatibility

Sun Servers and Solaris

Next Gen

AMD Now

Shipping

Summary: Virtualization EverywhereOnly Sun Puts It All Together

Dev

elop

er

Dat

a C

ente

r Man

agem

ent

Server

OS

Application

Service

Storage

Client

ERP EMAIL CRM ERP

Net

wor

k

Optimized systemresources

Strong disaster recovery capabilities Faster application

(re)deployment

DatabaseDatabaseAppServer

MailServer

Web

AppServer

Efficient energy usage

Tools for configuration, provisioning, deployment &

Suns End-to-End System Virtualization


Sun Fire Enterprise Servers

Sun Fire CoolThreadsTM Servers

Sun FireFF/DC Servers

Logical Domains VMWare (XEN) Dynamic Domains Dynamic Domains, xPars

Solaris 10 Container Solaris 10 Container Solaris 10 Container Solaris 10 Container

Server Virtualization PLUS OS Virtualization for all Sun Platforms

OS Virtualization

Server Virtualization

Get in Touch with Sun Virtualization

Virtualize your DC - Today !

• Define Application Stacks> x86/64 - non Solaris: VMWare Objects (OS+App)> x86/64 or SPARC Solaris: Container Objects (App)

• Automate DC Management> Provisioning> Automated Load Distribution> HA/Disaster Recovery

• Evolution in Billing, Revolution in Cost> Resource (Container) Usage billed, not HW (CPU/Svr.) > significantly lower Costs (or higher Margin) ....

Raise Resource Utilization to 75%, simplify Application Lifecycle Management

How Sun Delivers VirtualizationSun Offers Repeatable Best Practices and Expertise

VirtualizationJustification

Review

Perform in-depthTCO analysis

VirtualizationArchitecture

Architect new,consolidatedenvironment

Implementation

Deploy solution,train staff and

manage the newenvironment

VirtualizationWorkshop

Define project scope, evaluate TCO (high level)

Step 1

Step 4Step 3

Step 2

Want to Learn More?• Get Solaris

> sun.com/solaris/get• Get trained

> sun.com/solaris/training• Get data sheets & whitepapers

> sun.com/solaris/reference_materials• Learn how to use Solaris 10 technologies

> sun.com/solaris/teachme> sun.com/software/solaris/howto_guides.jsp

• Move to Solaris 10> sun.com/solaris/move

Five easy ways to try Solaris

• Download the Latest Update (Solaris 11/06) from http://www.sun.com/software/solaris/get.jsp

• Download the Latest Solaris Express (12/06) from http://www.sun.com/software/solaris/solaris-express/get.jsp

• Download Belenix OpenSolaris LiveCD from http://www.genunix.org/distributions/belenix_site/

• Download Nexenta GNU Solaris LiveCD from http://www.gnusolaris.org/gswiki/Download

• Download Solaris VMware Appliance from http://developers.sun.com/solaris/downloads/index.jsp

Try and Feel the Difference!

http://www.sun.com/software/solaris/get.jsp

http://www.sun.com/software/solaris/solaris-express/get.jsp

http://www.genunix.org/distributions/belenix_site/

http://www.gnusolaris.org/gswiki/Download

http://developers.sun.com/solaris/downloads/index.jsp

THANK YOU!

WHAT DO YOU THINK?

Pavel [email protected]

Sun: End-to-End System VirtualizationServer & OS Virtualization on all Platforms


Server

OS

App




Solaris Containers




VMware

Xen


x86/64: Virtualization on the RiseGartner: Virtualized Servers need scalability, significant I/O and RAS

Sun Ultra 20

Sun Ultra 40

SunFire X2100

SunFire X4100

SunFire X4200

SunFire V40z

SunFire X4600

SunFire X8000

x64 Line

Non virtualised

(1-2CPU)Pot. virtualised

(2+CPU)Virtualised

2+CPU,Top I/O,RAS

$

$$

$$$

Solaris 10 - Key Feature OS VirtualizationSolaris unique Selling Points - DC Efficiency Enablers

AvailabilityAvailability Platform ChoicePlatform ChoiceSecuritySecurityPerformancePerformance VirtualisationVirtualisation

Solaris 10Containers

D(ynamic)Trace & new TCP/IP Crypto Framework & Rights Mgmt.Predictive Self Healing & ZFS

SPARC& x86/x64

500 Mio. $ R&D, 3000 MY, 100% indemnified, 100% Open Source, 600 new Features11/2006: 6,5 Mio. Downloads (80% x86), > 650 certified HW-Plattforms, > 1500 Apps on x86 (SAP, Oracle, IBM, EMC, ...)

Solaris 10: Containers

OS Virtualization with Solaris 10Benefits above and beyond Server Virtualization

• Whats new:> Multiple autonomous Servers on top of just one OS Instance> App.Instances (ideally of same Type) live in those Servers

• Whats better:> Less Overhead: one OS instead of multiple 'redundant' OSs> Less Maintenance: Less OSs to patch, 'Life Update' further simplifies Patching> Less Complexity & Cost: Part of Sol.10, no additional Virtualization SW & Administration> More Governance: App.Instances gathered on few servers, no 'Image Sprawl'> Infinite Scalability: up to 8191 Servers on a single Solaris 10 Instance

• Who uses it:> 1st official reference: UGS (large PLM Provider): Solaris 10 Containers for mySAP, SAP ERM

& SAP ERP Core & Enterprise Portal