Serverquarium 2013Powering the Hands-On-Labs at MMSSteve ColeDirector, Technology ServicesXtreme Consulting Group, Inc.

Paul Gavin Training Manager

HP Cloud Solutions for Microsoft

Introducing the Serverquarium for 2013 Microsoft’s Jeff Woolsey and HP’s Jeff Carlat

Why a Private Cloud solution for labs?Steve Cole, XCGI

What’s under the hood for 2013?HP Cloud Solution for Microsoft: Servers, Storage and Networking, Management IntegrationPaul Gavin, HP

Q&A session with the engineers who made it happen

Session Agenda

Introducing the Serverquarium for 2013

Jeff WoolseyPrincipal Group Program

ManagerWindows Server

VirtualizationMicrosoft

Jeff CarlatDirector of Product

MarketingIndustry Standard Servers

HP

What is the Serverquarium?fastflexible

integrated

innovative

validated

federated

virtualized

resilient

redundantautonomic

securemanaged

multi-tenant

efficient

balancedavailable

Why a Private Cloud?It’s just labs, right?

• MMS ’09, all labs delivered via 650 physical servers!• Power consumption was 114,000 watts

• MMS ‘10, first year all labs were 100% virtualized• 41 Servers in 3 racks using local storage, 40,000 VM’s, power use down to 9000 watts, 650

thin clients

• MMS ‘11, the Cloud rolls in• 32 servers in 2 racks using SAN storage and 1TB less RAM still running 40k VM’s and using

8400 watts

• MMS ‘12, turning up the volume• More complex labs offered with more VM’s per lab meant upping the RAM per blade to 192GB

and bringing in 3PAR Storage• Over 50,000 VM’s in four days!

It’s a process…

• We can provision well over 500 VM’s per minute

• With the HP 3PAR StorServe P10800 and HP IO Accelerator Cards from Fusion-io, we’re at almost 8 million IOPS

• We’re averaging ~20% CPU utilization, peaking at 30%

• All with centralized web based self service portals that allow us to evenly distribute the load and cope with massive spikes in demand.

The need for speed

No ordinary workloads

The environment we support is a bit more complicated than usual• As of this morning, more than 6.5k labs with over 20k VM’s total• Peak of 2.5k simultaneous VM’s

For ILL’s, we need to provision an average of 1400 VM’s to 400 users to four physical locations in less than 10 minutes 5 times per day

To do that, we have:• Active Directory controlling lab availability to physical locations• Dynamic Memory dramatically increasing efficiency during VM run time• System Center monitoring Host and Virtual Machine health and

performance

No ordinary labs

Built with System Center 2012 OrchestratorPlus PowerShell 3.0

Managed with SC2012 Virtual Machine Manager

Monitored with SC2012 Operations Manager

Serverquarium is highly customized for our unique business needs

• Anonymous logons• Rapid response times

Our “non-needs” could be your priority list• High Availability for user sessions• 5 9’s uptime• User security

But the tools we used are the same

A private fabric makes a custom platform!

It’s a custom job…

Serverquarium 2013What’s under the hood this year?

Based on HP’s VirtualSystem VS3 for MicrosoftServerquarium MMS 2013 Overall Configuration

HP Cloud Solution for Microsoft

Accelerates journey to cloud with turnkey solutionHigh performance platform for the Microsoft

CloudOSProven solution – Designed with Microsoft Private

Cloud Fast Track compliance in mindFlexible configurations to meet customer

requirementsOptimized converged infrastructure that is factory

integratedDeployed onsite and integrated into customer’s

environmentTightly integrated management from infrastructure

to applicationAvailable now worldwide

23

4 11. Storage: 3PAR StoreServ2. FlexFabric FCoE and 10GbE

simultaneously + IRF3. Management: Insight Control &

System Center Management servers: DL360p Gen8

4. Host servers: C7000 + BL460 Gen8

Serverquarium MMS 2013 Overall Configuration Compute: 32x BL460c Gen8

2x Intel® Xeon® E5-2670 2.6GHz / 8 cores256GB RAM2x 300 GB SAS drives785GB / 1.2TB HP IO Accelerator cardHP VirtualConnect FlexFabric 10Gb 2-port

Management: 2x DL360 Gen8

2x Intel® Xeon® E5-2690 2.0Ghz / 8 cores192GB RAM2x 300 GB SAS drives10 Gb Ethernet 2-port PCIStorage / Data NetworkingHP 5920 Series Ethernet SwitchesHP B-Series FibreChannel SAN Switches

Serverquarium MMS 2013 Microsoft Management Compute: Windows Server 2012 with

Hyper-VUp to 100 VM’s per node at any timeLocal agents for SCVMM and SCOMUp to 30 virtual networks per node at any timeManagement: Windows Server

2012 clusterSystem Center 2012 SP1HP Insight Control for System CenterCentralized web service for self-service provisioningNetworkingIP network monitored by System Center 2012Fiber throughput near 1GB per second

Provides comprehensive system health, configuration management,

and software deployment

• Ideal for customers who have standardized on Microsoft System Center as their management platform

• Licensed and included with HP Insight Control

• Integrates directly into System Center consoles

• Included as key management component in HP Cloud Solution for Microsoft

Brings the native manageability of HP hardware to System Center 2012 environments

Severquarium MMS 2013 HP Server Management

Comprehensive Health Monitoring

Driver andFirmware Updates

Bare Metal OS Deployment

Detailed HP Inventory

Total Remote Control via iLO

Advanced• Agentless Gen8• Windows• Linux• VMware• Blade enclosures

Automated Virtual Machine

Management

Provides comprehensive system health, configuration

management, and software deployment

Serverquarium MMS 2013 HP Server Management

Severquarium MMS 2013 HP Storage Hardware Storage: HP

3PAR StoreServ 10800

153.6 TB in total128 x 600 GB FC disks64 z 200 GB SSD disks32x 2TB NL disks4 controller nodesHP 5920 Series Ethernet SwitchesHP B-Series FibreChanmelSAN Switches

Autonomic: Reduce time spent managing storage by 90%• System responds effortlessly and

instantly to new workload demandsEfficient: Reduce capacity requirements by 50% • Hardware enabled thin technologies and

tiering for high efficiency without tradeoffs.

Multi-tenant: Double VM density per server • Bulletproof tier-1 resilience for massive

consolidation of unpredictable mixed workloadsFederated: Non-disruptive data

mobility between systems• HP Peer Motion for easy refresh and data

services management across multiple arrays

Severquarium MMS 2013 HP Storage Management• Integration simplifies

management of Microsoft Hyper-V environments

• Rapidly provision new Virtual Machines

• Storage Management• Discovery• Manage HP 3PAR Virtual Volumes• Manage HP 3PAR Snapshots

Managing storage systems within System Center 2012 Virtual Machine Manager

22

Severquarium MMS 2013 HP Storage Management• Manage HP 3PAR Storage System

with System Center 2012 Operations Manager

• Consolidate Event/Alert Management with System Center 2012 Operations Manager

23

Serverquarium MMS 2013 HP Network Technology• Uses HP Virtual Connect

Technology• Reduces wiring costs and complexity

• Shared connection for FC and ISCSI and Ethernet• Reduces adaptor count

• VCEM • Allows multi cabinet network

management

Blade Servers (BL460c G8) Port 1

Port 2

Port 3

Port 5

Port 6

Port 7 Internal Crossover

Port 1

Port 2

Port 3

Port 5

Port 6

Port 7 Internal Crossover

FC-A-1 (8Gb)

FC-A-2 (8Gb)

Flex-Fabric –Bay 2

NIC Teaming

VirtualSwitch/

Virtual SAN

FC-A-3 (8Gb)

FC-B-1 (8Gb)

FC-B-2 (8Gb)

SUS-B5 (10Gb)

FC-B-3 (8Gb)

Flex Fabric 10/24 Interconnects

SUS-A5 (10Gb)

SUS-A6 (10Gb)

SUS-B6 (10Gb)

2 FF Modules

Port 8

Port 8

Internal Crossover

Internal Crossover

Flex-Fabric –Bay 1

Production

LOM_2AProduction-B (1Gb)

LOM_2CCSV (1Gb)

LOM_1AProduction-A (1Gb)

LOM_1BFC-A (8Gb)

LOM_1CLiveMigration (1Gb)

LOM_2DUnassigned

LOM_1DUnassigned

LOM_2BFC-B (4Gb)

FC-A

FlexibleLOM

FlexibleLOM

FC-B

Port 4 FC-A-4 (8Gb)

Port 4 FC-B-4 (8Gb)

Network Connectivity – Fibre Channel Connectivity

Serverquarium MMS 2012 HP Network Technology• Tested and Validated

Rack servers Blade servers

Legacy Architecture HP FlexFabric Architecture

High-performance 4-chassis virtualized

core

Rack servers

Blade servers

IRF

IRF Virtual Connect

Faster Live Migration

500x faster recovery time

2x network performance

Source: Test commissioned by HP: “NetworkTest: FlexNetwork Architecture Delivers Higher Speed, Lower Downtime With HP IRF Technology” http://www3.networktest.com/hpirf/hpirf1.pdf

• HP Fabric Management Add-in for SCVMM planned for future release• Available as part of Insight Control for System Center

• SCVMM 2012 SP1 provides capability for HP specific functionality integration directly into the SCVMM console

• Extends view of HP Converged Infrastructure elements which will provide:• Summary view• Diagram view from VM to external switch

• Combines logical and physical elements from:• Hyper-V• Windows Networking• SCVMM• HP Virtual Connect

Severquarium MMS 2013 HP Network Management ManagementTechnology Preview

SCVMM

Serverquarium combining VC and SCVMM

+• HP Virtual Connect

elements are not exposed in SCVMM• Difficult to get an end-

to-end view of connections and relationships

HP Virtual Connect

Severquarium MMS 2013 HP Network Management

Enclosure/Profile

ServervSwitchVMs

FlexNICs

Downlink

Ports

I/O Module

Uplink PortsExternal Switch

Actions

iLO ConsoleiLO WebVCM ConsoleOA Console

Launch Tools

Severquarium MMS 2013 HP IO Enhancement

Scale Up VM Performance Density Add more and larger VMs per server Add larger workloads to each VM

1.2TB HP IO Acceleratormezzanine card

• Extend virtualization to more I/O-intensive applications

• Maximize virtualization & infrastructure efficiency• Reduce power and footprint, simplify management• Eliminate I/O constraints, unleash VM performance

Q&A

Introducing the team who built the systemQ&A

Conrad CahillSenior Virtualization

ArchitectXtreme Consulting Group

Dung Hoang KhacPrincipal Engineer

Virtualization Engineering Group

HP

Call to Action A ‘single pane of glass’ view of storage resources from HP at #MMS2013 http://bit.ly/13OyD0t  See tech exposure of HP Storage integration w/MSFT System Center suite of products at #MMS2013 http://bit.ly/13OyD0t See session “HP Private Cloud Management w/System Center” Monday, April 8th b/twn 2:00-3:30pm http://bit.ly/13OyD0t #MMS2013

Accelerate your pathway to the cloud with HP at #MMS2013 http://bit.ly/10vJkh0 #Serverquarium Stop at the #Serverquarium & take the tour w/one of our HP technical experts on site http://bit.ly/10vJkh0 # MMS2013 See HP demo HP Cloud Solution for MSFT—an ideal foundation to move you along your journey to the cloud http://bit.ly/10vJkh0 # MMS2013 Visit the Serverquarium

What is the ServerQuarium?fastflexible

integrated

innovative

validated

federated

virtualized

resilient

redundantautonomic

securemanaged

multi-tenant

efficient

balancedavailable

Thank You!