managing storage for virtual machines using scvmm … · microsoft host resources providers...

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Managing Storage for Virtual Machines using SCVMM 2008 R2

Madhu Jujare (mjujare@microsoft.com )

Senior software design engineerMicrosoft Corporation

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Session Objectives

How VMM manages virtualization and storage

Walk thru of VM migrations and storage

Share challenges of a heterogeneous storage environment

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Key Takeaways

Storage is a key pillar of virtualization

Storage and virtualization are moving targets

Limited adoption of standards for storage management

COLLABORATE WITH US TO DELIVER VALUE TO THE CUSTOMERS!

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Topics we will cover

VMM basics

VMM & SANs

VMM & Clusters

Storage Migration and Rapid Provisioning

Post VMM plans

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

VMM BASICS

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Self Service UserAdministrator Console

Windows PowerShell

Virtual Machine Hosts

Perimeter Network (DMZ)

Library Servers

Self Service Web Servers

Storage (local & remote)

Virtual Machine Manager: Topology

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Manages 100s of hosts

Manages 1000s of VMs

Datacenters demand agility and availabilityVMs need to be created & deployed asapVMs need to move around with minimal or no service interruptionVMs need to be highly available (HA)

What is VMM’s challenge?

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

VM

VHDPass-thru diskPass-thru diskPass-thru disk

What storage does a VM need

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Local

SAN

SAN

Types of VM storage

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

VMM & SAN

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Host

VM

Pass-thru

SANVHD

HBA

SAN

VM on a SAN

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

FC Array / ISCSI Target

VMMVDS h/w provider

HostHost

VDS

VDS

LUN LUN LUN LUN

HBA Provider

• Discovery of LUNS• Mask and Unmask• Set ISCSI CHAP

• Port to LUN mappings

• Enumerate• Rescan• Mount/UnMount• Volume to Disk mapping• Disk to LUN mapping

SAN admin tool

NPIV Provider

• Virtual to Physical port mappings• Create & delete Virtual Ports

iSCSI initiator

• Discovery of portals and targets• Log on & log off

HostHost

Host

VMM on a SAN : Technologies

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

VDS hardware provider

VM can have multiple LUNs.

Each LUN needs to be dedicated to VM.

Available for Hyper-V hosts.

SAN Migration Requirements

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

FC Array / ISCSI Target

VMM

Host Host

LUN1 LUN2

VM1.VHD PassThrough

VM SAN Migration

VM1

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

LUN Migration processSetMask() VDS API is usedMask LUN from source hostUnMask LUN to target host

FC RequirementsVDS provider should be masking capable.Source and Destination hosts can see LUN

SAN Migration (FC)

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

HBAwith NPIV

VP1

VP2

P1

NPIV (N-port Virtualization)

P1

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

LUN MigrationDeletes Vport from source host.Create Vport on target host.

NPIV RequirementsSource and Destination Hosts connected to same SAN (via FC fabric).Source and Destination HBA’s are NPIV capable.NPIV WMI provider installed on Host

SAN Migration (NPIV)

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

class MSFC_FibrePortNPIVMethods- CreateVirtualPort- RemoveVirtualPort

class MSFC_VirtualFibrePortAttributesclass MSFC_FibrePortNPIVAttributes class MSFC_NPIVLUNMappingInformation

NPIV Interface

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

LUN Migration processSetMask() VDS API is usedMask LUN from source hostUnMask LUN to target host

iSCSI Mask migration requirementsSource and target hosts logged into ISCSI target.VDS provider is Masking capable.

SAN Migration (ISCSI Mask)

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

LUN MigrationiSCSI initiator logoff from source host and iSCSI initiator logon on destination host.

iSCSI Logon/Logoff migration requirementsSource and target hosts can access iSCSI target.One LUN per ISCSI Target

SAN Migration (ISCSI Logon/Logoff)

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

iSCSI EMC, NetApp, EqualLogic, MS ISCSI

FC EMC, HP, NetApp, LSI, Compellent, Hitachi

NPIV (N-Port Virtualization)Emulex, Qlogic and Brocade HBA

SAN Vendors

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

VMM & HYPER-V CLUSTER

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Dedicated storageWindows cluster disk resource3rd party custom disk resource (e.g. Symantec/Veritas)

Shared storageCluster Shared Volume (Win2k8 R2)3rd party cluster file systems (e.g. SANBOLIC MelioFS)

Cluster Storage

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Host Cluster

VM1SAN

VHD

HBA

SAN

VM2

VHD

VM on a Dedicated Cluster Storage

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Host Cluster

VM1SAN

HBA

SAN

VM2

VHD1

VHD2

VM on a Cluster Shared Storage

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Quick Migration Win2k8, Win2k8 R2

Live Migration Win2k8 R2Live migration queuing

Hyper-V Cluster VM Migration

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Cluster SAN Migration requirementsDedicated StorageMeets all requirements of SAN Migration.Only FC and ISCSI SAN migrations supported.

LUN MigrationDeletes Disk resource from source cluster.Disconnects LUN from all source nodes.Connects LUN to all target nodes.Creates Disk resource on target cluster.

Cluster SAN Migration

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

STORAGE MIGRATION &RAPID PROVISIONING

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

PurposeAllow migration of virtual storage device attached to a running VM with minimal service interruption

ScenariosLow disk spaceMigration from old SAN to new SANUpgrading & downgrading storage tierStandalone LUN CSVSite to site migration (consolidation)

Quick Storage Migration

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

QSM Algorithm

VHD

Snapshot

VHD

Save State

Save State

VM

Snapshot

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

MigrationType VM State When Expected Downtime

LIVE Running VM is highly available &&source and target are nodes of win2k8 r2 cluster

None

QUICK Any VM is HA &&when live migration is not possible.

< 1 Min

SAN Any Meets SAN migration requirements &&it can’t be migrated LIVE/Quick.

< 2 Mins

QSM Running VM storage is changed < 2 Mins

LAN Any When none of the above is possible. < 1 hour

VMM chooses the bestVM migration type

Migration Summary

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

PurposeDecrease deployment time for VMs Allows customers to use SAN based LUN cloning

instead of copying VHDs over the network

Can also be used for differencing disks

ScenariosAutomated and rapid deployment of large systems

VDI large scale deployments

Automated and concurrent deployment of VMs

Rapid Provisioning

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Rapid Provisioning Scenarios

Golden LUN

VHD

VHD

LUN1(clone)

VHD

LUN2(snapshot)

Base VHD Golden

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Rapid Provisoning Sample script

PS C:\> Get-VMMServer -ComputerName "VMMServer1.Contoso.com"

PS C:\> $JobGroupID = [Guid]::NewGuid().ToString()

PS C:\> $Template = Get-Template | where {$_.Name -eq MyTemplate"}

PS C:\> $VMHost = Get-VMHost | where {$_.Name -eq "VMHost.Contoso.com"}

PS C:\> Move-VirtualHardDisk -IDE -BUS 0 -LUN 0 -Path "L:\OS.VHD" -JobGroup $JobGroupID

PS C:\> New-VM -Name "VM06" -Path "L:\" -Template $Template -VMHost $VMHost -JobGroup -$JobGroupID -UseLocalVirtualHardDisks

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

POST VMM PLANS

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Future directions

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

WMI Server

SLP DiscoveryModule

SMI‐SModule

Host ResourceModule

WMI ServersWMI ServersWMI ServersWMI ServersSMI‐S Servers

CIM‐XML

WMI‐DCOM

WS‐Man

Storage Service (WMI Provider)

WMI ServersMicrosoft Host 

Resources Providers (SMI‐S Based)

CIM‐XMLClient

SLPClient

Microsoft Storage Management Service (Using SMI-S)

WMI ServersWMI ServersFuture SMI‐S Servers

WS‐Man

WS‐ManClient

VMM VNEXT

Storage Developer Conference 2009© 2009 Microsoft Corporation. All Rights Reserved

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Related SDC Content

Microsoft Storage Management UpdateMohamed LawindiSoftware Development Engineer II,Microsoft CorporationMichael BrasherPrincipal Software Development Engineer, Microsoft Corporation

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

SummaryChallenges of working across different vendors

Communicate plans, progress, statusCommunicate frequentlyCommunicate with management/dev/QATest, Test, Test

Integration paths with 3rd partiesSAN vendors:

VDS h/w provider for VMMSMI-S for VMM VNEXT

HBA vendors: SMI-S, NPIV mofClustered File SystemCustom cluster disk resourcesMonitoring: Ops Manager MP, VMM Pro PacksExtensibility and Value-Add : PowerShell + WF

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

More information

VMM blogs by MS employees:http://blogs.technet.com/chengw/ - Cheng Wei- Senior Program Managerhttp://blogs.technet.com/rakeshm/ - Rakesh Malhotra – Group Program

Managerhttp://blogs.technet.com/jonjor/ - Jonathan Jordan - CSS Subject Matter

Experthttp://blogs.technet.com/hectorl/ - Hector Linares – Senior Program

Managerhttp://blogs.technet.com/m2/ - Michael Michael - Senior SDE

VMM communityhttp://technet.microsoft.com/en-us/scvmm/bb679926.aspx

VMM public forumhttp://forums.microsoft.com/TechNet/default.aspx?ForumGroupID=489&SiteID=17

Storage Developer Conference 2009 © 2009 Insert Copyright information here. All rights reserved.

Q & A