esx server storage ii
TRANSCRIPT
![Page 1: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/1.jpg)
ESX Server Storage IITips and TricksRaw Disk Mapping
Mostafa Khalil and Bob Slovick
![Page 2: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/2.jpg)
What We Will Talk About
SAN connectivityFibre attached devicesRAW LUNsUsing RAW Device Mapping (RDM)RDM tips and tricks
![Page 3: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/3.jpg)
SAN Connectivity
![Page 4: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/4.jpg)
Fibre Attached RAW DevicesTape Devices
Fibre Attached Tape Devices are not supported by ESX Server 2.5.xPossible future support in ESX Server 3.x
SAN LUNsLUNs presented to the server’s HBAs are accessible by VMkernel and VMnix
![Page 5: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/5.jpg)
ESX Server RAW Device Mapping
ESX Server 2.5.xTypes of RDM
Physical compatibility modeVirtual compatibility mode
Not with shared HBAs
![Page 6: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/6.jpg)
Physical Compatibility ModeAKA: SCSI-Passthru-rdm
Allows virtual machines to pass SCSI commands directly to the physical hardwareRAW Disk Mapping file is created on a VMFS volume. This mapping file, which has a vmdkextension, points to the raw device RDM file lock is translated to SCSI Reservation on the LUNUtilities like admsnap and admhost, installed on the virtual machines, can directly access the raw device/partition
![Page 7: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/7.jpg)
RDM ‘Pass-Thru’ Mode
![Page 8: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/8.jpg)
View From the Virtual MachineHow a Passthru-rdm is seen in the guest OS
![Page 9: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/9.jpg)
View From the ESX Server ConsoleHow an RDM file is seen on the VMFS volume
The file name points to the RAW LUNThe size reflects the LUN Size with Zero blocks usedAttribute is “raw disk”
![Page 10: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/10.jpg)
Virtual Compatibility ModeAKA: SCSI-non-PassthruFull virtualization of the mapped device. It appears to the guest operating system exactly the same as a virtual disk file in a VMFS volumeThe real hardware characteristics are hiddenVMFS advanced file locking for data protection and redo logs
![Page 11: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/11.jpg)
RDM ‘Non-Pass-Thru’ ModePersistent Mode Undoable Mode
![Page 12: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/12.jpg)
View From the Virtual MachineHow a non-Passthru-rdm is seen in the guest OS
![Page 13: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/13.jpg)
VMFS vs. RDMRDM Advantages
Virtual machine partitions are stored in the native guest OS file system format, facilitating “layered applications”that need this level of accessAs there is only one virtual machine on a LUN, you have much finer grain characterization of the “storage container”, and no I/O or SCSI reservation lock contention at a LUN level. The LUN can be designed and configured for optimal performanceWith “Virtual Compatibility” mode, virtual machines have many of the features of being on a VMFS, such as file locking to allow multiple access, redo logs, and VMotion
![Page 14: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/14.jpg)
VMFS vs. RDMRDM Advantages
With “Physical Compatibility” mode, it gives a virtual machine the capability of sending almost all “low-level”SCSI commands to the target device, including command and control to a storage controller, such as through SAN Management agents in the virtual machine. An example of this is where a virtual machine tells a storage controller to invoke a snapshotDynamic Name Resolution: Stores unique information about LUN regardless of changes to physical address changes due to hardware or path changes
![Page 15: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/15.jpg)
VMFS vs. RDMRDM Disadvantages
Not available for block or RAID devices that do not report a SCSI serial numberNot available if FC-HBA shared with Service ConsoleNo redo logs in “Physical Compatibility” mode, only available in “Virtual Compatibility” mode
![Page 16: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/16.jpg)
VMFS vs. RDM
If you think you may need the added functionality of RDM, and can live with the downsides, consider deploying RDM early onIt can be difficult to migrate from VMFS to RDM and vice versa
![Page 17: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/17.jpg)
Identifying RAW DevicesLocate the target
wwpn.pl –v
![Page 18: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/18.jpg)
Identifying RAW DevicesLocate the LUN’s primary HBA
vmkmultipath -q
![Page 19: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/19.jpg)
Identifying RAW DevicesLocate the LUN’s Proc Node
#ls /proc/vmware/scsi/vmhba2
![Page 20: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/20.jpg)
Identifying RAW DevicesList the LUN’s partitions
#cat 0:2
![Page 21: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/21.jpg)
Identifying RAW DevicesVirtual machine configuration
![Page 22: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/22.jpg)
How to Create RDM
Using MUIUsing Virtual CenterUsing vmkfstools
![Page 23: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/23.jpg)
Creating an RDM Using the MUIUse the “Configure Hardware” option to add a disk
![Page 24: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/24.jpg)
Creating an RDM Using the MUISelect “System LUN/disk” option
![Page 25: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/25.jpg)
Creating an RDM Using the MUIThe choice is yours!
![Page 26: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/26.jpg)
Creating an RDM Using the MUISelect “Add” option from “Edit Properties” menu
![Page 27: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/27.jpg)
Creating an RDM Using the MUISelect “Hard Disk”
![Page 28: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/28.jpg)
Creating an RDM Using the MUISelect “System LUN”
![Page 29: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/29.jpg)
Creating an RDM Using the MUISelect the RAW LUN from the “Target LUN” menu
![Page 30: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/30.jpg)
Creating an RDM Using the MUIAgain! The choice is yours!
![Page 31: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/31.jpg)
Creating an RDM Using the MUINote that you do not have the choice to specify the RDM file name
You can locate the RDM file name here
![Page 32: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/32.jpg)
Creating an RDM Using the MUIIf the RDM file already exists, you only have a choice of compatibility mode
![Page 33: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/33.jpg)
Creating an RDM Using vmkfstoolsvmkfstools –r <raw-device> <vmfs-volume>:<rdm-name>.vmdk
Check the VMFS volume for the resulting file
vmkfstools –lM <vmfs-volume>
Then, you need to modify the virtual machine to use that RDM file.
![Page 34: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/34.jpg)
Use With Clustering
PhysicalPhysicalSharedCluster across boxes (opt.1)
PhysicalPhysicalPublicN+1 Cluster
Cluster across boxes (opt. 2)
Cluster in a box
PhysicalVirtualShared
VirtualVirtualPublic
Bus sharingRDMVMFS
Do not use C.A.B. option 2
![Page 35: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/35.jpg)
Use With ClusteringTo add an RDM for N+1 configuration, use this command sequence:
vmkfstools -L lunreset vmhbax.y.z.0; vmkfstools -r vmhbax.y.z.0 path_of_new_rdm
All on the same line.This temporarily resets the SCSI reservation on the LUN to allow you to create the RDM file.
![Page 36: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/36.jpg)
Use With Multilayered ApplicationsRequires “Physical Compatibility” modeClariion Requires FLARE 19White Paper at:http://www.vmware.com/pdf/clariion_wp_eng.pdfCheck out SLN012 session. Dan Weiss will discuss using Layered App with Exchange Server using RDM
![Page 37: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/37.jpg)
Using RDM For DR
Windows Application Data
WindowsLinux Application
Data
Linux
Replica of Windows Application Data
Production Servers
SnapViewReplica of Linux Application Data
Local SnapViewreplicas for local
recovery or backup.
MirrorView or SAN Copy
Remote Replica of Windows
Application Data
Remote Replica of Linux Application
Data
Replica of Windows Application Data
Replica of Linux Application Data
Remote SnapViewreplicas for remote
backup.
DR or BackupESX Server
Intel architectureVMware: Virtualization layer
SOFT
WA
RE
HA
RD
WA
RE
ESX Bootimage
ESX Bootimage
SnapView
ProductionCLARiiON
SecondaryCLARiiON
SnapView SnapView
At the secondary site VMware P2V tool can be used on the remote copy of physical server boot devices to represent physical servers in the virtual environment.
![Page 38: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/38.jpg)
Use With SRDF
![Page 39: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/39.jpg)
Tips and TricksHow to list RDM files
![Page 40: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/40.jpg)
Tips and TricksImporting a virtual disk to RDM
vmkfstools -i <virtual-disk> <target rdm>
Example:vmkfstools –i /vmfs/localvmfs/win2000.vmdk /vmfs/san01/w2k-rdm.vmdk
Imports win2000.vmdk to w2k-rdm.vmdk which maps to a RAW LUN
Upon completion of import, you get prompted with the disk geometry to use in the virtual machine configuration
![Page 41: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/41.jpg)
Tips and TricksUsing public volume with C.A.B
Use vmkfstools to create 2 RDM files mapped to the same LUN (one for each cluster node)
![Page 42: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/42.jpg)
Tips and TricksHow to delete an RDM
Make sure you are deleting the correct file
![Page 43: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/43.jpg)
Tips and Tricks
Booting guest from an RDMUse P2V to reconfigure it
![Page 44: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/44.jpg)
Where to Get More Informationhttp://www.vmware.com/pdf/clariion_wp_eng.pdfhttp://www.vmware.com/pdf/esx_SAN_guide.pdfhttp://www.vmware.com/pdf/esx25_rawdevicemapping.pdfhttp://www.vmware.com/pdf/SRDF_wp_eng.pdfhttp://www.vmware.com/support/esx25/doc/admin/esx25admin_cluster.html#998201
![Page 45: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/45.jpg)
Backup Slides
![Page 46: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/46.jpg)
VMFS vs. RDMVMFS Advantages
Several virtual machines and ESX Servers can share a common LUN. This means less LUNs to administer, and there is a limit of no more than 128 LUN presented to an ESX Server. This also supports VMotionA virtual machine’s partition is represented as a single file, making it very “portable”They use file level locks to prevent concurrent access to the same fileThey use SCSI reservation locks to protect file system metadata integrity
![Page 47: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/47.jpg)
VMFS vs. RDMVMFS Disadvantages
Several virtual machines and ESX Servers can share a common LUN, leading to possible I/O contentionA virtual machines partition is represented as a single file that “layered applications”, that need to access data at a native file system level, cannotDifficult to characterize disk I/O for a particular application, as all the virtual machines share the same “storage container”. Random I/O can be significant as virtual machines are scheduled. Read cache becomes less effective, due to poor “data locality”. Write cache can become saturatedRedo logs can generate a great deal of “SCSI reservation lock”activity, as metadata needs to be locked to “grow the file”…
![Page 48: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/48.jpg)
Questions?
![Page 49: ESX Server Storage II](https://reader036.vdocuments.net/reader036/viewer/2022071600/613d2128736caf36b759a9d4/html5/thumbnails/49.jpg)