pre-con ed: monitor your storage infrastructure with ca unified infrastructure management
TRANSCRIPT
World®’16
Pre-ConEd:MonitorYourStorageInfrastructurewithCAUnifiedInfrastructureManagement
RajSundaram,Sr.PrincipalProductManager,CATechnologies
DO4X69E
DEVOPS– AGILEOPERATIONS
2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.
Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.
ForInformationalPurposesOnlyTermsofthisPresentation
3 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Abstract
CAUnifiedInfrastructureManagementforstoragedeviceshelpsyoupreventoutages,quicklypinpointsystemissuesandoptimizestorageusage.JoinusinthissessiontolearnhowtomonitorkeytraditionalandsoftwaredefinedstoragewithCAUnifiedInfrastructureManagementsuchasEMC,PureStorage,NimbleStorage,NetApp,Nutanix andIBM.Topicscoveredwillincludetechnologyoverviewforadministrators,monitoringconfigurationforprobes,metricssupported,anddashboards/reportgeneration.
RajSundaramCATechnologiesSr.PrincipalProductManager
4 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Agenda
CAUNIFIEDINFRASTRUCTUREMANAGEMENTFORSTORAGEMONITORING
NETAPP
PURESTORAGE
EMC
HP
IBM
1
2
3
4
5
6
5 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAUnifiedInfrastructureManagementforStorageMonitoring
6 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
StorageAdminJobstoBeDoneJob Percent TasksManagecurrentstorageenvironment 20% • Resolveanystorageshortages
• Alertandresolveanyperformanceissuesandnotifyend-users• Insurethatdataisavailabletoallapplications
Applicationsupport 20% • Workwithapplicationdeveloperstodeterminestoragerequirements
• Workwithexistingprogrammers,DBAstooptimizestorage
Backup 15% • Maintainproperbackupschedule• Restoreandrecoverdataasrequested• Facilitateoff-sitestorageoftape
Monitorcurrentstorageenvironment 15% • Usage, Performance ,Availability, Reportingonstatus
Capacityplanning 10% • Forecaststoragegrowth• Determineallocationofdifferentstoragetypes
Evaluations 10% • Provideinputfromvendorproposals• Duediligenceonnewsoftware• Drivevendortesting
Newinstalls 10% • Responsible forplanning,executionofdeviceinstallation
7 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
StorageBottlenecksComponents Issues Key Metrics
I/OIntensiveapplications
• ToomanyVMsperserver• vMotion (CPU,memorymovebutstorageremains,
solvedwithstoragevMotion)• PoorlysizedVMs(notenoughmemorycausesIO
bottlenecks)
• IOPS(readsandwrites;randomandsequential;averageofoverallIOPS)
• Averagediskqueuelength
• AverageI/Osizeinkilobytes
• Throughputinmegabytespersecond.
• Writepercentagevs.readpercentage
• Capacity(free,usedandreserve)
Response timeintensiveapplications
• Toomany usersusingemail,ERP,databaseetc.• Manyrequests,randominnature,morereadsmore
thanwrites,andsmallI/Osize• Requestsqueueup,responsetimesincrease
Bandwidthintensiveapplications
• Few usersdatabackup,videostreaming/editingorsecuritylogging
• Root causecouldbeinsufficientnumberofdrivestoservicetheI/Os,contentionatthecontroller,orinadequatebandwidthatthearray'sfront-endports
Diskfailure • If inRAIDgroup,thiskicksoffrebuildcausingperformancedegradation
8 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
StorageBottlenecksComponents Issues
Storage controllers
• OversaturatingthecontrollerwithI/O,limitingtheIOPSthatcanbeprocessedfromthecachetothearray
• Throughputoverwhelmingtheprocessor• OverloadedCPU/insufficientprocessingpower• Inabilitytokeepupwiththeperformanceof solidstate drives(SSDs)
Disk• Toomanyapplicationshittingdisks• InsufficientnumberofdrivesforthroughputorIOPSthatapplicationrequires• Diskstooslowtomeetperformanceneedsandsupportaheavyuserworkload
Cache• Insufficientcachememory• Overloadingthecachewithwrites,causingslowperformance• Thrashingthecachebyfrequentlyaccessingnon-sequentialdata
SANfabric/frontendports
• Oversaturation/overutilizationifthere'saninadequatenumberofportsinthearray• Toomuchoversubscriptioninavirtualserverenvironment• Improperloadbalancingacrossports• Contention/trafficoverloadatinterswitch links• HBAcongestion
9 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
StorageMonitoringRequirements
Single,unifiedsolution tomonitorvastenterprisestoragetechnologies
Highscaleandperformancetohandlelargeelastic
environments
Elasticconfigurationatscale
Servicelevelvalidation
10 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAUIMforStorageAtAGlance
§ Rapidlyidentifyandcorrectstoragerelatedoutages
§ Preventproblemsbeforetheyhappenbyapplyingintelligentthresholdstometrics
§ Optimizestorageallocationsbytrackingstorageusageandrelatingthattoapplicationsandbusinessservices
§ Automaticallyidentify,deployandconfiguremonitoringforstoragecomponentsandelements
§ Monitorandmanagenotonlystorage,butalltheoperatingsystems,virtualizationenvironments,cloudenvironments,businessapplicationsandcriticalITservicesthatdependuponthatstorage
WhyMonitor?
11 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ComprehensiveInsightsonPerformanceandUtilizationIdentifyIssuesRapidlyandBetterPlanforCapacity
12 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
IntelligentAlarmsProactivelyIdentifyIssues
§ Richalertswiththeabilitytotriggerauto-remediation
§ Dynamicthresholdseliminatefalsealarms
§ Timetothresholdalarmssendadvancewarningsoncapacitybottlenecks
13 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ComprehensiveSupportForStorageWithCAUIM
Vendor/Type Series
EMC VNX,Celerra, Clarrion,VMAX,VPLEX
IBM SVC,V7000,V3700,DS3k, DS5k,DS8K
HP 3Par
Hitachi VSP, USP,USP-V
NetApp 7.XandC-Mode(beta)
All flash/hyperconvereged PureStorage, Nutanix
Cloud storage Ceph*,Swift,S3
Underconsideration:NimbleStorage,Tintri,Symplivity,EMCXtremeIO,AzureBlob,GoogleCloudStorage
14 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringNetAppWithCAUnifiedInfrastructureManagement
15 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
NetAppStorageMonitoringwithCAUIM
§ Probe sendsSNMPGETqueriestospecifiedNetAppdevices– Probethentransformsthequeryresultsintoalarmsandqualityofservicemessages
forservicelevelagreement– NetAppprobe usesasetofpredefinedSNMPOIDtemplatesavailableonmost
NetAppdevices– AprofilecanbeconfiguredtointegratetheNetAppdeviceintotheCAUIM
monitoringsolution
§ NetAppfilerorNetAppfabric-attachedstorage(FAS)isatypeofdiskstoragedevice;thisdeviceownsandcontrolsfilesystems,directories,andfilespresentoverthenetwork
§ NetAppfilerusestheDataONTAPoperatingsystem(basedonFreeBSD)
16 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
NetAppStorageMonitoringwithCAUIM
§ ProbecanbeconfiguredforNetAppOntap 7.2xto8.1c-modeand7-modeoperatingsystem
§ Componentsthatcanbemonitoredusingthenetapp probeare:
GeneralProductinformation& SystemStatistics
Clusterstatus Disk
Ethernetinterface Aggregates Volumes
vFiler SnapMirrors SnapVaults
17 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
NetAppStorageMonitoringwithCAUIM
§ Proberemotelymonitorsthehealthandperformanceof storageobjectsandsystemsrunningDataONTAP8.2xand8.3xversions inClustermode
§ Probecanmonitorthefollowingstoragecomponents:
Aggregates Controllers Disk
vServers• LUNs• Qtrees• Volumes
Hardware• Disks• Ethernet
interfaces
18 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
NetAppStorageMonitoringwithCAUIMSampleProbeConfiguration
19 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
NetAppStorageMonitoringwithCAUIMSampleDeviceDashboard
20 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringEMCCelerraWithCAUnifiedInfrastructureManagement
21 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringEMCCelerra withCAUIM
§ ProbeconnectstoCelerra networkservernodestocollectandstoremonitoringinformationintheprobe
§ Definealarmsthataregeneratedwhenthespecifiedthresholdsarebreached
§ Probecanmonitorthefollowingstoragecomponents:– Datamovers– Storagesystemsandprocessors– Filesystems– Networks– Storagesystems– Storagevolumes
22 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringEMCCelerrawithCAUIMSampleConfigurationScreen
23 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringEMCCelerrawithCAUIMSampleDeviceDashboard
24 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringEMCClariionWithCAUnifiedInfrastructureManagement
25 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringEMCClariionwithCAUIM
§ ProbemonitorstheperformanceandavailabilityofthefollowingcomponentsoftheEMCClariion storagesystems:– Fastcache– Hosts– LUNs– RAIDgroups– Storagegroups– Thinpools– Mirrorviews– Storageprocessors
26 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringEMCClariion withCAUIM
§ Probeusesnavisec CLI(acommand-linetoolavailablefromEMC)thatcollectsandstoresmonitoringinformationfromthemonitoredEMCClariionstorageserversatcustomizableintervals
§ Alarmsthataregeneratedwhenthespecifiedthresholdsarebreached
§ Theprobeiscertifiedonthefollowingstorageservers:– EMC ClariionCX4Models:CX4-480– EMC ClariionVNXModels:VNX5100,VNX5300,andVNX5700– EMC ClariionVNX2Models:VNX5400andVNX8000
27 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringEMCClariionwithCAUIMSampleConfiguration
28 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringEMCClariion withCAUIM
29 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
HitachiStorageMonitoringwithCAUnifiedInfrastructureManagement
30 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringHitachiwithCAUIM
§ Probehandlesallcommonmonitoringanddatacollectiontasksforthefollowingstoragearrays:– HitachiUSP_V– HitachiUSP_VM– HitachiAdaptableModularStorage(AMS)– HitachiUnifiedStorage(HUS)– HitachiVirtualStoragePlatform(VSP)
§ HitachiUSP_VandUSP_VMSeriesarediskstoragesolutionsforsmallandlargeenterprises
31 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringHitachiwithCAUIM
§ HitachiAMSisafamilyofblockstoragesystemsfortargetingthemid-tierenterprisemarket;asinglesystemcanmanageasmuchas1,417terabytes(TBs)ofstorage
§ Hitachireplacesitsmid-rangeAMSstoragearraywiththeHitachiUnifiedStorage(HUS)familyofsystems– Thesedevicesallowyoutomanageblock,file,andobjectdatainahighly
scalableandcost-efficientmanner– Asinglesystemcanmanagealmost3petabytes(PBs)ofstorage
32 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringHitachiwithCAUIM
§ Probecanmonitorthefollowingcomponents:– Storagearray– Controllersandports– Storagepools– Thinprovisioningpools– Arraygroups– Components– Logicalvolumes– Disks
§ ProbeusesanSMI-SinterfacetocommunicatewiththeHitachistoragesystemarrays
33 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringHitachiwithCAUIMSampleConfiguration
34 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringHitachiwithCAUIMSampleConfiguration
35 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
HP_3ParStorageMonitoringwithCAUnifiedInfrastructureManagement
36 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringHP_3ParwithCAUIM
§ HP3PARstoragemonitoring(hp_3par)probeenablesyoutomonitortheperformanceandusageofHP3PARStoreServ Storagesystems;itobtainsperformanceandstorageutilizationstatisticsonthefollowingstorageobjects:– Controllernodes– Commonprovisioninggroups(CPGs)– Diskcagesandapplicableinterfaces,powersupplies,andfans– Physicaldisks– Logicaldisks– Ports– Virtualvolumes
37 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringHP_3ParwithCAUIM
§ Proberetrievesthefollowinginformationaboutthecompletestoragesystem:– Performanceandscalability forthetotalnumberofstoragetransactionsbeing
processedeverysecondandthelatencyofthestoragesystem– Statisticaldata forallobjectsofthestoragesystemasawhole;forexample,
theconfiguredusedandfreespaceinformationforthestoragesystem
§ ProbeiscertifiedonthefollowingHP3PARversions:– HP3PARINServ F200– (version1.11andlater) HP3PARStoreServ 740
38 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
IBMStorageMonitoringwithCAUnifiedInfrastructureManagement
39 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringIBMStoragewithCAUIM
§ IBMDiskStorageSystem8000SeriesMonitoring(ibm_ds_next)probemonitorsIBMDS8xxxstoragesystems;phe probeusesanSMI-SinterfacetocommunicatewiththeIBMDSstoragesystem
§ Theprobecanmonitorthefollowingcomponents:– Arrays– Disks– Pools– Ports– Ranks– Volumes
40 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringIBMStoragewithCAUIM
§ ProbemonitorsIBMDS3xxx,IBMDS4xxx,andIBMDS5xxxstoragearrays
§ ProbeusesanSMI-SinterfacetocommunicatewiththeIBMDSstoragesystem
§ Probecanmonitorthefollowingcomponents:– Storagearray– Controllersandports– Storagepols– Arraygroups– Logicalvolumes– Disks
41 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringIBMStoragewithCAUIM
§ MonitorsthefollowingcomponentsofIBMSystemStorageSANVolumeController(SVC)andIBMV7000storagesystems:– vDisk,mDisk,mDisk group– Node,cluster,host,IOgroups,port
§ ProbesupportsuserauthenticationthroughSSH only;requires apasswordoravalidSSHkeyfiletoaccessCLI
42 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringIBMStoragewithCAUIMSampleConfiguration
43 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringIBMStoragewithCAUIMSampleDashboard
44 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
PureStorageMonitoringwithCAUnifiedInfrastructureManagement
45 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringPureStoragewithCAUIM
§ EnablesyoutomonitortheperformanceandusageofthePureStorageFlashArraysystems
§ Thefollowingphysicalandlogicalstoragecomponentsaremonitored:– PureStorageFlashArray– Drives– Hardware– Hosts– Hostgroups– Network– Volumes
46 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringPureStoragewithCAUIM
§ Proberetrievesvitalarrayinformation,suchas:– IOPS– Latency– Datareduction– Snapshotcapacity– Totalbandwidth
47 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringPureStoragewithCAUIM
48 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MonitoringPureStoragewithCAUIM
49 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Thankyou.
Stayconnectedatcommunities.ca.com
@CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.50 @CAWORLD#CAWORLD
DevOps– AgileOps
FormoreinformationonDevOps– AgileOps,pleasevisit:http://cainc.to/wYXSg6