exploiting operational intelligence within database ... · exploiting operational intelligence...

52
World ® ’1 6 Exploiting Operational Intelligence Within Database Management Tools Ron Colmone, Sr Consulting Architect Arun Vijayaraghavan, Sr Principal Product Manager CA Technologies MAINFRAME AND WORKLOAD AUTOMATION MFX76E

Upload: vuongquynh

Post on 05-Apr-2018

240 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

World®’16

ExploitingOperationalIntelligenceWithinDatabaseManagementToolsRonColmone,Sr ConsultingArchitectArunVijayaraghavan,Sr PrincipalProductManagerCATechnologies

MAINFRAMEANDWORKLOADAUTOMATION

MFX76E

Page 2: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Abstract

Attendthissessiontogetaclose-uplookatcurrentlyembeddedoperationalintelligenceindatabasemanagementutilities.Discoverhowtoexploittheseavailablecapabilitiesaswellasthepossibilitiesforyoutobuildyouown!Youwilllearnhowadvancedautomationrequiresuniqueoperationalintelligencethatcanfurtherevaluatewhichadditionaltaskscanbeautomatedandtowhatdegree.Additionally,learnhowtosimplifyyourdaytodaydecisionmakingtominimizethetimerequiredtoeffectivelymanageandrunanefficientdatabasesystem.Theeffectsofallthis?HowabouthelpingtolowerDB2operatingcostsandimproveuserproductivity,includingmanualeffortandspecifically“specializedorexpert”manualrequirements.

RonColmone

ArunVijayaraghavan

Sr.ConsultingArchitectCATechnologies

Sr.PrincipalProductManagerCATechnologies

Page 3: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

3 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Agenda

USINGDATABASEANALYZERFORAUTOMATINGOBJECTMAINTENANCE

IDENTIFYINGSQLTOANALYZEFORIMPROVINGAPPLICATIONPERFORMANCE

IMPROVINGQUERYPERFORMANCEWITHPLANANALYZER

IDAAACCELERATIONWITHRC/QUERYANDSYSVIEW FORDB2

FUTUREOFOPERATIONALINTELLIGENCEINDB2

1

2

3

4

5

Page 4: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

4 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

CADatabaseManagementPortfolioVisionManagingGrowthandComplexitytoAddressEvolvingDataManagementNeeds

Planned Available

IMS DB2

CAAdministrationSuite

CAPerformanceSuite

CAUtilitiesSuite

CARecoverySuite

ExperiencedDBA

WebAppServer

MobileDeveloper

BigDataAnalyst

RESTAPI

NextGenDBA

CAAnalyticsfor

DB2

NextGenDBA

ExternalApps

Page 5: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

5 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DatabaseAnalyzerProvidesOperationalIntelligenceforDB2ObjectMaintenance

Page 6: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

6 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DatabaseAnalyzer– PastandPresent

STATISTICSEVOLUTIONINDB2

QUICKOVERVIEWOFDATABASEANALYZERPROCESSING

TRADITIONALSTATISTICSCOLLECTIONANDANALYSIS

OBJECTMAINTENANCEUSINGDB2REALTIMESTATISTICS(RTS)

PRIORITIZEDOBJECTMAINTENANCE

1

2

3

4

5

Page 7: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

7 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Statisticsevolution– let’sstepbackandremember

§ RUNSTATSSinceDay-1– Collectedstatisticsfortheoptimizer– CollectedstatisticsfortheDBAtodeterminewhenREORGneeded

§ ExtentsaloteasiertotriggerthanCLR,LEAFDIST,FAROFF,NEAROFFetc.

§ Someissues/problemswiththisapproach– DB2cataloggotupdatedwithpotentially“bad”statistics– BIND’sandREBIND’sshouldbepostponeduntilstatisticsfixedby

REORGandanotherRUNSTATS

Page 8: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

8 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Statisticsevolution– let’sstepbackandremember

§ REPORTYESandUPDATENONE– Greatimprovementtoverifyobjectshealthcondition– NoneedtoworryaboutBIND,REBIND,dynamicSQLdueto“bad”

statistics– HadtochangeapplicationstointerpretRUNSTATSSYSOUTasopposed

tousingSQLagainsttheDB2catalogdeterminingREORGetc.

§ Objectskeptgrowinginnumberandsize– RUNSTATSexpensive– Samplingintroducedlateinthegame– Inlinestatscanbeusedwhenloading/reorganizingobject- Limited

Page 9: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

9 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Statisticsevolution– let’sstepbackandremember

§ RTSintroducedinDB2V7– fromDB29mandatory– Newchallengesintroduced(morelater)

§ Manywaystotriggerthereorgofanobject?– Performancemetrics– whenapplicationperformancestarttodegrade– Fixedschedule– Weekly,Monthly,etc.basedonobjectsize/type– Partitionedobjects- EntireTableSpaceoraPartitionatatime?

§ RTSiscommonlyusedtodayforObjectMaintenance

§ ToolslikeDatabaseAnalyzerorDB2’sDSNACCOXSP

Page 10: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

10 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

RTSDrivenREORGsandSpaceAdministration

§ Somelimitationstothinkaboutbasedonrequirements– Istheobject(orpartition)over- orunderallocated?– DoyouwanttoalterQTYbasedoncurrentconditions/metrics?– CanyousaveanINDEX-LEVELbydoingareorg

(oneRTScolumnmighthelp)– Doyouneedtoprovideaccuratespacetrending/forecasting– DoyouhaverequirementstogenerateyourownSQLbasedconditions

todrivetheprocess– DoyouhaveaneedforIF-ELSElogicdrivingtheprocessesor

dynamicallydecidehowtheutilityshouldbegenerated– Slidingscalealgorithmresolvesmanyspaceallocationconcerns

Page 11: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

11 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DatabaseAnalyzerProcessOverview

DatabaseAnalyzerExtractandActionProcessing

DB2UtilityJOBs

DatabaseStatisticsExtract

ActionsConditions

Page 12: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

12 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DatabaseAnalyzer– Traditional(OldStyle)Space/Reorg

§ VerycommontobuildanExtractProcedureononeormoreDatabases(couldprocessentiresubsystem)

§ ActionProcedurescanbecreatedorselectedfromlistofbestpracticeDB2maintenanceoptions(Reorg,RUNSTATS,ImageCopy,etc.)

§ ProblemwithTraditionalDatabaseAnalyzerAutomation– Toomanyobjectstoprocess,onlysubsetmayneedattention– CPUintensivecollectingallthestatsneededtodoReorgorAlter– RTShasbeenavailableforsometimeandcanprovidenecessarystats

Page 13: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

13 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DatabaseAnalyzer– PreferredMethodisRTOS

§ RealTimeObjectSelection(RTOS)usesDB2RTS– NewwithR19- ObjectSelectionProfile(OSP)linkedtoExtractprocedure

tofilterobjectstobeprocessed(DatabaseandTablespacemasks)– CangenerateactionJCLforselectedUtilityprocessingbasedonRTS

conditions(Bestpracticearevaluesavailable)– OrcangenerateDatabaseAnalyzerStatisticsonthesubsetofobjectsand

continuetotakeadvantageoftheextensive“traditional”actionconditions– NewwithR19– PrioritizedObjectMaintenance(POM)profilescanbe

linkedtoExtractProcedurestoenabletheActionJCLgeneratedtobeprioritizedbasedonPrioritizedObjectConditions(POC)

Page 14: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

14 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

OperationIntelligencewithDetectorSQLCollection

Page 15: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

15 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Detector– SQLCollectionforAcceleratedPerformance

§ AnalyticsAcceleratorUsageScenarios– Rapidlyacceleratebusinesscriticalqueries

§ OftenchallengingtotunequeriesthatalsosupportOLTPworkload– Improveaccesstohistoricaldata– Newbusinessintelligenceusecases

§ UseCADetectortohelpidentifylongrunningqueries– SortQueriesbyHighIN-DB2time– IdentifyDB2Tablesassociatedwiththeselongrunningqueries

§ IfrunningSubsystemAnalyzer,OptionTinDetectorwillshowtablesassociatedwithQuery

Page 16: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

16 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

PlanAnalyzertoDeterminePotentialAcceleratedPerformanceImprovements

Page 17: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

17 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

PlanAnalyzer- ACCELProfileSupport- ProfileServices

§ CreateanduseACCELprofilesusingtheDB2ProfileServicesfacility.ThefacilityusestheseDB2tables:– SYSIBM.DSN_PROFILE_TABLE– SYSIBM.DSN_PROFILE_HISTORY– SYSIBM.DSN_PROFILE_ATTRIBUTES– SYSIBM.DSN_PROFILE_ATTRIBUTES_HISTORY

§ ACCELprofilecostingisonlyappliedwhenDSNZPARMQUERY_ACCELERATIONisoneoftheseoptions:– ENABLE– ENABLEWITHFALLBACK

Page 18: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

18 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

PlanAnalyzer:IBMDB2AnalyticsAcceleratorsupport

ThresholdvaluesdetailstobeusedwhenAcceleratoraccessisconsidered

19.0 ---------- PPA DB2 Profile Services Create --------- 2016/04/05 03:32COMMAND ===>

PROFILEID ===> 5000 FUNCTION ===> ACCEL ENABLED ===> Y REMARKS ===> AIG DEMO >----------------------------------------------------------------- RASST02

ACCELERATOR THRESHOLDS: TABLE CARDINALITY ===> 2000000 N/A | -1 | 1 thru 2,147,483,647 RESULT SIZE ===> 1 N/A | -1 | 1 thru 2,147,483,647 TOTAL COST ===> +.0E+00 N/A | -1 | 0 thru +7.2E+75

Page 19: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

19 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

PlanAnalyzer:IBMDB2AnalyticsAcceleratorsupport

STARTPROFoncommandlinewillactivatenewDB2Profile

19.0 -------------- PPA DB2 Command Display ------------- 2016/04/05 03:36COMMAND ===> SCROLL ===> PAGE

LINE 1 OF 24DSNT741I !DB2G DSNT1SDV START PROFILE IS COMPLETED. DSN9022I !DB2G DSNT1STR 'START PROFILE' NORMAL COMPLETION

Profile Services Status Report

Profile ID: 5000 Function: ACCEL Status TS: 2016-04-05-03.36.11.397468 Status : ACCEPTED BY DB2G

Attribute : ACCEL_RESULTSIZE_THRESHOLD Value : 1 Status : ACCEPTED

Attribute : ACCEL_TABLE_THRESHOLD Value : 2,000,000 Status : ACCEPTED

Attribute : ACCEL_TOTALCOST_THRESHOLD Value : 0 Status : ACCEPTED

Profile ID: 8661 Function: ACCEL Status TS: 2016-04-05-03.36.11.397468 Status : REJECTED BY DB2G - DUPLICATED SCOPE SPECIFIED

ID=8661wasalreadyactive.

TogglecommandonProfileServicespanelcanbeusedtoenable/disable

Page 20: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

20 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

PlanAnalyzer:IBMDB2AnalyticsAcceleratorsupport

§ PossiblevaluesforQUERYACCELERATIONareobtainedfromSYSACCELERATEDPACKAGESandassignedtothespecialregister– (ENABLEWITHFAILBACK)BehaveslikeENABLE,butifanerroroccursonthefirstOPENof

theacceleratedstaticqueryDB2preventsthequeryfromfailing.Instead,DB2performsatemporarystatement-levelincrementalbindofthequery,andthequeryexecutesinDB2.

– (ELIGIBLE)Indicatesthatstaticqueriesareboundforacceleration,butareacceleratedonlywhentheymeetallaccelerationcriteriawiththeexceptionofcostandheuristicscriteria.QueriesthatdonotmeetthiscriteriaareboundforexecutioninDB2.

– (ALL)Indicatesthatallstaticqueriesareboundforacceleration,androutedtotheDB2Accelerator.IfDB2determinesaquerycannotbeacceleratedandthequeryreferencesauserbasetableorview,thebindorrebindpackagefailswithanerror.

SupportfornewBIND/REBINDcardsforpackages

Page 21: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

21 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

CAPlanAnalyzer:IBMDB2AnalyticsAcceleratorsupport

§ EXPLAINwithQUERYACCELERATION– Generatetheaccesspathinformationforpackagesthatwerebound

withthisoption,withoutissuingaREBIND.– FUTUREexplainwillSETthespecialregisterCURRENTQUERY

ACCELERATIONbeforethedynamicexplaintoreflectthevalueboundinthecatalogforthepackage.

– IfDSNZPARMACCELMODEL=YES,FutureExplainoverridesthevaluethatisspecifiedintheQUERYACCELERATIONbindoptiontoNONE.Thisactionallowstheaccesspathtogeneratesuccessfully.(nextslidewillillustrate)

Page 22: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

22 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

CAPlanAnalyzer:IBMDB2AnalyticsAcceleratorsupport

ACCESStypeillustratesthequerycanbeexecutedontheIBMDB2Analytics

Accelerator

ViewDSN_QUERYINFO_TABLEwhenusingExplainProfile– PLAN_TABLEOption===>ALL

Page 23: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

23 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

AccelerateandMonitorIDAATableswithRC/Query,BatchProcessorandSysview forDB2

Page 24: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

24 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

CADatabaseAdministrationforDB2forz/OS

§ CARC/Query &BatchProcessor(canusewithautomation)– Noneedtonavigatebetweenmultiplesolutions– ManageDB2AnalyticsAcceleratorwithinyourCADB2solutions

§ Display/Start/StopAccelerator§ Add/RemovetablestoDB2AnalyticsAccelerator§ Loadtabletotheaccelerator§ Enable/Disabletableacceleration/replication§ AlterAcceleratedtableDist.&OrgKeys§ ArchiveAcceleratedtable§ ForceRemoveTablefromDB2AnalyticsAccelerator§ Restorethearchivedmovedpartitionsdata

NewwithR19

Page 25: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

25 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

ManageDB2AnalyticsAcceleratorUseCARC/QueryforIDAAadministration

Use“?”linecommandtoseeavailablecommands.

IDAATablelevelfunctionsareavailabletoDefine,Alter,Remove,Load,etc.

Page 26: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

26 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

ManageDB2AnalyticsAccelerator

§ LoadDB2TableintoIDAA– RC/QALOADCommand

– CanloadrangeofpartitionsorentireTable

– UsesIDAALoaderutility

– MostcommandssuchasALOADareavailableusingBatchProcessorScripts

UseCARC/QueryforIDAAadministration

Page 27: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

27 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

SYSVIEWforDB2– IDAASubsystemStatistics

§ Newacceleratorrelatedfieldswereaddedtorecords:– Databasestatistics(IFCIDs2and1002)– DB2systemparameters(IFCIDs106and1006)

§ Updatedreports:– SYSACCEL/SYSACDTL:AcceleratorList/Detail– HSACCLST/SYSCCDTL:AcceleratorServerList/Detail(history)– HSUACLST/HSUACDTL:AcceleratorServerList/DetailSummary(history)– BTSTATR1:StatisticsDataTrace(batch)– BTSTASM2:SummaryofDB2databaseaddressspacestatistics(batch)– SYSSTATS/SYSTATA,GRPSTATS/GRPSTATA:SystemOverview

Page 28: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

28 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DB2AnalyticsAccelerator

§ Subsystemstatistics:AcceleratorDetails– SYSACDTL:

AcceleratorDetails– HSACCDTL/

HSUACDTL:AcceleratorServerDetails/Summary

CASYSVIEW®PerformanceManagementforDB2

Page 29: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

29 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DataDrivenDBPerformanceManagementMainframeOperationalIntelligence

Page 30: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

30 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

EXPERTSYSTEMS&MACHINELEARNING§ AnalysisofHistorical,Near

Real-timeplusLivedata§ DataMining,MachineLearning

&Autonomics§ SelfDrivingCars

DATAMINING&DECISIONSUPPORT§ AnalysisofHistorical&NearReal-timeData§ DataMining,Aggregations&Decision

Support§ NavigationToolswithTrafficUpdates

BI&STATISTICALANALYSIS§ AnalysisofHistoricalData§ BIReporting,Slicing/Dicing§ BasicNavigationTools

EvolutionofOperationalIntelligenceActionableanalyticswithsignificantadvancestowardszerotouchoperations

ANALYTICS1.0BUSINESSINTELLIGENCE

ANALYTICS3.0DATA-DRIVENAPPLICATIONS

ANALYTICS2.0BIGDATA

TechnologyTrend

Page 31: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

31 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

55%ofapps

dependonmainframe

70%world’scorporate

dataisonamainframe

70%oftransactionsflowthroughmainframe

64%Increaseinmainframeworkloads

ANOMALYDETECTION

BUSINESSSERVICEMANAGEMENT

EXPERTSYSTEMS

SECURITYBREACH

DETECTION

IndustryOpportunityDataAnalyticsandtheMainframeOpportunity

Page 32: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

32 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

MainframeOperationalIntelligenceLeveragetechnologytrendtosolveanimportantMainframeproblem

ANOMALYDETECTION

REPORTINGMODERNIZATION

BUSINESSSERVICEPERSPECTIVES

EXPERTSYSTEMS

• Reacttothresholdevents

• Selfserviceviews• ModernU/X

• Predictanomalies• Proactiveresponse

• Topologydiscovery• Businessserviceperspectives

• Predictbusinessservicedisruption

• Rootcausehypothesis• Resolution guidance• Automateresponse

DataAnalyticsBI/StatisticalModeling

USERS

Generalist

MAINFRAM

EOPERA

TIONS

Experts

Specialists

Automation

ENTERP

RISE

SUPP

ORT

MTTR&FirefightingOptimizedPerformance&Efficiency

AutomationDataDrivenOperations

Page 33: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

33 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

IntelligentMainframeOperations- LiftingtheBurden

DATA-DRIVENAPPLICATIONS

ANALYTICALTOOLS&SKILLS

IN-HOUSEDATASCIENCE

IN-HOUSEDOMAINEXPERTISE

+

+

YOURBURDEN MainframeTeamCenter

LettheDATAdotheWORKforyou

DoMOREwithLESS!

Fueledby:§ advancedanalytic

algorithms§ machinelearning

Page 34: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

34 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

MainframeOperationalIntelligenceKeycapabilitiesbeingdevelopedtomanagethelifecycleofyourdataassets

AnalyticsProcessing Multi-ChannelDelivery

Multi-ChannelDataCapture

DistributedDB2,Oracle,MySQL,

Cassandra...

MainframeVSAM,DB2,IMSDB,IDMS,DATACOM,

SMF,Syslogs,Vtape,CICS

Itsyourdata,leverageittodotheworkforyou!

DataLifecycleManagement

• ReportDistribution• AnomalyAlerts• Ad-HocAnalysisTools• APIbaseddataaccess• Automationframeworks

ExpertSystemsAutonomics

Transport&Integration ScalableData

Storage

DataScienceandAnomalyDetection

BusinessIntelligence

ITOperationsIntelligence

APIManagement

MasterDataManagement

Page 35: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

35 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DataDrivenDBPerformanceManagementProblem,OpportunityandProposedSolution

Page 36: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

36 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

INCREASINGCOMPLEXITY REACTIVETOPROACTIVE EARLYWARNING

CompaniesaredevelopingcomplexSQL applicationsonDB2.Performanceoftendegradesovertimewithoutanyonenoticing(thecreepingtrend).

AnintelligentsystemthatcanrecognizeandprioritizesignificantchangesinSQLperformancebeforeitstartstoimpactresourceoverheadsand servicelevelagreements

ADBAoftendoesnotrecognizedegradationuntilcustomerscomplain orservicelevelagreementshavebeenmissed.

TheSituationEverincreasingapplicationvolumesandcomplexity

Page 37: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

37 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

§ Howdoyoudeterminewhenperformancestartedtodegrade?§ HowlongdoesittaketoidentifytheproblematicSQLstatements?§ Doyouknowhowthestatementsexecutedbeforetheperformance

degraded?§ Doyouhavealogofapplicationperformanceproblemsand

resolutions?– Canyoucomparethislogwithcurrentproblems?

§ ManycustomersoffloadCADetectordatastoreintoDB2tables– Queryheaviestplans/packages&manuallycompareto“baselines”– Noefficientmethodtore-evaluatebaselineswhen“theworldchanges”

– Howtomonitor“standarddeviation”and“creepingtrend”iscomplexandcumbersome

TheChallengeHowdoyouresolveperformanceproblems?

Page 38: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

38 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Capture CADetectorcollectsSQL

intervalperformancemetricsforanalysis.Createsan historicalviewofapplicationperformance,whichwillbestoredinthecloud.

Baselin

e BaselinesarecreatedthatcontainastatisticalanalysisofapplicationSQLperformanceforachosen,representative,period-in-time.Baselinerepositorycanbeupdatedwhenbaselinesaredeterminedtonolongerberepresentative.

Analyze Analyzesapplication

performancedeviationsfromnormalexecutionbehavior(i.e.,deviationsfrombaselines)andlogsinaneventsrepository. N

otify

DuringtheAnalyzestep,notificationsofperformancedeviationscanbesenttokeypersonnelviaemail.

Review

InadditiontooutputfromCapture,Baseline,andAnalyzetheapplicationwillallowyoutoreviewapplicationperformancehistorythroughawebbrowserinterface.Deeperanalyticsandvisualizationareavailablethroughthebrowserdashboard.

Mainframe

TheSolutionMainframeTeamCenter–OperationalIntelligence

Page 39: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

39 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

USECASE:Sherman,Debbie,andFredhavedeepexperienceandskillsintheirrespectiveareas.Theyhatebeingcalledafterasystemproblemhasoccurredandbeingaskedtoprovethattheirareawasatfaultorinnocent.Theywouldlikeasystemthattellsthemwhentheirareaisbehavingabnormally,sothattheycanaddressitbeforeitcomestotheattentionoftheSystemsPerformanceEngineer.

• Operations,SystemsProgrammer,• NetworkEngineer,ApplicationDBA

PERSONA:

PROBLEM§ “Avoid,detectandpredictissuesthatmightbeaproblem”§ “Thresholdsarehardtomaintainandgeneratelargeamountoffalsepositives”§ “Abilitytoseemultipleviewsofdata”§ “Abilitytocreateviewsofinformationfaster”§ “ThecurrentU/Xpreventseasycollaborationandaccesstoanalytics”

AnomalyDetection– ProblemAvoidance/Prediction

Page 40: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

40 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

AnomalyDetection– ProblemAvoidance/PredictionSOLUTION§ Detectanomalies&predictissuesreal-time,alertbasedonpredefinedrules

§ Leveragehistoricaldataandmachinelearningfordynamicthresholds

§ SimplifiedU/X– browseraccess&designedforcollaboration

BOTTOMLINE§ HighAvailability

§ Problemavoidance§ ReducedMTTR

§ ReduceSMEdependenceforissuedetection

Page 41: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

41 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

AnomalyDetection– DeepDive

§ UtilizeHistoricaldata§ DefinebandsofLikelyandunlikelyvalues

§ Maprealtimemetricstreamsagainstsystemdefinednormal

§ Multi-pointalertsgeneratedusingindustry-standardWestern-Electricrules

§ Makestaticthresholdsoptional!

Letdatadotheworkforyou

Unlikely

MostLikely

Metric

Time

TypicalVolatility

Anomaly

Tasksready

tobedispatched

LessLikely

Page 42: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

42 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

USE CASE:As someone owning IT operations and responsible for technology progress, my MF systems should exploitplatforms like Linux (X86 & Z) to offload data processing and non essential management capabilities. Lack of thiscapability limits the ability to extend the strengths of the mainframe with next generation technology that issupported on Linux.

• BusinessOwner• TechnologyOwner

PERSONA:

PROBLEM§ “Helpmedeployyouranalyticssolutioninhoursnotdays”§ “Nosignificantincreaseonmyteamsworkload,wearenotlinux experts”§ “WeplantoexpandourzecosystemtoincludeLinuxandrequiretoolstoleverageourstrategy”§ “Ensuringtechnologyprogresswithoutlosingthereliability/securityofMFishighvaluegoal”§ ”Ensureanalyticssolutiondonotincreasemyoperationscostssignificantly”

SimplifiedDeployment– MinimizeCostandRisk

Page 43: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

43 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

SimplifiedDeployment– MinimizeCostandRisk

Web-basedUI

RestAPI

z/OS

PerformanceManagement

DatabaseManagement

RestAPIs

StorageManagement

SoftwareVirtual

Appliance

BENEFITS§ LowCostcomputing§ Non-Invasive§ RetainsSecurity§ SetupinMinutes

ANALYTICSSTREAM

EXISTINGPRODUCTS

Browser

SOLUTION§ Virtualappliance§ ContainerizedPlug-n-play§ SimpleConfig GUI

MetricBaseline

AnomalyDetection

Correlations

Aggregation

HistoricalData

Page 44: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

44 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

BusinessServicePerspectives&TopologyViewsSOLUTION§ Monitorservicelevelmetrics

§ Analyzemetricswithabilitytodrilldownacrossentiretopology

§ Trackandprioritizeeventsaffectingservices,consolidatealerts

§ Correlatemetricsviamachinelearning

§ QuickrootcauseanalysisandreducedMTTR

BOTTOMLINE§ ReducedMTTR

§ ReduceSMEdependenceforissuetriage/investigation

§ Improvedenduserexperience

Page 45: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

45 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

ExpertSystems– IntelligentMainframe

SME

•SOLUTION§ AssistedtriagethathelpsfasterRCA,reduced

MTTRandfacilitatesbetterdecisions§ Utilizecorrelationdatasciencetofindclusters

ofalertsandrelationships

§ Leveragemachinelearning&yourdatatothesystemtriageandisolatetheproblem

§ Systemlearnsfromexperts,helpsonboardjuniorstafffaster

BENEFITS§ ReducedMTTR

§ Higherproductivityofjuniorstaff§ TransferofTribalknowledgetoanexpertsystem

§ Lowercostsofoperations,noincreaseinrisks

1

2

3

41 3

2

4

Page 46: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

46 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

LEVERAGEDATAITSYOURASSET

MOVEFROMREACTIVETOPROACTIVE

DETECTANOMALIESAVOIDPROBLEMS

WrapUpandKeyTakeawayMainframeOperationalIntelligence&DB2Tools

Expertuserswithdecadesofexperience

Highlycustomizable,flexibletoolkits

Basicsoftwareintelligence

InexperiencedusersnewtoMainframe

Toolsthatguideuserstodecisions

Predictivesoftware

intelligence

WeInviteyoutoparticipateinDesign@CAandTechPreview!

Page 47: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

@CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.47 @CAWORLD#CAWORLD

MainframeandWorkloadAutomation

FormoreinformationonMainframeandWorkloadAutomation,pleasevisit:http://cainc.to/9GQ2JI

Page 48: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

48 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

RecommendedSessions

SESSION# TITLE DATE/TIME

MFX79E ProtectingandTappingIntoyourDataGoldmine:leveragingwhatresidesinyourmainframe 11/15/2016at9:00am

MFX80EIntelligentMainframeManagement- DataDrivenDatabase PerformanceManagement 11/15/2016at10:00am

MFX81EHowtoGettheMostoutofYourDB2,DB2Management,andAnalyticsInvestment 11/15/2016at11:00am

MFX88S StrategyandVisionforCADB2DatabaseManagement 11/17/2016at12:45pm

MFX90S DrivingDownCostsforDB2Management 11/17/2016at1:45pm

MFX91S BirdsofaFeather/StumptheTechieforCADB2Tools! 11/17/2016at3:00pm

Page 49: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

49 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

MustSeeDemos

DemoNameServicesYTheater#location

DemoNameSolutionYTheater#location

DemoNameProductXTheater#location

DemoNameProductXTheater#location

Page 50: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

50 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Questions?

Page 51: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

51 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Thankyou.

Stayconnectedatcommunities.ca.com

Page 52: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

52 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.

Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.

ForInformationalPurposesOnlyTermsofthisPresentation