z/OSVersion 2 Release 3

DFSMS Advanced Copy Services

IBM

SC23-6847-30

Note

Before using this information and the product it supports, read the information in “Notices” on page749.

This edition applies to Version 2 Release 3 of z/OS (5650-ZOS) and to all subsequent releases and modifications untilotherwise indicated in new editions.

Last updated: 2019-03-01© Copyright International Business Machines Corporation 1994, 2019.US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract withIBM Corp.

Contents

List of Figures.................................................................................................... xviiList of Tables.......................................................................................................xix

About this document...........................................................................................xxiRequired product knowledge.................................................................................................................... xxi

How to send your comments to IBM................................................................... xxiiiIf you have a technical problem.............................................................................................................. xxiii

Summary of changes......................................................................................... xxivSummary of changes for z/OS Version 2 Release 3 (V2R3) ...................................................................xxivSummary of changes for z/OS Version 2 Release 2 (V2R2) ...................................................................xxviSummary of changes for z/OS Version 2 Release 1 (V2R1) as updated February, 2015..................... xxviiz/OS Version 2 Release 1 summary of changes....................................................................................xxviii

Part 1. Advanced Copy Services Overview.............................................................. 1

Chapter 1. Introducing Advanced Copy Services........................................................................................3In this topic.............................................................................................................................................3Overview of the Advanced Copy Services functions..............................................................................3

Extended remote copy (XRC)............................................................................................................4Peer-to-Peer Remote Copy (PPRC) ..................................................................................................4FlashCopy ......................................................................................................................................... 5Global Mirror..................................................................................................................................... 5Metro/Global Copy............................................................................................................................ 5Metro/Global Mirror.......................................................................................................................... 5Multi-Target Mirror............................................................................................................................ 6Failover/Failback............................................................................................................................... 6SnapShot........................................................................................................................................... 6Concurrent copy ............................................................................................................................... 6

Using the ESS Copy services Web interface.......................................................................................... 6Combining copy services operations..................................................................................................... 7Volume types.......................................................................................................................................... 8

Chapter 2. What is remote copy? ................................................................................................................9In this topic.............................................................................................................................................9Overview of remote copy .......................................................................................................................9

Using remote copy for disaster recovery....................................................................................... 10Using remote copy for workload migration....................................................................................12

Deciding which remote copy option to use..........................................................................................13Choosing extended remote copy....................................................................................................14Choosing Peer-to-Peer Remote copy............................................................................................. 15Choosing Global Mirror................................................................................................................... 17Choosing Multi-Target Mirror.......................................................................................................... 17

Using channel extenders .....................................................................................................................18XRC, PPRC and GDPS combination incremental resynchronization................................................... 18

Part 2. Extended Remote Copy............................................................................. 19

Chapter 3. Planning for extended remote copy........................................................................................ 21In this topic...........................................................................................................................................21XRC requirements................................................................................................................................ 21

iii

XRC software requirements............................................................................................................21XRC hardware requirements.......................................................................................................... 21

XRC operational considerations...........................................................................................................22Introducing the XRC components........................................................................................................23

XRC primary systems......................................................................................................................23System data mover......................................................................................................................... 24XRC volume terminology................................................................................................................ 26XRC data sets.................................................................................................................................. 27XRC storage control sessions......................................................................................................... 28

Establishing XRC secondary volumes..................................................................................................29Evaluating remote copy with DFSMShsm............................................................................................ 29Defining storage requirements............................................................................................................ 30

Virtual storage requirements..........................................................................................................30Real storage requirements............................................................................................................. 30Paging space requirements............................................................................................................ 31Library requirements...................................................................................................................... 32

Configuring extended remote copy......................................................................................................32Choosing an XRC configuration...................................................................................................... 32Including channel extenders..........................................................................................................34

Determining XRC resource needs........................................................................................................ 34Evaluating how XRC affects the primary storage subsystem........................................................ 35Evaluating how XRC affects the recovery storage subsystem.......................................................35Determining the recovery site storage capacity............................................................................ 35Determining recovery system access to resources....................................................................... 36Establishing storage subsystem channel connections.................................................................. 36Establishing XRC ESCON connections............................................................................................36Establishing XRC FICON connections............................................................................................ 37Establishing XRC system data mover connections........................................................................ 37Estimating XRC system resources for system data mover operations..........................................37Allocating XRC journal data sets.................................................................................................... 37

Protecting access to XRC commands.................................................................................................. 37XRC enhanced multiple reader function..............................................................................................38

Configuration recommendations....................................................................................................38Enabling the XRC enhanced multiple reader function...................................................................39Disabling the XRC enhanced multiple reader functions................................................................ 41Increasing and decreasing the number of read tasks................................................................... 41Adjusting multiple utility volumes and alias addresses................................................................ 42

Chapter 4. Setting up the extended remote copy environment............................................................... 45In this topic...........................................................................................................................................45Installing and configuring XRC.............................................................................................................45Recovery system clock considerations................................................................................................46Virtual storage messages.....................................................................................................................47Controlling access to XRC resources................................................................................................... 47

Controlling ICKDSF activity to XRC volumes..................................................................................47Controlling access to XRC commands................................................................................................. 47

Placing TSO commands in an RACF-protected library.................................................................. 47Defining resource profiles in the RACF FACILITY class................................................................. 48

Including XRC TSO commands in automated procedures..................................................................49Using the ANTRQST API to run XRC.....................................................................................................49Specifying XRC journal, control, and state data sets.......................................................................... 49

Specifying the journal data sets..................................................................................................... 51Specifying the control data set.......................................................................................................54Specifying the state data set.......................................................................................................... 54Specifying the cluster data set....................................................................................................... 55Specifying the cluster state data set..............................................................................................56

Creating a PARMLIB data set............................................................................................................... 56Copying the catalog and control data sets.......................................................................................... 56

iv

Specifying XRC utility volumes.............................................................................................................57Identifying volume pairs...................................................................................................................... 57Optimizing XRC performance...............................................................................................................58

Configuring for high performance...................................................................................................58Balancing storage control configurations...................................................................................... 61Distributing work loads...................................................................................................................61Balancing system data mover configurations................................................................................ 61Maximizing access to journal data sets..........................................................................................61

Chapter 5. Extended remote copy command descriptions...................................................................... 63In this topic...........................................................................................................................................63Issuing extended remote copy TSO commands..................................................................................63

XADDPAIR–Adding volume pairs or utility volumes...................................................................... 65XADVANCE—Updating secondary volumes....................................................................................70XCOUPLE—Coupling XRC sessions.................................................................................................72XDELPAIR–Deleting volume pairs.................................................................................................. 75XEND–Ending a session..................................................................................................................78XQUERY–Querying a session..........................................................................................................82XRECOVER–Recovering data on the recovery system...................................................................90XSET–Changing session parameters..............................................................................................93XSTART–Starting a session...........................................................................................................100XSTATUS – querying XRC status.................................................................................................. 102XSUSPEND–Suspending volumes or sessions............................................................................ 104

ANTRQST application programming interface overview...................................................................110

Chapter 6. Administering your extended remote copy environment.....................................................113In this topic........................................................................................................................................ 113Description and use of parameter libraries (Parmlibs)..................................................................... 113

PARMLIB members.......................................................................................................................114Authorization................................................................................................................................ 115XSET PARMLIB..............................................................................................................................116ANTXIN00 parmlib parameters................................................................................................... 116

Description and use of flags...............................................................................................................137Flag parameters............................................................................................................................137FLAG syntax considerations......................................................................................................... 139Flag examples...............................................................................................................................139

Description and use of patches......................................................................................................... 139Patch parameters......................................................................................................................... 139PATCH syntax considerations.......................................................................................................140Patch examples............................................................................................................................ 140

PARMLIB example..............................................................................................................................141Examples of XQUERY ENVIRONMENT reports..................................................................................142

XQUERY ENVIRONMENT(FLAG) report........................................................................................142XQUERY ENVIRONMENT(PARM) report.......................................................................................142XQUERY ENVIRONMENT(PATCH) report..................................................................................... 143

Chapter 7. Managing extended remote copy operations....................................................................... 145In this topic........................................................................................................................................ 145Starting or restarting an XRC session................................................................................................ 145Workload balancing ...........................................................................................................................146

Application protection.................................................................................................................. 146Application workload pacing........................................................................................................ 147Subsystem long-busy state.......................................................................................................... 150Synchronization and resynchronization processing.................................................................... 150

Using XRC utility devices....................................................................................................................151Addressing the utility device selection........................................................................................ 152Using parallel access volumes for utility devices........................................................................ 155

Adding an XRC volume pair................................................................................................................155

v

Initializing volume pairs............................................................................................................... 156Adding volumes in a volume group.............................................................................................. 157Adding a volume with the FULLCOPY or QUICKCOPY option......................................................157Adding a volume with the NOCOPY option.................................................................................. 159Adding a volume with the SUSPENDED option............................................................................159Adding a volume with the DONOTBLOCK option......................................................................... 160Adding a volume with the LOGPLUS option................................................................................. 160Understanding the XADDPAIR command.................................................................................... 160

Using the ATTIME, DRAIN, and IMMEDIATE keywords.................................................................... 162Deleting an XRC volume pair .............................................................................................................162Using the XSUSPEND command........................................................................................................ 163

Suspending XRC volume pairs......................................................................................................164Suspending an XRC session......................................................................................................... 164Adding back suspended volumes to the XRC session.................................................................165

Using XRC with FlashCopy and tertiary volumes.............................................................................. 166Using the XSET TIMEOUT parameter................................................................................................ 166Channel extender considerations......................................................................................................167Running the ICKDSF program ........................................................................................................... 167Using XRC reports.............................................................................................................................. 168

Examples of XQUERY reports in an uncoupled environment...................................................... 169Examples of XQUERY reports in a coupled environment............................................................ 172Examples of XQUERY ADVANCE and XQUERY RECOVER reports............................................... 175

Accessing secondary volumes while XRC is active........................................................................... 175Ending an XRC session.......................................................................................................................176Applying XRC operational scenarios..................................................................................................176

Example: applying maintenance.................................................................................................. 176Example: preparing for disaster...................................................................................................177Example: migrating data...............................................................................................................178Example: switching system modes..............................................................................................178Example: changing the session error recovery level................................................................... 180Example: changing a volume pair's error recovery level.............................................................181Example: suspending and resynchronizing a volume pair.......................................................... 181Example: suspending and resynchronizing a session................................................................. 182Example: changing volume channel connection addresses....................................................... 182Examples: changing TIMEOUT intervals for suspended sessions.............................................. 183

Identifying XRC system interactions................................................................................................. 185XRC varies volumes offline and online.........................................................................................185Using the DEVSERV and IDCAMS functions.................................................................................185

Chapter 8. Managing coupled extended remote copy sessions.............................................................187In this topic........................................................................................................................................ 187Overview of CXRC...............................................................................................................................187Configuring a coupled XRC environment .......................................................................................... 188

Identifying sessions in a coupled environment........................................................................... 188Choosing a coupled XRC configuration........................................................................................ 189Accessing the CXRC master data set........................................................................................... 194Migrating CXRC session clustering ..............................................................................................194Defining master data sets in a coupled environment.................................................................. 196Defining cluster data sets in a coupled environment.................................................................. 197Using journal, state, and control data sets.................................................................................. 199

Managing coupled XRC operations....................................................................................................199Coupling XRC sessions................................................................................................................. 200Coupling XRC sessions through a cluster session....................................................................... 201Querying coupled status for XRC sessions.................................................................................. 203Creating a backup copy of secondary volumes (XADVANCE)......................................................203Restarting an inactive XRC coupled session................................................................................204What to do if the master session is in coupled HOLD status.......................................................206Using the XCOUPLE RELEASE command..................................................................................... 211

vi

What to do if a session is in COUPLE_FAILED status.................................................................. 211What to do if cluster session is in INACTIVE status.................................................................... 212Removing coupled sessions......................................................................................................... 212Generating dumps of address spaces..........................................................................................213

Applying CXRC operational scenarios............................................................................................... 214Example: recovering from a disaster using the XRECOVER command....................................... 214Example: applying software maintenance in a coupled environment........................................ 215

Chapter 9. Extended remote copy data recovery operations.................................................................217In this topic........................................................................................................................................ 217Understanding the XRC volume synchronization process................................................................ 217

Overview of consistency group time............................................................................................ 217Terms used for consistency group time.......................................................................................218Changes to consistency group time............................................................................................. 218Example: illustration of consistency group time......................................................................... 219Understanding the importance of timestamped writes.............................................................. 220

Recovering data with XRC—Uncoupled and coupled sessions......................................................... 221Recovering data with XRC............................................................................................................ 221Creating a recovery volume report...............................................................................................223Advancing consistency time using the XADVANCE command.................................................... 223

Chapter 10. Migrating data with extended remote copy........................................................................ 225In this topic........................................................................................................................................ 225Steps for migrating data with XRC.....................................................................................................225Migration operation considerations...................................................................................................226

Chapter 11. Recovering from error conditions using extended remote copy........................................229In this topic........................................................................................................................................ 229Specifying the ERRORLEVEL parameter in coupled and uncoupled sessions................................. 229

Comparing the ERRORLEVEL options.......................................................................................... 229ERRORLEVEL(VOLUME)................................................................................................................ 230ERRORLEVEL(SESSION)............................................................................................................... 230ERRORLEVEL(group_name)......................................................................................................... 231

Steps for recovering from environmental errors............................................................................... 231Steps for recovering from processor, address space, and XRC data set failures.............................231Using mirror status verification to check for non-duplex volumes...................................................232Using state saves to diagnose suspected problems......................................................................... 232

Part 3. Peer-to-Peer Remote Copy......................................................................235

Chapter 12. Planning for Peer-to-Peer Remote Copy.............................................................................237In this topic........................................................................................................................................ 237PPRC requirements............................................................................................................................ 237

PPRC software requirements....................................................................................................... 237PPRC hardware requirements...................................................................................................... 237

PPRC operational considerations...................................................................................................... 238Examining PPRC configuration options........................................................................................239

Establishing the PPRC solution..........................................................................................................242Synchronous PPRC solutions....................................................................................................... 242Asynchronous PPRC solutions..................................................................................................... 244Multi-target PPRC solutions......................................................................................................... 245PPRC and DASD channel extenders.............................................................................................251

Determining PPRC resource needs....................................................................................................252Steps for evaluating how PPRC affects the primary storage subsystem.................................... 252Evaluating how PPRC affects the recovery storage subsystem.................................................. 252Determining the recovery site storage capacity.......................................................................... 252Determining recovery system access to resources..................................................................... 253

vii

Establishing storage subsystem channel connections................................................................253Establishing PPRC ESCON connections....................................................................................... 253Establishing PPRC FCP connections............................................................................................ 254

Copying the catalog and control data sets........................................................................................ 255Controlling access to PPRC commands.............................................................................................255

Chapter 13. Setting up the Peer-to-Peer Remote copy environment.................................................... 257In this topic........................................................................................................................................ 257Installing Peer-to-Peer Remote copy................................................................................................ 257Controlling access to PPRC resources...............................................................................................257

Protecting access to PPRC commands........................................................................................ 258Controlling ICKDSF activity to PPRC volumes............................................................................. 259

Identifying volume pairs.................................................................................................................... 260Steps for including PPRC TSO commands in automated procedures.............................................. 261Configuring storage subsystem resources for PPRC.........................................................................261

Configuring IBM storage controls.................................................................................................261Accessing PPRC secondary volumes........................................................................................... 262Accessing open system devices...................................................................................................262Optimizing PPRC performance.....................................................................................................262

Using FlashCopy target as PPRC primary.......................................................................................... 264Setting up Metro/Global Copy............................................................................................................264

Metro/Global copy mode combinations.......................................................................................265

Chapter 14. Peer-to-Peer Remote copy command descriptions........................................................... 267In this topic........................................................................................................................................ 267PPRC command overview.................................................................................................................. 267CDELPAIR – deleting volume pairs....................................................................................................268

CDELPAIR command syntax.........................................................................................................268CDELPAIR command examples................................................................................................... 270

CDELPATH – deleting paths............................................................................................................... 270CDELPATH command syntax........................................................................................................ 270CDELPATH command examples...................................................................................................271

CESTPAIR – establishing volume pairs............................................................................................. 272CESTPAIR command syntax.........................................................................................................272CESTPAIR command examples....................................................................................................278

CESTPATH – establishing paths.........................................................................................................279CESTPATH command syntax........................................................................................................ 280CESTPATH command examples...................................................................................................282

CGROUP – controlling volume groups............................................................................................... 282CGROUP command syntax........................................................................................................... 283CGROUP command examples...................................................................................................... 284

CQUERY – querying status.................................................................................................................284CQUERY command syntax............................................................................................................285CQUERY command examples.......................................................................................................287

CRECOVER – recovering data on the recovery system..................................................................... 287CRECOVER command syntax....................................................................................................... 287CRECOVER command example....................................................................................................289

CSUSPEND – suspending volume pairs.............................................................................................289CSUSPEND command syntax....................................................................................................... 290CSUSPEND command examples.................................................................................................. 291

PSETCHAR – set PPRC volume pair characteristics..........................................................................291PSETCHAR command syntax....................................................................................................... 291PSETCHAR command examples.................................................................................................. 293

Chapter 15. Managing Peer-to-Peer Remote Copy operations..............................................................295In this topic........................................................................................................................................ 295Managing the PPRC system............................................................................................................... 295

System IPL volumes..................................................................................................................... 295

viii

ESCON Manager............................................................................................................................295Resource Measurement Facility (RMF) data................................................................................ 296DEVSERV and IDCAMS................................................................................................................. 296

Identifying Peer-to-Peer Remote Copy volume states..................................................................... 296Establishing PPRC paths.................................................................................................................... 299

General overview for establishing a FCP path............................................................................. 299General overview for establishing ESCON paths......................................................................... 300

Managing volumes and paths............................................................................................................ 302Adding a PPRC volume pair.......................................................................................................... 302Querying PPRC volumes............................................................................................................... 303Querying PPRC linkage................................................................................................................. 314Querying PPRC paths....................................................................................................................315Suspending PPRC volume pair operations...................................................................................320Deleting a PPRC volume pair........................................................................................................320Deleting PPRC paths.....................................................................................................................321

Using PPRC with FlashCopy...............................................................................................................321Managing PPRC extended distance mode.........................................................................................321

Understanding how PPRC extended distance works...................................................................322Setting up your environment to use PPRC extended distance ...................................................322Using PPRC extended distance.................................................................................................... 323Converting from one PPRC volume state to another .................................................................. 324Monitoring PPRC volume pairs..................................................................................................... 326Scenarios using PPRC extended distance and synchronous mode for backup purposes..........326Using extended distance and synchronous modes during peak and nonpeak operations........ 328

Failover/Failback in a PPRC environment..........................................................................................329Failover process for synchronous PPRC in a planned outage..................................................... 329Failback process for synchronous PPRC in a planned outage.....................................................330Failover/Failback for synchronous PPRC an unplanned outage..................................................332Failover process for PPRC-XD in a planned outage..................................................................... 332Failback process for PPRC-XD in a planned outage.....................................................................332Failover/Failback process for PPRC-XD in an unplanned outage................................................ 334

Chapter 16. Peer-to-Peer Remote Copy data recovery operations....................................................... 335In this topic........................................................................................................................................ 335Examining disaster recovery from a system viewpoint.....................................................................335Resuming operations at the recovery site.........................................................................................336PPRC failover/failback........................................................................................................................337Managing errors during recovery....................................................................................................... 338

Errors encountered when writing to PPRC volumes established with CRIT(YES)......................338Errors that occur in the absence of write activity........................................................................ 338Errors that cause a PPRC pair to become suspended................................................................. 338

Chapter 17. Moving and migrating data with Peer-to-Peer Remote Copy.............................................339In this topic........................................................................................................................................ 339Moving the work load with PPRC....................................................................................................... 339Migrating data with PPRC...................................................................................................................340Copying the secondary volumes with PPRC......................................................................................340Migrating data on a secondary with Multi-Target Mirror................................................................... 341Migrating data on a primary with Multi-Target Mirror....................................................................... 343

Chapter 18. Recovering from Peer-to-Peer Remote Copy error conditions.......................................... 347In this topic........................................................................................................................................ 347Understanding host error recovery procedures................................................................................ 347

Preparing for PPRC error recovery............................................................................................... 348Putting PPRC error recovery procedures into effect......................................................................... 348

Chapter 19. Peer-to-Peer Remote Copy dynamic address switching (P/DAS)...................................... 355In this topic........................................................................................................................................ 355

ix

How does P/DAS work?......................................................................................................................355Preparing for P/DAS operations......................................................................................................... 356

Hardware and software requirements......................................................................................... 356Environmental conditions.............................................................................................................356Additional P/DAS considerations................................................................................................. 357

P/DAS operations............................................................................................................................... 357Typical PPRC configuration before P/DAS operations................................................................. 357Steps for using P/DAS in a nonsysplex, shared-disk environment..............................................359Typical PPRC configuration after a P/DAS function has completed............................................ 360Steps for using P/DAS in a sysplex environment......................................................................... 362

Replying to P/DAS-related messages................................................................................................363System actions for switch pair, and swap.................................................................................... 365

P/DAS error conditions.......................................................................................................................367Storage-related failures............................................................................................................... 367I/O-related failures.......................................................................................................................367Validation failures......................................................................................................................... 367

P/DAS operations example................................................................................................................ 368

Part 4. Global Mirror.......................................................................................... 371

Chapter 20. Planning for Global Mirror................................................................................................... 373In this topic........................................................................................................................................ 373Global Mirror requirements............................................................................................................... 374

Global Mirror software requirements...........................................................................................374Global Mirror hardware requirements......................................................................................... 374

Global Mirror operational considerations..........................................................................................375Controlling access to Global Mirror commands................................................................................ 375Additional planning considerations................................................................................................... 375

Chapter 21. Setting up Global Mirror for ESS..........................................................................................377In this topic........................................................................................................................................ 377Setting up PPRC and FlashCopy........................................................................................................ 377Establishing Global Mirror paths........................................................................................................377Steps for configuring a Global Mirror session....................................................................................378Global Mirror session example.......................................................................................................... 379

Chapter 22. Global Mirror command descriptions................................................................................. 381In this topic........................................................................................................................................ 381Global Mirror command overview......................................................................................................381RQUERY – querying a Global Mirror session..................................................................................... 381

RQUERY command syntax............................................................................................................381RQUERY command examples...................................................................................................... 383

RSESSION – controlling a Global Mirror session...............................................................................384RSESSION command syntax........................................................................................................ 384RSESSION command examples...................................................................................................387

RVOLUME – manage volumes for Global Mirror session...................................................................387RVOLUME command syntax......................................................................................................... 387RVOLUME command examples.................................................................................................... 389

Chapter 23. Querying Global Mirror........................................................................................................ 391In this topic........................................................................................................................................ 391Deciding which query to use..............................................................................................................391Querying Global Mirror summary output at session level.................................................................391Querying Global Mirror summary output at LSS level.......................................................................398Querying Global Mirror summary output at device level.................................................................. 399

Chapter 24. Managing Global Mirror ...................................................................................................... 403

x

In this topic........................................................................................................................................ 403How Global Mirror consistency groups are formed...........................................................................403

Restrictions................................................................................................................................... 405Changing the Global Mirror session performance parameters.........................................................405Changing the Global Mirror session topology....................................................................................405Adding volumes to the Global Mirror session....................................................................................406Terminating a Global Mirror session..................................................................................................406Failover/failback for a Global Mirror session.....................................................................................406

Moving a Global Mirror session to the recovery site in a planned outage...................................406Returning Global Mirror to the primary site in an planned outage..............................................408Moving a Global Mirror session to the recovery site in an unplanned outage............................ 409Returning Global Mirror to the primary site in an unplanned outage..........................................411

Diagnosing Global Mirror session problems......................................................................................413

Chapter 25. Metro/Global Mirror.............................................................................................................415In this topic........................................................................................................................................ 415Introducing Metro/Global Mirror....................................................................................................... 415Setting up a Metro/Global Mirror configuration................................................................................ 416Metro/Global Mirror recovery scenarios............................................................................................417

Metro/Global Mirror planned site swap to intermediate............................................................. 417Metro/Global Mirror primary site unplanned outage – site swap to intermediate site.............. 419Metro/Global Mirror primary site planned outage – resume at remote......................................421Metro/Global Mirror primary site unplanned outage – resume at remote..................................423

Incremental Resync for Metro/Global Mirror cascade......................................................................424Introducing Incremental Resync for Metro/Global Mirror...........................................................424Setting up incremental resync for Metro/Global Mirror...............................................................425Recovery scenarios for Metro/Global Mirror with incremental resync....................................... 426

Part 5. FlashCopy.............................................................................................. 429

Chapter 26. What is FlashCopy?............................................................................................................. 431In this topic........................................................................................................................................ 431Overview of FlashCopy.......................................................................................................................431

Understanding how FlashCopy works..........................................................................................432Determining fast replication eligibility......................................................................................... 437Track space efficient FlashCopy...................................................................................................437

FlashCopy requirements....................................................................................................................438Determining FlashCopy software requirements..........................................................................438Determining FlashCopy hardware requirements.........................................................................438

Installing FlashCopy...........................................................................................................................439Using FlashCopy.................................................................................................................................439

Copying your data with FlashCopy...............................................................................................439Creating a backup copy of your data using FlashCopy ............................................................... 440Displaying information about FlashCopy volumes...................................................................... 441Inband FlashCopy.........................................................................................................................443Incremental FlashCopy................................................................................................................ 443Cascading FlashCopy....................................................................................................................445FlashCopy to PPRC primary..........................................................................................................447Remote Pair FlashCopy for XRC................................................................................................... 450Withdrawing FlashCopy relationships..........................................................................................451

FlashCopy consistency groups.......................................................................................................... 456Combining copy services functions with FlashCopy......................................................................... 457Using track space efficient FlashCopy...............................................................................................458

Copying your data with track space efficient FlashCopy.............................................................458Exhausted space situations..........................................................................................................458Releasing space for track space efficient volumes......................................................................458

Using extent space efficient FlashCopy.............................................................................................459

xi

Releasing space for extent space efficient volumes................................................................... 459Using FlashCopy TSO commands...................................................................................................... 459

Controlling access to FlashCopy commands............................................................................... 460FlashCopy establish (FCESTABL) command................................................................................461FlashCopy query (FCQUERY) command...................................................................................... 471FlashCopy withdraw (FCWITHDR) command.............................................................................. 474

Part 6. SnapShot copy........................................................................................481

Chapter 27. What is SnapShot copy?...................................................................................................... 483In this topic........................................................................................................................................ 483SnapShot copy requirements............................................................................................................ 483

Determining SnapShot copy software requirements.................................................................. 483Determining SnapShot copy hardware requirements................................................................. 484

Using SnapShot copy......................................................................................................................... 484Steps for initializing sessions....................................................................................................... 484Steps for providing a SnapShot working-space data space........................................................ 484Copying data with SnapShot copy................................................................................................485Moving data sets with SnapShot copy......................................................................................... 485

Determining how DFSMSdss determines volume eligibility for fast replication operations............486Using SnapShot copy, PPRC, and RVA together................................................................................ 486SnapShot SMF information................................................................................................................ 487

Part 7. Concurrent copy..................................................................................... 489

Chapter 28. What is concurrent copy?....................................................................................................491In this topic........................................................................................................................................ 491Understanding the concurrent copy solution....................................................................................491Concurrent copy requirements..........................................................................................................491

Determining concurrent copy software requirements................................................................ 492Determining concurrent copy hardware requirements............................................................... 492

Determining concurrent copy resource needs.................................................................................. 492Central and expanded storage..................................................................................................... 492Storage subsystem cache.............................................................................................................493Channel paths............................................................................................................................... 494

Using concurrent copy....................................................................................................................... 494Steps for initializing sessions....................................................................................................... 494Copying the data...........................................................................................................................495

SMF information................................................................................................................................. 495Scheduling concurrent copy operations............................................................................................495Virtual-concurrent-copy FlashCopy function.................................................................................... 495

Understanding the virtual-concurrent-copy................................................................................ 495Allocating working-space dataset (WSDS).................................................................................. 495Virtual-concurrent-copy SMF type 42 subtype 4 records........................................................... 497

ANTMIN00 parmlib............................................................................................................................ 497Modify commands..............................................................................................................................499

SETPARMLIB - change the ANTMAIN settings............................................................................ 499CCATTNTHROTTLE - control parallel attention processing.........................................................500CCREADAHEAD - tune the rate at which SDM reads updated track data from the controller

cache........................................................................................................................................500CCSTOR - list the concurrent copy session status.......................................................................500LISTWS - report the WSDS status................................................................................................ 501PETINFO - display information about the SDM pause element token table...............................501REFRESHWS - refresh the WSDS list........................................................................................... 502RELEASEWS - release ANTMAIN's enqueue on a WSDS.............................................................502

Appendix A. Advanced Copy Services diagnostic aids......................................... 503

xii

Maintaining the system data mover........................................................................................................ 503Restarting system data mover address spaces (SDM, XRC, CC, SnapShot).......................................... 503Diagnosing system data mover functions with the MVS MODIFY command.........................................503

CREFRESH operation (XRC)............................................................................................................... 504DELBMAP operation (XRC).................................................................................................................505DUMP operation (XRC, CC).................................................................................................................505DVCDATA operation (XRC, CC)........................................................................................................... 505IGNORE_INTERRUPTS operation (XRC)........................................................................................... 506LISTDVCS operation (XRC).................................................................................................................506LISTSESS Operation .......................................................................................................................... 507PATHS operation ................................................................................................................................509REDISCOVER operation (XRC)........................................................................................................... 510RESTART operation (XRC).................................................................................................................. 510SCDATA operation (XRC, CC)..............................................................................................................510SCTRAP operation (XRC)....................................................................................................................511SCTRAP2 operation (XRC)................................................................................................................. 512STATESAVE operation (XRC).............................................................................................................. 512SUSSESS operation (XRC)..................................................................................................................513TERMDVC operation (XRC).................................................................................................................514TERMSESS operation (XRC, CC).........................................................................................................515XENDDUMP operation (XRC)..............................................................................................................516XRCTRAP/SUPRDUMP operation (XRC).............................................................................................517Peer-to-peer remote copy diagnostic aids........................................................................................517

Appendix B. SMF type 42 records....................................................................... 519XRC information in SMF type 42 records................................................................................................ 519Concurrent copy information in SMF type 42 records............................................................................521

Concurrent copy SMF type 42 subtype 4 records............................................................................. 521

Appendix C. ANTRQST and ANTRQSTL macros – call to the system data moverAPI................................................................................................................525SDM API usability guide.......................................................................................................................... 527

Programming requirements...............................................................................................................527SDM API usage................................................................................................................................... 528SDM API macros.................................................................................................................................528SDM API invocation............................................................................................................................529Programming considerations.............................................................................................................531Programming examples..................................................................................................................... 534

Environment.............................................................................................................................................537Programming requirements.................................................................................................................... 537Restrictions.............................................................................................................................................. 538Recommended common invocation parameters....................................................................................538Input register information....................................................................................................................... 539Output register information.....................................................................................................................539Performance implications....................................................................................................................... 539Syntax for ILK=ESSRVCS......................................................................................................................... 539Syntax for ILK=PPRC............................................................................................................................... 548Syntax for ILK=SNAPSHOT......................................................................................................................559Syntax for ILK=XRC................................................................................................................................. 563Parameter descriptions for ILK=ESSRVCS..............................................................................................573

Subparameters for REQUEST=LEVEL................................................................................................ 573Subparameters for REQUEST=FCESTABLISH................................................................................... 573Subparameters for REQUEST=FCQUERY.......................................................................................... 581Subparameters for REQUEST=FCWITHDRAW.................................................................................. 583Subparameters for REQUEST=QFRVOLS...........................................................................................589Subparameters for REQUEST=QHA...................................................................................................591Subparameters for REQUEST=RQUERY............................................................................................ 593

xiii

Subparameters for REQUEST=RSESSION.........................................................................................595Subparameters for REQUEST=RVOLUME..........................................................................................598Subparameters for REQUEST=STATESAVE....................................................................................... 600

Parameter descriptions for ILK=PPRC....................................................................................................603Subparameters for REQUEST=FENCE............................................................................................... 603Subparameters for REQUEST=LEVEL................................................................................................ 605Subparameters for REQUEST=PDELPAIR......................................................................................... 605Subparameters for REQUEST=PDELPATH.........................................................................................607Subparameters for REQUEST=PESTPAIR......................................................................................... 609Subparameters for REQUEST=PESTPATH.........................................................................................615Subparameters for REQUEST=PFREEZE........................................................................................... 618Subparameters for REQUEST=PQSCSTAT.........................................................................................620Subparameters for REQUEST=PQUERY............................................................................................ 622Subparameters for REQUEST=PRECOVER........................................................................................ 625Subparameters for REQUEST=PRUN.................................................................................................627Subparameters for REQUEST=PSUSPEND........................................................................................629Subparameters for REQUEST=PSETCHAR........................................................................................ 631

Parameter descriptions for ILK=SNAPSHOT.......................................................................................... 633Subparameters for REQUEST=LEVEL................................................................................................ 633Subparameters for REQUEST=SDVCINFO.........................................................................................633Subparameters for REQUEST=SQRYDVCS........................................................................................ 635Subparameters for REQUEST=SQRYSSYS.........................................................................................638Subparameters for REQUEST=SRELEASE......................................................................................... 639Subparameters for REQUEST=SSNAP...............................................................................................640Character filtering.............................................................................................................................. 641

Parameter descriptions for ILK=XRC...................................................................................................... 642Subparameters for REQUEST=LEVEL................................................................................................ 642Subparameters for REQUEST=XADD.................................................................................................642Subparameters for REQUEST=XADVANCE........................................................................................645Subparameters for REQUEST=XCONTIME........................................................................................ 647Subparameters for REQUEST=XCOUPLE...........................................................................................648Subparameters for REQUEST=XDEL..................................................................................................650Subparameters for REQUEST=XEND.................................................................................................652Subparameters for REQUEST=XQUERY............................................................................................ 654Subparameters for REQUEST=XRECOVER........................................................................................ 656Subparameters for REQUEST=XSCSTATS......................................................................................... 659Subparameters for REQUEST=XSET..................................................................................................662Subparameters for REQUEST=XSTART............................................................................................. 667Subparameters for REQUEST=XSTATUS........................................................................................... 668Subparameters for REQUEST=XSUSPEND........................................................................................670

Common end codes for REQUESTS within each ILK.............................................................................. 672ANTQFRVL macro.................................................................................................................................... 674

ANTQFRVL header return and reason codes.....................................................................................674Volume capability and reason codes.................................................................................................674Volume extent capability and reason codes......................................................................................679Preserve Mirror reason codes............................................................................................................680XRC Remote Pair FlashCopy reason codes....................................................................................... 681

ABEND codes........................................................................................................................................... 682Return and reason codes.........................................................................................................................682

Appendix D. REXX support for the ANTRQST API................................................ 685Calling ANTTREXX................................................................................................................................... 688

Syntax for ANTTREXX........................................................................................................................ 688ANTTREXX results..............................................................................................................................688Example of specifying keywords....................................................................................................... 689Programming requirements...............................................................................................................689

Samples................................................................................................................................................... 690

xiv

ANTTREXX request types........................................................................................................................ 694FCESTABLISH (FlashCopy establish).................................................................................................695FCQUERY (FlashCopy query)............................................................................................................. 700FCWITHDRAW (FlashCopy withdraw)............................................................................................... 702LEVEL (query ANTRQST level)........................................................................................................... 706QHA (Query where path groups are established)............................................................................. 707FENCE (PPRC prevent unintended access through Soft Fence)....................................................... 707PDELPAIR (PPRC delete volume pair)............................................................................................... 708PDELPATH (PPRC delete path).......................................................................................................... 709PESTPAIR (PPRC establish volume pair)...........................................................................................711PESTPATH (PPRC establish path)...................................................................................................... 714PFREEZE (PPRC control volume groups)...........................................................................................716PQSCSTAT (Query storage controller)............................................................................................... 717PQUERY (PPRC query)........................................................................................................................717PRECOVER (PPRC recover data on the recovery system)................................................................. 719PRUN (PPRC control volume group).................................................................................................. 720PSETCHAR (PPRC set characteristics of volume pair)...................................................................... 721PSUSPEND (PPRC suspend volume pair).......................................................................................... 723RQUERY (Global Mirror query)........................................................................................................... 724RSESSION (control a Global Mirror session)..................................................................................... 725RVOLUME (Global Mirror manage volumes)...................................................................................... 728STATESAVE (Request State Save)......................................................................................................730WAIT (perform a wait)........................................................................................................................731XADD (XRC add volume pair)............................................................................................................. 731XADVANCE (XRC recover).................................................................................................................. 733XCONTIME (XRC consistency time)...................................................................................................734XCOUPLE (couple XRC connections)................................................................................................. 734XDEL (XRC delete volume pair)..........................................................................................................735XEND (XRC end)................................................................................................................................