implementing an ndmp backup solution using commvault simpana 9.0

72
© Copyright IBM Corporation, 2011. Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS Technical Report Udayasuryan Kodoly IBM Systems and Technology Group ISV Enablement April 2011

Upload: others

Post on 03-Feb-2022

9 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Implementing an NDMP backup solution using CommVault Simpana 9.0

© Copyright IBM Corporation, 2011.

Implementing an NDMP backup solution using CommVault Simpana 9.0 on

IBM SONAS Technical Report

Udayasuryan Kodoly

IBM Systems and Technology Group ISV Enablement April 2011

Page 2: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

Table of contents Abstract ..................................................................................................................................... 1 SONAS NDMP ........................................................................................................................... 1

Overview of SONAS NDMP ..................................................................................................................... 1 SONAS NDMP supported physical configuration .................................................................................... 2

Two-way (or remote) SONAS NDMP configuration .......................................................... 2 Three-way SONAS NDMP configuration........................................................................... 3 Fundamentals of SONAS NDMP feature .......................................................................... 4 SONAS NDMP command-line configuration ..................................................................... 6 ISV LAB SONAS system configuration ............................................................................. 6 SONAS NDMP network group configuration ..................................................................... 7 SONAS NDMP node group configuration ......................................................................... 8 Configuring SONAS NDMP backup prefetch .................................................................... 9 Concurrent SONAS NDMP backup and restore usage with other SONAS functions ..... 11 You need to take care of the following considerations for CommVault Simpana 9.0 DMA SONAS NDMP backup .................................................................................................... 12 Monitoring NDMP session on SONAS system ................................................................ 13 Monitoring NDMP log information on SONAS system .................................................... 14

CommVault Simpana 9.0 NDMP configuration ..................................................................... 15 CommVault Simpana 9.0 NDMP specific software deployment ............................................................ 15 Launching CommVault Simpana 9.0 CommCell console on a Microsoft Windows .............................. 16 Launching CommVault Simpana 9.0 CommCell console ...................................................................... 16 SONAS NDMP configuration on CommVault Simpana 9.0 ................................................................... 17

Tape library and drive configuration ................................................................................ 17 Two-way (or remote) SONAS NDMP library and drive configuration ............................. 18 Three-way SONAS NDMP library and drive configuration .............................................. 23 Creating CommVault Simpana 9.0 storage policy .......................................................... 31 Creating CommVault Simpana 9.0 storage policy for three-way SONAS NDMP: Considerations ................................................................................................................. 38 Adding CommVault Simpana 9.0 client for SONAS NDMP ............................................ 39 Creating a new subclient for the newly-created CommVault Simpana 9.0 SONAS NDMP client ................................................................................................................................ 42

SONAS NDMP backup using CommVault Simpana 9.0 NDMP essentials .......................................... 47 Types of CommVault Simpana 9.0 backup ..................................................................... 47 Initiating CommVault Simpana 9.0 full SONAS NDMP backup ...................................... 48 The CommVault Simpana 9.0 incremental / differential SONAS NDMP backup considerations ................................................................................................................. 51 Initiating CommVault Simpana 9.0 incremental / differential SONAS NDMP backup .... 52 Scheduling CommVault Simpana 9.0 SONAS NDMP backup ....................................... 54 Viewing CommVault Simpana 9.0 NDMP backup history ............................................... 56

SONAS NDMP restore using CommVault Simpana 9.0 ........................................................................ 58 Direct Access Restore ..................................................................................................... 58 Browse and restore SONAS NDMP backup with CommVault Simpana 9.0 ................... 59

Page 3: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

Summary ................................................................................................................................. 62 Appendix A: Glossary ............................................................................................................ 63 Appendix B: Materials used in the lab setup ........................................................................ 64 Appendix C: Resources ......................................................................................................... 65 About the author..................................................................................................................... 67 Trademarks and special notices ........................................................................................... 68

Page 4: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

1

Abstract Network Data Management Protocol (NDMP) is an open protocol for managing data stored on networked servers. This document provides the best practices guide for implementing IBM SONAS NDMP backup solution using CommVault Simpana. The NDMP future development is under the direction of the Storage Networking Industry Association (SNIA), which has a work group for NDMP.

SONAS NDMP

IBM® Scale Out Network Attached Storage (SONAS) is designed to address the new storage challenges posed by the continuing explosion of data. Leveraging mature technology from IBM’s high-performance computing experience, and based upon IBM General Parallel File System (IBM GPFS™), SONAS is an easy-to-install, turnkey, modular, scale out network-attached storage (NAS) solution that provides the performance, clustered scalability, high availability, and functionality that are essential to meet strategic Petabyte Age and cloud-storage requirements.

The high-density, high-performance SONAS can help organizations consolidate and manage data affordably, reduce crowded floor space, and reduce management expense associated with administering an excessive number of disparate storage systems. With its advanced architecture, SONAS virtualizes and consolidates multiple filers into a single, enterprise-wide file system, which can translate into reduced total cost of ownership (TCO), reduced capital expenditure, and enhanced operational efficiency.

This paper is part of the SONAS Network Data Management Protocol (NDMP) information set and is intended for the System Administrator implementing a backup strategy with CommVault Simpana 9.0. The System Administrator should be familiar with backup and restore operations and with the basic administration of CommVault Simpana 9.0.

Overview of SONAS NDMP NDMP is a network-based protocol used by data management applications primarily for backing up and restoring the files contained within a NAS system such as SONAS. The SONAS support the Network Data Management Protocol (NDMP) version 4.

The SONAS NDMP implementation provides the capability to back up and restores the file systems with the SONAS system using NDMP. The granularity of backup is at the directory level. NDMP supports the concept of a full backup and an incremental backup. A full backup backs up all files and directories specified to be backed by SONAS NDMP. An incremental backup backs up those files and directories that have changed since the last full backup. Incremental backups are cumulative.

A cumulative incremental backup backs up the files that are specified in the backup selections list that have changed since the last full backup. All files are backed up if no previous backup has been done. Cumulative incremental backups occur automatically according to schedule criteria. A complete restore requires the last full backup and the last cumulative incremental backup.

Page 5: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

2

A differential incremental backup backs up the files that have changed since the last successful incremental (differential or cumulative) or full backup. All files are backed up if no previous backup has been done. Differential incremental backups occur automatically according to schedule criteria. A complete restore requires the last full backup, the last cumulative incremental backup, and all differential incremental backups that have occurred since the last full backup.

SONAS NDMP supported physical configuration There are two primary methods in which NDMP can be used as an interface with SONAS.

1. Two-way (or remote) NDMP

2. Three-way NDMP

The following sections describe the two-way (or remote) and three-way NDMP configurations in depth.

Two-way (or remote) SONAS NDMP configuration

The two-way NDMP consists of an external data management application, such as CommVault Simpana, running on a server external to the SONAS system. The data management application has some form of storage hierarchy such as a tape library that it manages for the storage of backup data.

In addition to the external data management application (CommVault Simpana), an Ethernet network exists that connects the data management application to the SONAS interface nodes on which the NDMP server is running. NDMP control and data traffic flow across this network between the external data management application and the SONAS interface nodes on which the NDMP server is running.

The recommendation is that this network be a high speed 10 Gb Ethernet network to handle the volume of data being backed up or restored. However, nothing prevents this network from being a 1 Gb Ethernet network.

The Figure 1 shows an example of a two-way SONAS NDMP configuration. It includes an external data management application (CommVault Simpana) running on a server external to the SONAS system. The data management application has an IBM System Storage® TS7650G ProtecTIER® Deduplication Gateway attached to it through an 8 Gbps Fibre Channel (FC) storage area network (SAN). The System Storage TS7650G ProtecTIER Deduplication Gateway has an IBM System Storage DS5000 storage controller attached to it through 8 Gbps FC links, which in turn has some number of IBM System Storage® DS5020 disk storage expansion units attached to it through 8 Gbps FC links. The data management application connected to a 10 Gbps Ethernet network, to which the SONAS interface nodes are attached. In Figure 1, the lines are intended to show the type and speed on the connections between the various physical components and do not necessarily represent the actual number of physical links.

Page 6: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

3

Figure 1: An example of a two-way SONAS NDMP configuration

Three-way SONAS NDMP configuration

In three-way SONAS NDMP implementation, an NDMP tape server is installed on a server external to the SONAS system and separate from the server on which the CommVault Simpana data management application is running. Some form of storage devices, such as a virtual tape library or real tape library and tape drives are attached to the server running the NDMP tape server.

The NDMP control traffic flows between the CommVault Simpana data management application and the SONAS interface nodes and NDMP data traffic flows between the SONAS interface nodes and the NDMP tape server. In this scenario, as only NDMP control traffic is flowing between the CommVault Simpana data management application and the SONAS interface nodes, the CommVault Simpana data management application does not need to be on a high-speed network. The CommVault Simpana (data management application) can use a lower speed 1 Gbps Ethernet network to connect the SONAS interface nodes and the external server on which the NDMP tape server is running.

However, NDMP data traffic (the actual data being backed up or restored) is flowing between the SONAS interface nodes and the external server on which the NDMP tape server is running. Therefore, it is recommended that the Ethernet network between the NDMP tape server and the SONAS interface nodes running the NDMP server be a high-speed 10 Gbps Ethernet network.

The Figure 2 shows an example of an NDMP three-way configuration. In this example, the SONAS interface nodes (used for file serving) and the data management applications are on a 1 Gbps

Page 7: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

4

Ethernet network. Other SONAS interface nodes, used for NDMP backup and restore, are on a 10 Gbps Ethernet network along with the NDMP tape server. The server on which the NDMP tape server is running is connected to an 8 Gbps FC SAN along with an IBM System Storage TS3500 tape library with some FC attached tape drives, such as IBM Linear Tape-Open data cartridges, Generation 3, Generation 4, or Generation 5 tape drives.

Figure 2: An example of NDMP three-way configuration

Fundamentals of SONAS NDMP feature The following points explain the fundamentals of SONAS NDMP features:

• An NDMP version 4 compliant data server is available on every interface node of the SONAS system. There is a provision to create a set of interface nodes that will be part of an NDMP_NODE_GROUP. These set of interface nodes is paired with network group IP addresses that can be assigned to a specific network port. This network port is associated with the NDMP service.

• The NDMP server running on an interface node provides for both data and control

connections to servers external to the SONAS system on which a data management appliance is running.

Page 8: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

5

• The ability to configure the NDMP parameters for this set of interface nodes (the

NDMP_NODE_GROUP) is provided through SONAS command-line interface (CLI) commands that are run from the management node, which stores the NDMP configuration parameters in the Samba Registry.

• In addition to the SONAS CLI commands available to store and retrieve NDMP configuration parameters, a set of CLI commands are provided that allow to view NDMP session information and NDMP log information, and to stop currently running NDMP sessions.

• An NDMP backup session will provide backup of a specific directory in a GPFS file system

and all files and subdirectories contained within it. Besides the basic data of the files and directories, all extended GPFS attributes are saved for every file and directory. In order to provide the provision to back up a directory structure at a given point in time, a snapshot is used and it is actually the snapshot of the directory structure that is backed up. This snapshot also accounts for files that may be open or in use during the backup as a point in time representation of the file is backed up by NDMP.

• An NDMP restore session will restore all of the files and directories in the proper structure

of subdirectories, and so on. In addition to the actual file contents, the GPFS extended attributes are also restored.

Page 9: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

6

SONAS NDMP command-line configuration

The following SONAS CLI commands (shown in Table 1) are available for configuring, monitoring, and managing the NDMP configuration parameters and NDMP sessions:

Table 1: SONAS CLI command description

ISV LAB SONAS system configuration In the ISV lab:

• The SONAS appliance has one management node: mgmt001st001 • The SONAS appliance has five interface nodes: int001st001, int002st001,

int003st001,int004st001,int005st001 • The SONAS cluster is defined as: st001.vsofs1.com • There is a 10 Gb Ethernet card on each interface node and configured ethX0 to access

the bonded ports

(Refer to “Appendix B: Materials used in the lab setup” for more information)

# SONAS CLI command Is used to

1 cfgndmp Configure NDMP

2 cfgndmpprefetch Configuring NDMP backup prefetch

3 lsndmp List NDMP configuration

4 lsndmplog List the actual contents of the NDMP log on the given interface node

5 lsndmpsession List NDMP session information

6 rmndmpcfg Remove NDMP configuration information for a specified NDMP node group

7 stopndmpsession Stop NDMP session

8 lsndmpprefetch List NDMP prefetch configuration

Page 10: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

7

SONAS NDMP network group configuration This section provides the guidelines to create and configure network group that includes all of the interface nodes that will service NDMP requests for the NDMP node group.

• Create a network group comprising three interface nodes using mknwgroup SONAS CLI command on SONAS management node.

mknwgroup ndmp_nw_group int001st001,int002st001,int003st001

Validate the network group using the lsnwgroup SONAS CLI command on SONAS management node.

Note: If you want to add an interface node to an existing network group, use the chnwgroup command. For example, you could add an interface node named int005st001 to the network group ndmp_group as follows:

chnwgroup ndmp_nw_group --add int005st001

• Create a network with configurable IP addresses using the mknw SONAS CLI command on SONAS management node.

mknw 17.0.0.0/24 0.0.0.0/0:17.0.0.1 --add 17.0.0.100,17.0.0.101, 17.0.0.102, 17.0.0.103

Note: Visit the URL: http://oav.net/mirrors/cidr.html to figure out the Classless Inter-Domain Routing (CIDR). In this case, the team used 23. mknw 17.0.0.0/24…

Validate the newly created network using the lsnw SONAS CLI command on SONAS management node.

• Attach the newly created network group, ndmp_nw_group, to the newly created network using the attachnw SONAS CLI command on SONAS management node.

attachnw 17.0.0.0/24 ethX0 -g ndmp_nw_group

Page 11: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

8

SONAS NDMP node group configuration This section provides appropriate guidelines to create and configure the SONAS NDMP node group.

• A SONAS NDMP configuration can be defined only for an NDMP node group. • A SONAS NDMP node group must be created before any other specific SONAS NDMP node

group configuration parameters can be set. • A SONAS NDMP node group is created, configured, and activated appropriately, before an NDMP

backup or restore can be configured on the CommVault Simpana DMA (Data Management Application) server.

Note: The SONAS NDMP configuration parameters of a single interface node cannot be changed individually.

• Create an NDMP node group using the “--create” option of the “cfgndmp” command on SONAS management node.

cfgndmp -c st001.vsofs1.com ndmp_node_grp1 --create

• Attach the newly configured network group, ndmp_nw_group, refer to “SONAS NDMP network group configuration”, to the newly created SONAS NDMP node group using the cfgndmp SONAS CLI command with the --networkGroup option on the SONAS management node.

cfgndmp -c st001.vsofs1.com ndmp_node_grp1 --networkGroup ndmp_nw_group

• Set the data port range of the NDMP node group using the --dataTransferPortRange option of the cfgndmp command on SONAS management node.

cfgndmp -c st001.vsofs1.com ndmp_node_grp1 --dataTransferPortRange 2048-2098

• Add file system mount point paths to the NDMP node group configuration using the -addPaths option of the cfgndmp command on the SONAS management node.

cfgndmp -c st001.vsofs1.com ndmp_node_grp1 --addPaths /ibm/isvtsm,/ibm/isvvm,/ibm/isvora,/ibm/isv64

• A default NDMP backup prefetch configuration is assigned to a newly created NDMP node group, with the function deactivated. Optionally, use the cfgndmpprefetch CLI command to change the NDMP backup prefetch configuration and activate the function for improved NDMP backup performance. Refer to the “Configuring SONAS NDMP backup prefetch” section for more information.

• Activate the NDMP node group with the –-activate option of the cfgndmp CLI command.

cfgndmp -c st001.vsofs1.com ndmp_node_grp1 --activate

Note: You can use the lsndmp CLI command with the -ndmpServiceStatus option to verify that NDMP has started on all of the nodes in the NDMP node group, on the SONAS management node.

lsndmp -c st001.vsofs1.com [-s] [--ndmpServiceSatus]

Page 12: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

9

Figure 3: An example of lsndmp -s option result

Configuring SONAS NDMP backup prefetch

The NDMP backup prefetch function navigates the directory that is being backed up, reading files in advance to the files actually coming due to be backed up. The prefetch function opens files in read-only mode and places the files in the interface node's cache for improved backup performance.

NDMP backup prefetch is designed to work on files that are less than or equal to 1 MB in size.

Restriction: SONAS NDMP backup prefetch will not work for a file system that has block size that is greater than 1 MB.

• To activate the NDMP backup prefetch feature, use the cfgndmpprefetch CLI command

with the --activate option. Specify the NDMP node group to enable NDMO prefetch feature with SONAS NDMP node group, as in the following example on the SONAS management node.

cfgndmpprefetch -c st001.vsofs1.com ndmp_node_grp1 --activate Note: If NDMP is not active on the specified NDMP node group, a message is displayed indicating that prefetch for NDMP will be activated when NDMP is activated.

• To set a limit for the number of applications that can simultaneously use SONAS NDMP

backup prefetch for a node, (including multiple instances of the same program such as multiple SONAS NDMP sessions) use the cfgndmpprefetch CLI command with the -applimit option, as in the following example on the SONAS management node.

cfgndmpprefetch –c st001.vsofs1.com ndmp_node_grp1 --applimit 4

Note: If NDMP is not active on the specified NDMP node group, a message is displayed indicating that the configuration for Prefetch for NDMP has been updated.

• To set a limit for the number of prefetching threads per interface node, use the

cfgndmpprefetch CLI command with the -numThreads option, as in the following example on the SONAS management node.

cfgndmpprefetch –c st001.vsofs1.com ndmp_node_grp1 --numThreads 100

Note: The value for the --numThreads option must be a positive integer greater than 50 and less than or equal to 180. The default value is 100.

• To display NDMP backup prefetch status information, use the lsndmpprefetch CLI

command using the -s or --status option, and optionally adding the -g option to limit

Page 13: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

10

display to the specified NDMP node group, as in the following example on the SONAS management node

lsndmpprefetch –c st001.vsofs1.com –g ndmp_node_grp1 -s

Page 14: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

11

Concurrent SONAS NDMP backup and restore usage with other SONAS functions

The information in Table 2 helps you identify which SONAS features and functions may be currently used on the same SONAS system and on the same set of SONAS interface nodes.

Anti-virus scanning

Asynchronous replication

HSM processing

NDMP backup and

restore

IBM Tivoli Storage Manager

backup and restore

Anti-virus scanning

N/A Same system: Yes Same interface nodes: Yes

Same system: Yes Same interface nodes: Yes Refer Note 3

Same system: Yes Same interface nodes: Yes

Same system: Yes Same interface nodes: Yes

Asynchronous replication

Same system: Yes Same Interface Nodes: Yes

N/A Same system: Yes Same interface nodes: Yes Refer Note 2

Same system: Yes Same interface nodes: Yes

Same system: Yes Same interface nodes: Yes

HSM processing

Same system: Yes Same interface nodes: Yes Refer Note 3

Same system: Yes Same interface Nodes: Yes Refer Note 2

N/A Same system: No Same interface nodes: No

Same system: Yes Same interface nodes: Yes

NDMP backup and restore

Same system: Yes Same interface nodes: Yes

Same system: Yes Same interface nodes: Yes

Same system: No Same interface nodes: No

N/A Same system: No Same interface nodes: No Refer Note 1

Tivoli Storage Manager

backup and restore

Same system: Yes Same interface nodes: Yes

Same system: Yes Same interface nodes: Yes

Same system: Yes Same interface nodes: Yes

Same system: No Same interface nodes: No Refer Note 1

N/A

Table 2: Concurrent SONAS NDMP backup and restore usage with other SONAS functions

Notes:

1. IBM Tivoli® Storage Manager backup / restore and NDMP backup / restore provide the same basic functionality of backing up or restoring file systems and the directories and files within the file systems. It is not recommended and not supported to have both Tivoli Storage Manager backup restore processing and NDMP backup restore processing being used on the same SONAS system.

2. NDMP backup are normally scheduled operations, which can be scheduled at a time when other activity, such as general purpose file serving, is low. If possible, it is recommend performing

Page 15: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

12

NDMP backup during periods when other file serving activity is generally lower, perhaps late in the evening or early in the mornings.

3. In case, the NDMP backup or restore processing significantly interferes with other SONAS functions, such as network file serving (CIFS, NFS, FTP, HTTP) then please consider increasing the processing power and memory configuration of the SONAS interface nodes or should consider isolating NDMP processing to dedicated SONAS interface nodes. Many SONAS functions invoke the GPFS policy engine to evaluate a GPFS policy to determine the list of files to operate on. These include:

• Tivoli Storage Manager backup processing • Tivoli Storage Manager hierarchical storage management (HSM) processing • NDMP incremental backup processing • Asynchronous replication processing • The runpolicy CLI command and others

The GPFS policy engine scans the file system metadata to determine which files match the criteria specified in the policy. This scan of the file system metadata can generate a significant amount of I/O to the storage systems to read all the file system metadata, especially for file systems containing very large number of files, such as 10s or 100s of millions of files. Therefore, it is recommended that all of these functions not be started at exactly the same time, but instead these SONAS functions be staggered over time.

You need to take care of the following considerations for CommVault Simpana 9.0 DMA SONAS NDMP backup • Obtain either the IP address or host name for the interface node to be used for this NDMP

session. − Host Name: Configure a DNS server with a common hostname mapped to all of the IP

addresses that are associated with the network group that is associated with the NDMP node group. If this hostname is used, any of the interface nodes that are associated with the NDMP node group can be assigned based on a round robin IP address assignment from the DNS server.

− IP address: Submit the lsnwinterface CLI command using the -x option on the management node of the SONAS system and choose an IP address, or multiple IP addresses if multiple backup policies are to be run simultaneously. This method is useful if multiple NDMP backup policies are used and you want to distribute the NDMP workload across multiple interface nodes and ensure that the same interface node will not be used for all of the backup policies that will be run from the DMA server.

• Configure the CommVault Simpana 9.0 DMA server with the configuration parameters of the NDMP server for the interface nodes that are available to perform NDMP services, including the username and password associated with the NDMP node group. If a port other than 10000 was selected for the NDMP control port, then that control port's information needs to be configured on the DMA server.

Page 16: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

13

Monitoring NDMP session on SONAS system

Note: Read this information after configuring CommVault Simpana NDMP configuration and staging appropriate SONAS NDMP backup or restore. Refer to the “CommVault Simpana NDMP configuration” section for more information

• The lsndmpsession CLI command enables to monitor NDMP session on SONAS system. Use -n or -nodes option to view NDMP sessions running on specified interface nodes or with the -g or --nodeGroupName option to view NDMP sessions running on specified NDMP node groups.

Only interface nodes can be specified when using the -n or --nodes option. Multiple nodes and multiple node groups in a list must be separated with commas. If no nodes or node groups are specified, the output displays information for all of the interface nodes in the cluster. To determine which interface nodes are running NDMP sessions for an NDMP node group, submit the following command that shows which interface nodes have NDMP sessions running and which sessions are running on the nodes:

lsndmpsession –c st001.vsofs1.com -n int005st001

Or

lsndmpsession –c st001.vsofs1.com –g ndmp_node_grp1

Figure 4: An example of lsndmpsession CLI command usage

• Use the SONAS CLI lsndmpsession command with the -i or --sessionID option to view the verbose information of the NDMP session identified by the specified session id (sid) running on the specified interface node. In the following example, the sid 1284990 is specified. Use the SONAS CLI lsndmpsession command with the -i or --sessionID option to view the verbose information of the NDMP session identified by the specified session id (sid) running on the specified interface node.

lsndmpsession –c st001.vsofs1.com -n int005st001 -i 1284990

Figure 5: An example of lsndmpsession CLI command usage with -i option

Page 17: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

14

Monitoring NDMP log information on SONAS system

You can view SONAS NDMP log using the lsndmplog CLI command.

• Use the SONAS CLI lsndmplog command with the -n or --nodes option to view all of the NDMP log information related to the specified interface node. In the following example, the node int005st001 is specified:

lsndmplog -c st001.vsofs1.com -n int005st001

• Use the SONAS CLI lsndmplog command with the -l or --lines option to view the most

recent lines of the NDMP log information related to the specified interface node. In the following example, the node int005st001 and 25 lines are specified: lsndmplog -c st001.vsofs1.com -n int005st001 -l 25

• Use the SONAS CLI lsndmplog command with the -o or --outputLogFilePath option to

save the log file as a temporary file, as in the following example: lsndmplog -c st001.vsofs1.com -n int001st001 -o /ibm/gpfs0/ndmplog.out

Page 18: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

15

CommVault Simpana 9.0 NDMP configuration The CommVault Simpana 9.0 enables to use the NDMP to initiate and control backups and restores of NAS systems.

CommVault Simpana 9.0 NDMP specific software deployment

The following CommVault Simpana 9.0 NAS iDataAgent software required to install in the data management application system.

Essential components:

• MediaAgent – for complete information, refer to Media Agent deployment at http://documentation.commvault.com/commvault/release_9_0_0/books_online_1/english_us/deployment/deployment.htm?var1=http://documentation.commvault.com/commvault/release_9_0_0/books_online_1/english_us/deployment/mediaagent.htm

• Microsoft® Windows® File System iDataAgent – Required when using a Windows Media agent. For complete information, refer to Deployment - Windows File System iDataAgent at the URL: http://documentation.commvault.com/commvault/release_9_0_0/books_online_1/english_us/deployment/deployment.htm?var1=http://documentation.commvault.com/commvault/release_9_0_0/books_online_1/english_us/deployment/windows.htm (For UNIX® MediaAgent, the File System iDataAgent is not required.)

Additional components:

• NRS install - Installing the NDMP remote server software is required, if the tape library is attached to the MediaAgent. Refer to Install the NDMP Remote Server (NRS) - Unix at the URL: http://documentation.commvault.com/commvault/release_9_0_0/books_online_1/english_us/deployment/install/ndmp_remote_server_unix.htm for step-by-step instructions on installing NDMP remote server software on Unix system. Note: On Unix, The NDMP Remote Server (NRS) is a separate installation from the MediaAgent. The NDMP Remote Server (NRS) installation can be performed at the same time as the MediaAgent on a Windows system.

Page 19: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

16

Launching CommVault Simpana 9.0 CommCell console on a Microsoft Windows To launch CommVault Simpana 9.0 CommCell console as a stand-allone application on a Microsoft Windows:

1. Launch the CommCell Console from the Start Programs menu, or by clicking the CommCell Console icon on your desktop.

2. Enter the user name, password and the name of the CommCell you wish to connect and click OK to continue.

Launching CommVault Simpana 9.0 CommCell console

To launch CommVault Simpana 9.0 CommCell console as a stand-alone application on a Linux® RHEL computer:

4. Login to RHEL GNOME (GUI) using root access authentication 5. Launch the terminal and type console and press Enter. 6. Provide the appropriate CommServ user credential and password to launch the CommCell stand-

alone browser. (Refer to Figure 6 and Figure 7).

Figure 6: CommCell authentication

Page 20: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

17

Figure 7: CommCell GUI console

SONAS NDMP configuration on CommVault Simpana 9.0 This section describes SONAS NDMP configuration with CommVault Simpana 9.0 in detail.

Tape library and drive configuration

To configure tape library double click the Library and Drive Configuration icon from the Control Panel of CommCell GUI.

Figure 8:CommCell Control Panel

Page 21: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

18

Two-way (or remote) SONAS NDMP library and drive configuration

To configure a two-way (or remote) SONAS NDMP library and drive:

1. Select the appropriate MediaAgent from the Available MediaAgents list box, click Add, and then click OK to continue. (Refer to Figure 9).

Figure 9: Select MediaAgents dialog box

2. The Library and Drive Configuration tool, as shown in Figure 10 is displayed

Figure 10: The Library and Drive Configuration tool

Page 22: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

19

3. Click Start and select Detect/Configure Devices to launch the Detect Library dialog box,

as shown in 4. Select SCSI Devices for the libraries attached to the SCSI or FC adapter and click OK to

continue.

Figure 11: Detect Library dialog box

5. The Library and Disk Configuration tool initates the process to identify the connected tape libraries, as shown in Figure 12. After tape library configuration, click View Log for details

Figure 12: The Library and Disk Configuration tool in process

Page 23: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

20

6. The Library and Disk Configuration tool provides the log information for the detected tape

library, as shown in Figure 13

Figure 13: Log information for the detected tape library

7. The Library and Disk Configuration tool provides the display with detected tape libraries, as shown in Figure 14.

Figure 14: The Library and Drive Configuration tool displaying the detected tape libraries

Page 24: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

21

8. Right-click the detected tape library and click Configure to configure the tape library, as

shown in Figure 15

Figure 15: configuring a selected tape drive

9. In the Configuration dialog box, select the Library and all drives option and click OK (as

shown in Figure 16) to configure the tape library and the drives.

Figure 16: Specifying the options to configure the tape library and the drive

10. Select an appropriate media type and click Yes to continue, as shown in Figure 17

Figure 17: Discover Media Options dialog box

Page 25: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

22

11. Notice that the Library and Drive Configuration tool displays the configured tape library and

drives, as shown in

Figure 18: The Library and Drive Configuration tool displaying the configured tape library and drives

Page 26: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

23

Three-way SONAS NDMP library and drive configuration

Perform the following steps for SONAS three-way NDMP tape server authentication and tape configuration on CommVault Simpana 9.0

To configure a three-way SONAS NDMP library and drive:

1. Select the appropriate MediaAgent from the Available MediaAgents list box and click Add. Then click OK to continue, as shown in Figure 19

Figure 19: Select MediaAgents dialog box

Page 27: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

24

2. The Library and Configuration tool will be launched. Click Start and select Detect/Configure

Devices to launch the Detect Library dialog box, as shown in Figure 20.

Figure 20: The Library and Drive Configuration tool

3. In the Detect Library dialog box, select NDMP Devices, select the appropriate MediaAgent, and click OK to continue, as shown in Figure 21

Figure 21: Specifying the options in the Detect Library dialog box

Page 28: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

25

4. Click Update NDMP Host List and click the Update NDMP Host List button, as shown in

Figure 22.

Figure 22: Updating the NDMP host list

5. In the NDMP Server List dialog box, click Add to provide the SONAS NDMP tape server IP address information, as shown in

Figure 23: The NDMP Server List dialog box

Page 29: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

26

6. In the Add NDMP Server dialog box, provide the SONAS NDMP tape server IP address and

SONAS NDMP credentials and click OK to continue, as shown in Figure 24.

Figure 24: Providing the SONAS NDMP tap server IP address information

Note: By default, the SONAS NDMP login ID is ndmp and NDMP password is ndmp.

7. In the NDMP Server List dialog box, click Close to continue, as shown in Figure 25.

Figure 25: NDMP Server List dialog box displaying the recently added IP address

Page 30: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

27

8. Select the SONAS NDMP tape server from the Available NDMP Servers list box and click Add.

Then click OK to continue, as shown in Figure 26.

Figure 26: Selecting NDMP tape server

9. In the NDMP tape server library configuration confirmation message box, click Yes to continue

(as shown in Figure 27 ) after NDMP tape server is configured, click View Log for details.

Figure 27: The Library and Disk Configuration tool in process

Page 31: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

28

10. The Library and Disk Configuration tool provides the log information for the detected tape library

of the NDMP tape server, as shown in Figure 28.

Figure 28: Log information of the detected tape library of the NDMP tape server

Page 32: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

29

11. Right-click the detected tape library of the NDMP tape server and click Configure (as shown in

Figure 29) to configure the tape library of the NDMP tape server.

Figure 29: Configuring the tape library of the NDMP tape server

12. Select the Library and all drives option and click OK (as shown in Figure 308) to configure the tape library and the drives for the NDMP tape server.

Figure 30: Setting the configuration options

Page 33: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

30

13. In the Discover Media Options dialog box, select an appropriate media type and click Yes to

continue, as shown in Figure 31

Figure 31: Specifying the media type

14. The Library and Drive Configuration tool displays the configured tape library and drives of the NDMP tape server, as shown in Figure 32.

Figure 32: The Library and Drive Configuration tool displaying the configured tape library and drives

Page 34: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

31

Creating CommVault Simpana 9.0 storage policy

To create CommVault Simpana 9.0 storage policy:

1. Launch CommVault Simpana 9.0 CommCell. 2. In the CommCell browser, right-click the Storage Policies node and click New Storage Policy.

Figure 33: Creating a new storage policy

3. In the Create Storage Policy wizard, click Next to continue.

Figure 34: Create Storage Policy Wizard

Page 35: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

32

7. Select Data Protection and Archiving as the storage policy type and click Next to continue.

Figure 35: Selecting the storage policy type

8. Designate storage policy for legal hold. Select Yes or No.

Figure 36: Designating the storage policy for legal hold

Note: This is only applicable for Backup and Compliance Archiver storage policies. Legal Hold designation status cannot be changed at a later time.

Page 36: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

33

9. Provide an appropriate storage policy name and click Next to continue.

Figure 37: Providing a name for the storage policy

10. Provide an appropriate primary copy name and click Next to continue.

Figure 38: Specifying a name for the primary copy

Page 37: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

34

11. Select the appropriate tape library from the drop-down list, and click Next to continue.

Figure 39: Specifying the default library for the primary copy

12. Associate default MediaAgent and drive pool for the primary copy.

Figure 40: Associating the default MediaAgent and drive pool for the primary copy

Page 38: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

35

13. Select the appropriate scratch pool and click Next to continue.

Figure 41: Selecting the scratch pool

14. Configure the device stream and iDataAgent backup retention policies and click Next to continue.

Figure 42: Configuring the device stream and iDataAgent backup retention policies

Page 39: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

36

15. Select the Hardware Compression check box for storage policy and click Next to continue.

Figure 43: Enabling hardware compression for the storage policy copy

16. Review the storage policy configurations and click Finish to exit and create storage policy.

Figure 44: Confirming the selected attributes

Page 40: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

37

17. Notice the newly created storage policy under the Storage Polices node in the CommCell browser.

Figure 45: Storage Policies node displaying the newly-created storage policy

Page 41: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

38

Creating CommVault Simpana 9.0 storage policy for three-way SONAS NDMP: Considerations

Select an appropriate NDMP tape server configured tape library when creating SONAS NDMP three-way specific storage policy as shown in Figure 46.

Figure 46: Creating CommVault Simpana 9.0 storage policy for three-way SONAS NDMP

Page 42: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

39

Adding CommVault Simpana 9.0 client for SONAS NDMP

To add CommVault Simpana 9.0 client for SONAS NDMP:

1. From SONAS system, validate the network configuration of the interface nodes using the lsnwinterface SONAS CLI command with the --extended or -x option.

Figure 47: lsnwinterface SONAS CLI command usage

2. In the CommCell browser, right-click the Client Computers node and click New Client.

Figure 48: Creating a new client

Page 43: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

40

3. From the Select Client drop-down list, select NAS Client click OK to continue.

Figure 49: Add New Client dialog box

4. Provide appropriate SONAS NDMP interface node IP address and SONAS NDMP credentials. Then click Detect to validate the SONAS NDMP server and then click OK to continue.

Note: By default, the SONAS NDMP login ID is ndmp and password is ndmp.

Figure 50: Adding the NDMP interface node IP address

Page 44: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

41

5. Notice that the SONAS NDMP server client is added to CommCell browser.

Figure 51: verifying the SONAS NDMP server client added to the CommCell browser.

Page 45: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

42

Creating a new subclient for the newly-created CommVault Simpana 9.0 SONAS NDMP client

The SONAS system consists of many file systems. In order to backup specific SONAS system file system, you need to create subclient to point specific SONAS file system to perform NDMP backup.

Figure 52: SONAS file system mapping with CommVault Simpana subclient

To create a new subclient:

1. In the newly-created SONAS NDMP client within the CommCell browser, right-click the DefaultbackupSet node and click All Tasks New Subclient to continue.

Figure 53: Creating a new subclient

Page 46: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

43

2. On the General tab, provide an appropriate name for the new subclient.

Figure 54: Specifying a name for the new subclient

Page 47: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

44

3. On the Content tab, select the specific SONAS file system directory to backup and click Add.

Figure 55: Specifying the SONAS file system directory for backup

Page 48: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

45

4. On the Storage Device tab, associate the appropriate storage policy. Please refer to section

Creating CommVault Simpana 9.0 storage policy for more information.

Figure 56: The Storage Device tab

Page 49: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

46

6. On the Deduplication subtab, select the Enable Deduplication check box, in order to enable the

deduplication feature during NDMP backup and click OK to continue.

Figure 57: Enabling deduplication

Page 50: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

47

7. On the Backup Schedule dialog box, select an appropriate backup schedule option. In this

example, the Do Not Schedule option is selected. Click OK to create a new subclient.

Figure 58: Backup Schedule dialog box

SONAS NDMP backup using CommVault Simpana 9.0 NDMP essentials This section illustrates SONAS NDMP essential backup details and how to configure the SONAS NDMP differential and incremental backup with CommVault Simpana 9.0

Types of CommVault Simpana 9.0 backup

The different types of CommVault Simpana 9.0 backup are:

• Full backup: A full backup contains all the data that comprises a subclient's contents. You can also perform a backup at the backup-set or instance-level, and apply to all of the subclients within the selected backup set or instance.

• Incremental backup: An incremental backup contains only data that is new or has changed since the last backup, regardless of the type. On an average, incremental backup consume far less media and place, less of a burden on resources, than full backup.

• Differential backup: A differential backup contains only the data that is new or has changed since the last full backup. Similar to incremental backup, differential backups, on an average, consume less media and place, less of a burden on resources, than full backup.

Page 51: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

48

Initiating CommVault Simpana 9.0 full SONAS NDMP backup

To initiate CommVault Simpana 9.0 full SONAS NDMP backup:

1. In the CommCell browser, right-click the newly-created subclient and select Backup to continue.

Figure 59: Creating a full SONAS NDMP backup

Page 52: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

49

2. In the Select Backup Type section, select Full and in the Job Initiation section select Immediate.

Then click Advanced.

Figure 60: Specifying the backup options

Page 53: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

50

3. On the Data Path tab select the correct MediaAgent, library, drive pool, and drive and click OK to

continue as shown in Figure 62

Figure 61: Specifying advanced backup options

4. Track the progress of the backup job from the Job Controller window. For the stand-alone drive, you are prompted to load a specific cartridge into the drive. If you are using a library, you will not receive this prompt. The system loads the tapes automatically and therefore the cartridges need to be appropriately labeled. This enables to locate the correct cartridge for a restore job, if necessary.

5. When the backup is complete, the Job Controller displays the text Completed. After running a backup, view the backup history to verify the backup data.

Page 54: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

51

The CommVault Simpana 9.0 incremental / differential SONAS NDMP backup considerations

There are specific SONAS NDMP environment variables, which are treated as parameters and can be passed to the NDMP server from data management applications performing NDMP backups. The following two parameters can be configured through data management applications.

• BACKUP_GROUP_NAME: This is the name of a backup group where all the backup directories within the backup group share the same SONAS snapshot.

− NOTE 1: The way to set this environment variable is to have a line similar to the following

in the backup policy: SET BACKUP_GROUP_NAME=NDMP_EXISTING_snap1

− NOTE 2: If the BACKUP_GROUP_NAME begins with NDMP_EXISTING then it is

assumed that the SONAS system configured to use a snapshot, which has a name corresponding to this environment variable value. In this special case, it is also assumed that the user will delete the corresponding snapshot manually.

− NOTE 3: The maximum length of the backup group name is 32 characters (inclusive of a

possible NDMP_EXISTING).

• BACKUP_GROUP_EXPIRATION: This parameter helps to configure the amount of valid time that the snapshot is associated with BACKUP_GROUP_NAME. After the age of the snapshot has surpassed the expiration value, a new snapshot will be taken and all new NDMP backup sessions associated with BACKUP_GROUP_NAME will use the new snapshot. This SONAS NDMP parameter is very important to effectively schedule incremental or differential backup which has less than 1 hour incremental and differential backup expiration schedule time.

− NOTE 1: The way to set this environment variables is to have a line similar to the following

line in the backup policy: SET BACKUP_GROUP_EXPIRATION = 1_DAY

− NOTE 2: The following values are acceptable for this environment variable:

• 0_SEC … 60_SEC • 0_MIN … 60_MIN • 0_HOUR … 168_HOUR • 0_ DAY … 31_DAY • 0_MONTH … 12_MONTH

− NOTE 3: If no value is given for the expiration, the default will be 1 hour. − NOTE 4: If the user wants to ensure that a separate snapshot is taken for every directory,

then an expiration value of 0_SEC should be specified.

Page 55: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

52

Initiating CommVault Simpana 9.0 incremental / differential SONAS NDMP backup Please download and install specific CommVault Simpana patch to configure NDMP incremental backup configuration parameters at: https://services.commvault.com/mainadv.asp?reason=denied_empty&script_name=/mainadv/index.asp&path_info=/mainadv/index.asp

Perform the following steps to initiate CommVault Simpana 9.0 incremental / differential SONAS NDMP backup.

1. In the CommCell browser, right-click the newly-created subclient and click Backup.

2. In the Select Backup Type section, select either Incremental or Differential (as shown in Figure 63 and Figure 64) and click Advanced.

Figure 62: Specifying Incremental as the backup option

Page 56: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

53

Figure 63: Specifying Differential as the backup option

3. On Data Path tab select the correct MediaAgent, library, drive pool, and drive

Page 57: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

54

4. On NAS Option tab, provide the appropriate SONAS NDMP incremental or differential parameters as shown in the Figure 64

Figure 64:Specifying advanced backup options

4. Track the progress of the backup job from the Job Controller window.

5. When the backup is complete, the Job Controller displays the status as Completed. After running a backup, view the backup history to verify the backup data.

Scheduling CommVault Simpana 9.0 SONAS NDMP backup

Perform the following steps to schedule a CommVault Simpana 9.0 SONAS NDMP backup.

1. In the CommCell browser, right-click the newly-created subclient and select Backup.

2. In the Select Backup Type section, select appropriate backup type (show in Figure 63) and from the Job Initiation section, select Schedule, and click Configure.

Page 58: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

55

Figure 65: Scheduling SONAS NDMP backup

Page 59: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

56

3. In the Schedule Details dialog box, provide an appropriate schedule name and configure the

NDMP backup schedule. Click OK to continue.

Figure 66: CommVault backup schedule dialog box

The SONAS NDMP backup operation will run according to the specified schedule configuration.

Viewing CommVault Simpana 9.0 NDMP backup history

Perform the following steps to view the CommVault Simpana 9.0 NDMP backup history.

1. In the CommCell browser, right-click the entity (client computer, iDataAgent, backup set, or subclient) whose backup history you want to view, and click View Backup History.

Figure 67: Viewing the backup history

Page 60: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

57

2. In the Backup History filter dialog box, select the filter options you want to apply and click OK.

Figure 68: Selecting the filter options

Page 61: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

58

3. View the backup job history information that is displayed in CommVault Simpana 9.0.

Figure 69: Backup job history information

SONAS NDMP restore using CommVault Simpana 9.0

Using CommVault Simpana 9.0, you can restore NDMP backup data to SONAS system, on both two-way SONAS NDMP and three-way SONAS NDMP configurations.

Direct Access Restore

Direct Access Restore optimizes the restore operation by allowing the NDMP client to directly access backed up data anywhere in a tape set without having to traverse the tape set sequentially. In a normal restore operation, a large portion of the data from the backup that included the file must be read. In a Direct Access Restore, only the portion of the tape which contains the data to be restored is read. This option is available for each of the SONAS NDMP restore types and can save significant time in the restore operation.

When to use Direct Access Restore

While each environment is different, with many variables that can affect restore efficiency (making it impossible to define when a Direct Access Restore can yield best performance), the following guidelines might be of assistance until you can evaluate the speed appropriately in a specific environment:

• Generally, the smaller the percentage of a given backup that are restoring, the greater will be the performance value of using Direct Access Restore. As the percentage rises above 30 to 40 percent, a non-Direct Access Restore becomes the preferred choice.

• A three-way restore involves more communication overhead between the library and the SONAS system being restored, and thus sequentially reading the tape becomes the more efficient choice sooner. Because of this, you may find that a non-Direct Access Restore is the preferred choice even when the percentage of a given backup being restored is under 30 percent.

Efficient non-Direct Access Restore

Even if you are not using direct access restores, it is still possible to optimize restore performance. For instance, if the most-recent copy of the data that you want to restore was backed up by an incremental or differential backup, the restore only reads the archive file from that differential or incremental backup, instead of reading the archive files back to the last full backup.

Page 62: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

59

Browse and restore SONAS NDMP backup with CommVault Simpana 9.0 Perform the following steps to browse and restore SONAS NDMP backup with CommVault Simpana 9.0.

1. In the CommCell browser, right-click the subclient to restore from and click Browse Backup Data.

Figure 70: Browsing backup data

2. In the Browse Options dialog box, select the Browse the Latest Data option, and from the Use MediaAgent drop-down menu, select the appropriate MediaAgent, and click OK.

Figure 71: The Browse Options dialog box

Page 63: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

60

3. Browse and select the appropriate files or an entire file set depending on the dataset to restore

and click Recover All Selected. .

Figure 72: Recovering selected data

4. Select the Use Direct Access Restore and Restore to Same folder check boxes.

Figure 73: Setting the restore options

5. From the agent's Restore Options and Advanced Restore Options dialog boxes, select the restore options to use. For agents with multiple tabs, do not click OK until you have specified the

Page 64: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

61

necessary options on all the tabs. If you accept all the default settings, you will be restoring the selected data to its original location.

6. After completing the restore selections, you can either start an immediate restore or schedule the restore. a. If you want to schedule the job, in the Restore Options dialog box, click the Job Initiation tab,

click Schedule, schedule the job, and then click OK. b. If you want to run the job now, click Run Immediately in the same tab and then click OK.

Note: While the job is running, you can right-click the job in Job Controller and click Detail to view information on the job. After the data has been restored, you will see a job completion message in Job Controller and Event Viewer.

7. Validate the SONAS file system to make sure the selected files have been correctly restored.

Page 65: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

62

Summary

SONAS is designed to address the new storage challenges posed by the continuing explosion of data. Leveraging mature technology from IBM high performance computing experience and based upon IBM GPFS, SONAS is an easy-to-install, turnkey, modular, scale out NAS solution that provides performance, clustered scalability, high availability and functionality that are essential to meet strategic Petabyte Age and cloud-storage requirements.

The high-density, high-performance SONAS can help organizations consolidate and manage data affordably, reduce crowded floor space, and reduce management expense associated with administering an excessive number of disparate storage systems. With its advanced architecture, SONAS virtualizes and consolidates multiple filers into a single, enterprise-wide file system, which can translate into reduced total cost of ownership, reduced capital expenditure and enhanced operational efficiency.

The SONAS has incorporated the NDMP technology and support the NDMP protocol version 4. Leveraging CommVault Simpana NDMP backup support, the SONAS data files can seamlessly backup to the tape devices and perform restore from the tape device.

This technical content is intended to be a reference guide for users who want to use CommVault Simpana for backing up files using NDMP protocol that are created on SONAS. It is not meant to be an implementation or solution guide. For details on actual implementation or solution design, see the documentation provided in the “Resources” section of this technical paper.

Page 66: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

63

Appendix A: Glossary

• IBM Scale Out Network Attached Storage (SONAS) - Build on IBM’s high-performance computing experience, and based upon IBM General Parallel File System (GPFS), scale out network-attached storage (NAS) solution that provides the performance, clustered scalability, high availability, and functionality that are essential to meet strategic Petabyte Age and cloud-storage requirements.

• Network Data Management Protocol (NDMP) - An industry standard protocol created to

ease the process of integrating backup and restore for NAS with data protection software such as NetBackup. The NDMP is the data transfer protocol and one piece of the overall data protection solution. For more information about the NDMP protocol and the NDMP standards group visit http://www.ndmp.org/info/faq.shtml.

• Two-way (or remote) SONAS NDMP - NDMP configuration supported by SONAS. The

two-way NDMP consists of an external data management application, such as CommVault Simpana, running on a server external to the SONAS system. The data management application has some form of storage hierarchy such as a tape library that it manages for the storage of backup data.

• Three-way SONAS NDMP - NDMP configuration supported by SONAS. NDMP

configuration supported by SONAS. In a three-way SONAS NDMP configuration, an NDMP tape server is installed on a server external to the SONAS system and separate from the system where CommVault Simpana data management application is running.

• CommVault Simpana - NDMP Data Management Application used to backup SONAS

data, using SONAS NDMP technology. • Direct access recovery (DAR) - CommVault Simpana uses DAR to restore a directory or

individual files from a backup image. DAR can greatly reduce the time it takes to restore files and directories. DAR is enabled by default (no configuration is required).

Page 67: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

64

Appendix B: Materials used in the lab setup Infrastructure component Vendor Quantity Details

DMA server IBM 1 IBM x3650 M3

Storage IBM IBM SONAS

Management node – 1

Interface nodes – 5

Storage nodes – 2

Nearline SAS and SAS drives

Network adapter (interface nodes)

Broadcom 2 Broadcom NetXtreme II BCM 5709 1000Base-T

Network adapter (DMA server)

Broadcom 2 Broadcom NetXtreme II BCM 5709 1000Base-T

Switch (DMA server back-end SAN)

IBM 1 IBM Switch Model 2498-B24

For more information, refer to IBM System Storage SAN24B-4 Express Switch at ibm.com/systems/storage/san/b-type/san24b-4/express/specifications.html

HBA QLogic 2 QLogic QLA 2432

Tape Library IBM 2 IBM TS3200 Tape Library Express Model

For more information, visit ibm.com/systems/storage/tape/ts3200/index.html

Software

IBM SONAS 1.2.0.0

IBM SONAS NDMP version 4

CommVault CommVault Simpana 9.0

Page 68: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

65

Appendix C: Resources These websites provide useful references to supplement the information contained in this paper:

• IBM Systems on PartnerWorld ibm.com/partnerworld/systems

• IBM Redbooks®

ibm.com/redbooks • IBM Publications Center

www.elink.ibmlink.ibm.com/public/applications/publications/cgibin/pbi.cgi?CTY=US

• IBM SONAS on IBM PartnerWorld® ibm.com/partnerworld/systems/sonas

IBM SONAS documentation

• IBM Scale Out Network Attached Storage Concepts ibm.com/redbooks/redpieces/abstracts/sg247874.html?Open

• IBM SONAS Introduction and Planning Guide (GA32-0716): http://publib.boulder.ibm.com/infocenter/sonasic/sonas1ic/topic/com.ibm.sonas.doc/sonas_ipg.pdf

• IBM SONAS administration and user documentation: http://publib.boulder.ibm.com/infocenter/sonasic/sonas1ic/index.jsp

• IBM Scale Out Network Attached Storage Administrator's Guide (GA32-0713): http://publib.boulder.ibm.com/infocenter/sonasic/sonas1ic/topic/com.ibm.sonas.doc/sonas_admin_guide.pdf

• IBM SONAS User's Guide (GA32-0714):

http://publib.boulder.ibm.com/infocenter/sonasic/sonas1ic/topic/com.ibm.sonas.doc/sonas_user_guide.pdf

• IBM SONAS Configuration Guide (GA32-0718):

http://publib.boulder.ibm.com/infocenter/sonasic/sonas1ic/topic/com.ibm.sonas.doc/configuration_guide.pdf

• IBM SONAS Troubleshooting Guide (GA32-0717): http://publib.boulder.ibm.com/infocenter/sonasic/sonas1ic/topic/com.ibm.sonas.doc/sonas_pd_guide.pdf

Page 69: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

66

CommVault Simpana 9.0 documentation

• Getting Started - NAS NDMP iDataAgent: http://documentation.commvault.com/commvault/release_9_0_0/books_online_1/english_us/prod_info/nas_ndmp.htm

Page 70: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

67

About the author Udayasuryan Kodoly is a Storage Technology Specialist in IBM Systems and Technology Group (ISV Enablement) Organization. Uday has more than 10 years of experience on designing, architecting, and developing solution best practices on various NAS and SAN appliance data protection (backup) solutions. Uday also has expertise on various virtualization technologies such as (VMware, Hyper-V, KVM (Kernel-based Virtual Machine) and the virtual machine data protection strategies. Presently, Uday is working on enabling various ISV backup, disaster recovery, and virtualization solutions for IBM SONAS.

You can reach Uday at [email protected].

Page 71: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

68

Trademarks and special notices

© Copyright IBM Corporation 2011. All rights Reserved.

References in this document to IBM products or services do not imply that IBM intends to make them available in every country.

IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml.

Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.

Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.

Intel, Intel Inside (logos), MMX, and Pentium are trademarks of Intel Corporation in the United States, other countries, or both.

UNIX is a registered trademark of The Open Group in the United States and other countries.

Linux is a trademark of Linus Torvalds in the United States, other countries, or both.

SET and the SET Logo are trademarks owned by SET Secure Electronic Transaction LLC.

Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries.

Other company, product, or service names may be trademarks or service marks of others.

Information is provided "AS IS" without warranty of any kind.

All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.

Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the supplier of those products.

All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Contact your local IBM office or IBM authorized reseller for the full text of the specific Statement of Direction.

Page 72: Implementing an NDMP backup solution using CommVault Simpana 9.0

Implementing an NDMP backup solution using CommVault Simpana 9.0 on IBM SONAS © Copyright IBM Corporation, 2011.

69

Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here.

Photographs shown are of engineering prototypes. Changes may be incorporated in production models.

Any references in this information to non-IBM websites are provided for convenience only and do not in any manner serve as an endorsement of those websites. The materials at those websites are not part of the materials for this IBM product and use of those websites is at your own risk.