implementing ibm protectier deduplication with symantec

Implementing IBM ProtecTIER deduplication with Symantec

NetBackup OpenStorage

Technical report

IBM Systems and Technology Group March 2012

© Copyright IBM Corporation, 2012

© Copyright IBM Corporation, 2012

Abstract............................................................................................................................3 Introduction .....................................................................................................................3

Intended audience ...................................................................................................................... 3 Scope.......................................................................................................................................... 3

Prerequisites ...................................................................................................................4 IBM System Storage ProtecTIER (TS7600) ...................................................................4

Overview ..................................................................................................................................... 4 ProtecTIER models..................................................................................................................... 4

TS7650G ProtecTIER Deduplication Gateway................................................................... 5 Notes:.................................................................................................................................. 5 TS7650 ProtecTIER Deduplication Appliance .................................................................... 6 TS7610 ProtecTIER Deduplication SMB Appliance ........................................................... 6

ProtecTIER service modes ......................................................................................................... 7 Virtual-tape library (VTL)..................................................................................................... 7 OpenStorage (OST)............................................................................................................ 7

ProtecTIER Manager .................................................................................................................. 8 ProtecTIER Replication Manager ............................................................................................... 9

Symantec NetBackup ...................................................................................................10 Overview ................................................................................................................................... 10 OpenStorage operating environment........................................................................................ 11

The storage server ............................................................................................................ 11 The logical-storage unit..................................................................................................... 11 The Plug-in........................................................................................................................ 11

Configuring ProtecTIER to work with the OpenStorage environment .....................12 Configuring a storage server (STS) .......................................................................................... 12

Adding the storage server................................................................................................. 12 Modifying storage-server credentials ................................................................................ 14

Configuring a logical-storage unit (LSU)................................................................................... 15 Adding an LSU.................................................................................................................. 15 Modifying a LSU configuration .......................................................................................... 17

Managing the LSU configuration .............................................................................................. 18 The ProtecTIER OpenStorage plug-in...................................................................................... 19

Installing the ProtecTIER OpenStorage plug-in on a NetBackup media server ............... 19 Configuring the ProtecTIER OpenStorage plug-in on a NetBackup media server........... 24 Configuring the ProtecTIER OpenStorage on NetBackup................................................ 27

Summary........................................................................................................................45 Appendix A: Glossary...................................................................................................46 Appendix B: Resources................................................................................................47 Trademarks and special notices..................................................................................48

Abstract This technical paper provides a best-practices guide for implementing an IBM System Storage ProtecTIER backup solution by using the Symantec NetBackup OpenStorage API. ProtecTIER is a disk-based data-storage system. It uses data deduplication technology to store data to disk arrays. The ProtecTIER Virtual Tape (VT) emulates traditional automated tape libraries. ProtecTIER OpenStorage implements a storage-server emulation. The NetBackup OpenStorage API allows intelligent disk-device vendors to natively integrate with NetBackup to deliver seamless solutions. It simplifies management by allowing a single NetBackup policy layer and catalog to control both backup and recovery.

Introduction

Symantec has long been an established market leader in data protection. The Symantec NetBackup OpenStorage API helps strengthen Symantec market-leader position by minimizing

cost and complexity and ensuring greater business continuity with a solution that does the following:

Simplifies management and movement of backup repositories

Improves disaster recovery capabilities Reduces burden on existing backup servers across the enterprise

IBM® System Storage® ProtecTIER® is the first virtual-tape product to contain patented data-

deduplication technology — IBM HyperFactor®. This technology detects recurring data in multiple backups. The common data is merged into a single-instance store, saving disk space that is needed to store multiple backups without sacrificing performance or the availability of backups for

restore.

HyperFactor is a breakthrough on several fronts:

It is scalable up to 1024 TB

The algorithm used to find the common data between backups does not affect the

backup performance of the virtual-tape engine

Data integrity is not compromised, not even statistically

Merged data is stored in a format that preserves restore performance

Intended audience

This technical report is intended for:

Users and prospects who are looking to implement a backup solution on ProtecTIER using Symantec NetBackup OpenStorage (OST) software

Users and management who are seeking detailed information to implement a backup

solution on ProtecTIER using Symantec NetBackup software

Scope

This technical paper provides:

Detailed backup solution implementation on the ProtecTIER deduplication system (the

IBM System Storage TS7600 family) with Symantec NetBackup OST 7.x

Implementing IBM ProtecTIER deduplication with Symantec NetBackup OpenStorage

3

Detailed backup-implementation and configuration best-practices guide

This technical paper does not:

Discuss any performance impact and analysis from a user perspective Replace any official manuals and documents from IBM and Symantec on the products

used in the ProtecTIER and NetBackup OST solution

Prerequisites

This technical paper assumes familiarity with the following prerequisites:

Basic knowledge of IBM System Storage ProtecTIER Basic knowledge of Symantec NetBackup OpenStorage (OST) 7.0.1 or higher The ProtecTIER firmware must be at version 2.5 GA or higher.

IBM System Storage ProtecTIER (TS7600)

This section discusses ProtecTIER.

Overview

IBM ProtecTIER deduplication solutions are designed to meet the disk-based data-protection needs of users of all sizes while enabling significant infrastructure cost reductions. ProtecTIER uses an inline data deduplicator called HyperFactor to detect recurring data as data streams are

passing through it. A ProtecTIER system supports up to 1 petabyte (PB) of physical storage that can provide up to 25 PB of storage capacity.

Figure 1: How IBM System Storage ProtecTIER works

ProtecTIER models

The IBM ProtecTIER deduplication system offers three models:

TS7650G ProtecTIER Deduplication Gateway TS7650 ProtecTIER Deduplication Appliance

TS7610 ProtecTIER Deduplication SMB Appliance


4

TS7650G ProtecTIER Deduplication Gateway

Figure 2: IBM System Storage TS7650G ProtecTIER Deduplication Gateway

It includes only the server installed with the ProtecTIER code. This is the most scalable model of the three. It can start from a small disk subsystem

and scale to 1 PB of repository in size.

It supports a single or two-node cluster Gateway. It can be connected to any disk subsystems listed in the support matrix that is found

at ibm.com/systems/storage/tape/resources.html

The TS7650G consists of three models: 3958-DD4: This is the latest server and is based on the IBM System x3850 Type

7145 server

3958-DD3: This server is based on the IBM System x3850 M2 Type 7233. This model is no longer available for ordering

3958-DD1: This server is based on the IBM System x3850 M2 Type 7141. This

model is no longer available for ordering

Component 3958-DD1 3958-DD3 3958-DD4

IBM System x3550 M2 x3580 M2 x3580 X5

Processor 4x quad core (16 cores) 4x hex cores (24 cores) 4x octo cores (32 cores)

RAM 32 GB 32 GB 64 GB

Table 1: IBM System Storage TS7650G ProtecTIER Deduplication Gateway capabilities

Notes:

1. A critical hardware component in a TS7650G implementation is the disk array that holds

the ProtecTIER repository; but it is not packaged as part of a TS7650G order from IBM. You can order a new disk subsystem from IBM or another vendor (if supported) or use an existing disk subsystem (listed in the support matrix).

2. With ProtecTIER, no additional compression is effective. ProtecTIER performs compression by default after the deduplication process. Do not allocate disk arrays for ProtecTIER virtual tap libraries (VTLs) that perform their own compression.


5

TS7650 ProtecTIER Deduplication Appliance

Figure 3: IBM System Storage TS7650 ProtecTIER Deduplication Appliance

It includes the server installed with ProtecTIER code and disk subsystems for the repository

It offers 7, 18 or 36 TB for repository It supports a single or two-node cluster in a 36 TB appliance It consists of the following components:

Server: 3958-AP1 server, based on an IBM System x3850 X5 System console: a TS3000 System Console (TSSC) Disk controller: an IBM System Storage DS5020 Express

Disk-expansion controller: an IBM System Storage DS4000® EXP810 storage-expansion unit

Note: All components are mounted in an IBM 36U rack unit.

IBM System Storage TS7650 Appliance is available in four configurations (see Table 2).

Table 2: IBM System Storage TS7650 ProtecTIER Deduplication Appliance Models

Size of repository 7 TB configuration

18 TB configuration

36 TB configuration

36 TB two-node configuration

Nominal capacity (based on 15:1 deduplication)

175 TB 450 TB 900 TB 900 TB

Maximum throughput

Up to 100 MBps Up to 250 MBps Up to 500 MBps Up to 500 MBps

TS7610 ProtecTIER Deduplication SMB Appliance

Figure 4: IBM System Storage TS7610 ProtecTIER Deduplication SMB Appliance


6

It is a user-installable entry system that consists of the appliance installed with ProtecTIER code and internal disks to serve as a repository

The TS7610 Appliance offers either 4.0 or 5.4 TB for repository It is available in a stand-alone one-node configuration only

A 4.0 TB model can be upgraded to a 5.4 TB model by a software upgrade; no additional

hardware is required.

ProtecTIER service modes

All models of the ProtecTIER deduplication system can be configured to operate in one of two modes:

Virtual-tape library (VTL)

The ProtecTIER VTL service emulates traditional tape libraries, which enables you to make a transition from a traditional tape backup to a disk backup without having to replace your entire

backup environment. Your existing backup application can access virtual robots to move virtual cartridges between virtual slots and drives. The backup application perceives that the data is being stored on cartridges; ProtecTIER actually stores data on a deduplicated disk

repository on the storage fabric or direct-attached storage.

Figure 5: ProtecTIER VTL

OpenStorage (OST)

With OpenStorage, ProtecTIER can be integrated with Symantec NetBackup to provide the means for backup-to-disk without having to emulate traditional tape libraries. Using a plug-in that is installed on an OST-enabled media server, ProtecTIER can implement a

communication protocol that supports data transfer and control between the backup server and the ProtecTIER server. Therefore, to support the plug-in, ProtecTIER adds function to emulate a storage server.


7

Figure 6: OpenStorage emulation

Note: A single ProtecTIER system cannot be configured to run both modes at the same time.

ProtecTIER Manager

The ProtecTIER Manager (PT Manager) application is a GUI for viewing, configuring, managing and troubleshooting the operation of the IBM TS7600 family of products. It can be installed on a

Microsoft® Windows® or Linux® operating-system- based PC on an Ethernet network.

The workstation for the installation of the PT Manager is not included with the ProtecTIER system. You can install the PT Manager GUI on any workstation that meets the following

requirements:

x86 (Intel® Pentium or higher) processor 256 MB memory at minimum

1.2 GB of disk space Access to the ProtecTIER service node’s IP address (port 3501 and 3503 are open on

the firewall)

Keyboard, mouse and CD-ROM drive Screen resolution of 1024x768 or higher 24-bit color or higher

Operating environments supported: Windows 32/64 bit (2003, XP or 7) Linux® Red Hat 32 and 64-bit (Enterprise 4 or later)


8

Figure 7: ProtecTIER Manager Start Window

ProtecTIER Replication Manager

Also referred to as Grid Manager, the ProtecTIER Replication Manager recognizes all members of the entire network that the ProtecTIER Replication Manager handles on both replication

subnets. The ProtecTIER Replication Manager is enabled separately from the ProtecTIER Manager on the user’s ProtecTIER server. The ProtecTIER Replication Manager manages the configuration of multiple replication grids in an organization. An agent on every node in each

ProtecTIER server interacts with the server and maintains a table of its grid members.

Native replication lets you replicate data objects between ProtecTIER repositories. For a logical set of repositories to replicate from one to another, you must create a replication

grid. The replication grid is remotely created and managed by the Replication Manager.

Each ProtecTIER Replication Manager has a unique identity. A repository, after it has joined a replication manager, cannot join a replication grid managed by a different replication manager,

even if it has left the grid. This setup prevents data collision.

The ProtecTIER Replication Manager is a server that remotely manages the replication grids within an organization. The ProtecTIER Manager connects to the ProtecTIER Replication

Manager using the IP address of the ProtecTIER Replication Manager server. The ProtecTIER Replication Manager can be installed on a dedicated host (which requires a special request for support from IBM) or on a ProtecTIER node.

If the ProtecTIER Replication Manager is installed on a ProtecTIER node, it can manage one single grid with 24 repositories. If the ProtecTIER Replication Manager is installed on a dedicated server, it can manage up to 64 grids with 256 repositories in each grid.


9

Symantec NetBackup

This section discusses Symantec NetBackup.

Overview

Symantec NetBackup provides a complete, flexible data-protection solution for a variety of platforms, including Microsoft Windows, UNIX®, Linux and Netware systems.

NetBackup allows users to back up, restore and archive data files according to periodic or calendar-based schedules. These backups occur automatically during working hours or off-peak hours. The backups can be full or incremental.

NetBackup consists of both the server and the client software:

Server software resides on the computer that manages the storage devices. Client software resides on the computers that contain data to back up.

Figure 8: NetBackup storage configuration

NetBackup supports both master and media servers. The master server manages the backups, archives and restores. Media servers provide additional storage by allowing NetBackup to use the

storage devices that they control. Media servers can also increase performance by distributing the network load.

During a backup or archive, the client sends backup data across the network to a NetBackup

server that has the type of storage specified for the client. The storage requirement is specified during NetBackup configuration.

In a restore, users use the NetBackup GUI to browse and select files and directories to recover.

NetBackup finds and then restores these files and directories to the client storage device.


10

OpenStorage operating environment

With OpenStorage, ProtecTIER can be integrated with NetBackup to provide backup to disk without having to emulate tape. Using a plug-in that is installed on an OST-enabled media server,

ProtecTIER implements a communication protocol that supports data transfer and control between the backup server and the ProtecTIER server.

In addition to ProtecTIER firmware 2.5 or higher and the ProtecTIER system, the OpenStorage

environment is comprised of the following major components:

The storage server

The Storage Server (STS) is an entity that runs on the ProtecTIER server. It is a high-level

component defined by the OST API and is created using ProtecTIER Manager. An STS is a container of logical-storage units (LSUs).

The logical-storage unit

As with an STS, the LSU is also defined by the OST API and is a container of images that are where data is stored. Up to 256 LSUs can be defined per STS and identified by a name string that is unique within the storage server. In ProtecTIER for OST, an LSU’s storage capacity is

defined as a nominal percentage of the repository’s overall nominal capacity, taking into consideration the configured percentage of LSUs that share the repository’s physical storage.

Figure 9: OpenStorage repository components

Note: Overall LSU capacity can be less than or equal to the repository’s nominal capacity.

The Plug-in

The plug-in is a shared library that resides on the NetBackup media server and is dynamically

linked to the NetBackup application for data transfer to and from the ProtecTIER storage server emulation. The OST plug-in supports the following platforms: IBM AIX®, Linux, Solaris, Windows 2003 and Windows 2008.

Note: The hardware configuration for OST is different than the one for VTL. You must know which configuration is needed before ordering.


11

Configuring ProtecTIER to work with the OpenStorage environment

The following section describes how to configure the ProtecTIER system for OST using

ProtecTIER Manager.

Before configuring the ProtecTIER system, ensure that a repository is created with OST as the backup interface.

Figure 10: Summary Report Window - OpenStorage appears in the Applications field

Configuring a storage server (STS)

Follow these steps to add the storage server (STS) and then define the logon credentials. NetBackup uses these credentials so that the media server can log in to the storage server for

storage access.

Adding the storage server

1. Log in to ProtecTIER Manager.

2. From the OpenStorage menu, select Storage server > Add Storage server. The STS configuration window is displayed.


12

Figure 11: Add storage server

3. Enter a unique name for the new storage server in the STS Name field.

Note: The STS unique name cannot be modified after the STS has been

created. Refer to Table 3 for field specifics when defining the logon credentials.

4. Enter a user name in the User name field.

5. Enter a password in the New Password field and reenter the password in the

Verify password field as shown next.

Figure 12: Add Storage Server window

6. Click OK to complete the task.


13

Table 3: Logon credentials field specifics

Field name Field length Field type (alphanumeric or special characters)

STS name 4 -to16 characters Alphanumeric, period (.) or underscore (_)

User name 4 to 16 characters ASCII

New password 4 to 16 characters All alphanumeric and special characters. The use of special

characters might be unrecognized by NBU. Therefore, if

special characters are used (for example, space, &, - and

others) use quotation marks (“ “) before and after the string.

Modifying storage-server credentials

This section describes how to modify the credentials of the selected storage server using the ProtecTIER Manager. The STS unique name cannot be modified after the STS has been

created. Follow these steps:

1. Access ProtecTIER Manager, and from the OpenStorage menu, select Storage server > Modify Storage server credentials. The STS modify-credentials window

opens:

Figure 13: Modify Storage Credentials menu

2. To modify the user name, enter a new user name in the User name field.

3. To modify the password, enter the password that was previously defined in the Password field.

4. Enter a new password in the New password field and reenter the password in the

Verify password field, and click Ok.


14

Figure 14: Modify Storage Server Credential window

Configuring a logical-storage unit (LSU)

Configuring LSUs on a storage server divides the appliance into one or more logical units of space. As with an STS, an LSU is defined by the OST API and is a container of storage and

images that consumes storage.

Adding an LSU

Complete this task to add an LSU to an STS.

1. From ProtecTIER Manager, select OST > Logical Storage Unit management. The LSU management window is displayed:

Figure 15: Logical Storage Unit Management menu


15

Figure 16: Logical Storage Unit Management window

2. Click Add to configure a new LSU on the storage server. The Adding an LSU window is displayed. Refer to Table 4 for the field specifics when defining an LSU.

Table 4: LSU field specifics

Field name Field length Field type (alphanumeric or special characters)

LSU name 4 to 6 characters alphanumeric, period (.) or underscore (_)

Description 0 to 1023 characters All alphanumeric and special characters

3. Enter a unique name in the LSU Name field.

Note: After the LSU is created and saved, the LSU name can no longer be modified.

4. Enter a description for the LSU in the Description field

5. Enter the size of the LSU as the nominal percentage (up to two precision digits) of

the repository in the Nominal percentage field.

6. Select the data factoring mode from the HyperFactor drop-down menu:

Enabled to turn on hyperfactoring

Disabled to turn off hyperfactoring Baseline for no deduplication, but an index is built


16

Figure 17: Hyperfactor drop-down menu

7. Select On or Off in the Compression field to enable or disable data compression.

8. Click Ok.

Modifying a LSU configuration

Complete the following steps to modify an LSU on an STS:

1. From ProtecTIER Manager, select OST > Logical Storage Unit management. The

LSU management window is displayed, as shown.

Figure 18: LSU management window


17

2. Click Modify to change the LSU properties previously defined on the storage server. The Modifying an LSU window is shown. Modify one or all of the following:

Enter a new LSU description (up to 1023 characters) in the Description field. Change the size of the LSU as the nominal percentage (up to two points of

precision) of the repository in the Nominal percentage field.

Modify the factoring-mode option from the HyperFactor drop-down list by selecting one of the following options: Yes to enable hyperfactoring

No to disable hyperfactoring Baseline for no deduplication, but an index is built

Modify the data-compression option by selecting On or Off in the

Compression field to enable or disable data compression.

Figure 19: LSU Modify window

3. Click OK to save the LSU properties.

Managing the LSU configuration

The LSU management window has the configuration properties. Use the spacebar or double-click Repository Nominal Quota or LSU usage to quick-edit the LSU storage capacity and do these

steps:

1. Select OpenStorage > Logical Storage Unit management. The LSU management window contains the information as shown in Table 5.

Table 5: Logical Storage Management windows

Column Description

Status Display if the LSU is new, or if it has been modified or deleted.

LSU name The unique name defined for the LSU.

Repository nominal quota LSU nominal percentage used of the repository’s overall nominal capacity.


18

LSU usage The actual amount of space (MB) used from the LSU’s nominal percentage.

Images The number of images contained on an LSU.

Hyperfactor The data-factoring mode status.

Compression Data compression is either enabled (on) or disabled ((off).

Description Describes the LSU.

2. Click Refresh usage to update the LSU usage column.

3. Click Multiple adjust to equally divide the repository nominal quota between selected

LSUs (that is, Available percentage / Number of selected LSUs) or set all selected LSUs with a selected percentage value.

4. Click Save Changes to save the updated configuration.

The ProtecTIER OpenStorage plug-in

This section describes the ProtecTIER OpenStorage plug-in and how to install and configure it on a NetBackup media server.

The ProtecTIER OpenStorage plug-in software is installed on media servers that access the

ProtecTIER system. The plug-in allows the control of multiple storage servers over various IP network subnets. After the plug-in is installed, the storage server is configured in NetBackup.

Installing the ProtecTIER OpenStorage plug-in on a NetBackup media server

This section describes the procedure for handling the ProtecTIER OpenStorage plug-in on the media server to communicate with the storage server.

The OpenStorage plug-in installers are provided on the IBM System Storage ProtecTIER

OpenStorage Plug-in CD. Various plug-in installers are available for AIX, Linux, Solaris and Windows. Currently, the OST HP plug-in is not been supported.

Installing the OpenStorage plug-in on Windows

Complete the following steps to install the OpenStorage plug-in on Windows.

1. From the ProtecTIER OpenStorage Plug-in CD, access and launch the Windows plug-in installed by double-clicking the executable file. The InstallAnywhere

wizard helps you install the ProtecTIER OST Plug-in for 32- or 64-bit.

2. Click Next. The installer prompts you to stop the NetBackup Remote Manager and Monitor Service if it is running (see Figure 20).


19

Figure 20: Message about NetBackup Service

3. To stop the NetBackup Remote Manager ad Monitor Service, go to Start >

Control Panel > Administrative Tools > Services.

4. In the Services window, services are listed in alphabetical order by name.

5. Locate the name, NetBackup Remote Manager and Monitor Service. Its Status

field shows the state of the service.

6. Select the service and right-click.

7. The next menu has options to Stop, Start or Restart the service. Select Stop.


20

Figure 21: Stop NetBackup Remote Manager and Monitor Service

8. Return to the InstallAnywhere window and click Next.

9. Review the Pre-Installation Summary; click Install to run the install procedure.

10. When the installation is complete, you are prompted to start the NetBackup Remote Manager and Monitor Service. Select Start service and click Next.

11. The OpenStorage plug-in installation is complete. Press Done.

Installing the OpenStorage plug-in on AIX

Complete the following steps to install the OpenStorage plug-in on AIX.

1. From the IBM System Storage ProtecTIER OpenStorage Plug-in CD, copy and

extract the IBM_OSTP_Vxxx.tar file.

2. Access the command-line interface on the media server.

3. Log in as root.

4. Stop the NetBackup Remote Manager and Monitor Service by entering the following command: nbrmms –terminate

If the command is not recognized, enter the full path:

/usr/openv/netbackup/bin/nbrmms -terminate

5. Run the rpm in install mode from the command line on the media server. The filename is IBM_ProtecTIER_OST_plugin_AIX64-xx.xxx.ppc.rpm for 64-bit and

IBM_ProtecTIER_OST_plugin_AIX32-xx.xxx.ppc.rpm for 32-bit, where xxx is the package number.

Note: The 32- and 64-bit difference is with respect to the NetBackup installation

(not the operating system). That is, if the NetBackup installation is 32-bit on a 64-bit OS, use the 32-bit plug-in and not the 64-bit.


21

6. Enter the respective filename. The following output is displayed:

[root@server tmp]# rpm -i IBM_ProtecTIER_OST_plugin_AIX64-xx-xxx.ppc.rpm Creating default configuration files... Created config unit /etc/IBM/ost-plugin/plugin_network_cfg.xml Created config unit /etc/IBM/ost-plugin/plugin_cfg.xml done

7. The OpenStorage plug-in installation is now complete.

8. Start the NetBackup Remote Manager and Monitor Service by entering the following command: nbrmms

If the command is not recognized, enter the full path: /usr/openv/netbackup/bin/nbrmms

Installing the OpenStorage plug-in on Solaris

Complete the following steps to install the OpenStorage plug-in on Solaris.

1. From the IBM System Storage ProtecTIER OpenStorage Plug-in CD, copy and extract the IBM_OSTP_Vxx.xxx.tar file.


3. Log in as root.

4. Stop the NetBackup Remote Manager and Monitor Service by entering the following command: nbrmms -terminate <enter>

If the command is not recognized, enter the full path: /usr/openv/netbackup/bin/nbrmms

5. Access the IBM_OSTP_Vxxx folder and copy the IBM ProtecTIER OST plug-in software package for Solaris to a /tmp directory.

6. Enter this command: pkgadd -d IBM_ProtecTIER_OST_plugin_Solaris64-xxx.pkg all

7. Press Enter. The following output is displayed:

8. Processing package instance <IBMPTOSTPI> from

</tmp/IBM_ProtecTIER_OST_plugin_Solaris64-2.5-1.pkg> IBM ProtecTIER OST Plugin 2.5 (64 bit) software package(sparc) 2.5.1 IBM Corp. ## Executing checkinstall script. ## Processing package information. ## Processing system information. 4 package pathnames are already properly installed. ## Verifying disk space requirements. ## Checking for conflicts with packages already installed. ## Checking for setuid/setgid programs. This package contains scripts which will be executed with super-user permission during the process of installing this package. Do you want to continue with the installation of <IBMPTOSTPI> [y,n,?]

9. Enter y at the prompt to continue with the installation. The following is displayed:

Installing IBM ProtecTIER OST Plugin 2.5 (64 bit) software package as <IBMPTOSTPI> # Installing part 1 of 1. /opt/IBM/ost_plugin_tools/iperf /opt/IBM/ost_plugin_tools/ostp_cli /opt/IBM/ost_plugin_tools/pt_net_perf_util


22

/opt/IBM/ost_plugin_tools/report_problem /usr/openv/lib/ost-plugins/libstspiIbmPt.so /usr/openv/lib/ost-plugins/libstspiIbmPtMT.so /usr/openv/netbackup/db/config/OPT_DUP_BUSY_RETRY_LIMIT [ verifying class <none> ] ## Executing postinstall script. Creating default configuration files... Creating logs dir /var/log/IBM/ost Creating stats dir /var/log/IBM/ost/stats Creating config dir /etc/IBM/ost-plugin done Installation of <IBMPTOSTPI> was successful.

10. The installation is complete.

11. Start the NetBackup Remote Manager and Monitor Service by entering the following command: nbrmms


/usr/openv/netbackup/bin/nbrmms

Installing the OpenStorage plug-in on Linux

Complete the following steps to install the OpenStorage plug-in on Linux.

1. From the IBM System Storage ProtecTIER OpenStorage Plug-in CD, copy and extract the IBM_OSTP_V3.x.xxx.tar file.


3. Log in as root.

4. Stop the NetBackup Remote Manager and Monitor Service by entering the

following command: nbrmms -termiante

If the command is not recognized, enter the full path: /usr/openv/netbackup/bin/nbrmms –terminate

5. Run the rpm with install mode from the command line on the media server by entering the command: rpm –i <filename>

6. Enter the <filename>c. For example, the filename is similar to

IBM_ProtecTIER_OST_plugin_Linux64-xxx.x86_64.rpm for 64-bit.

The following sample output is displayed:

[root@server tmp]# rpm -i IBM_ProtecTIER_OST_plugin_Linux64-xxx.rpm Creating default configuration files... Created config unit /etc/IBM/ost-plugin/plugin_network_cfg.xml Created config unit /etc/IBM/ost-plugin/plugin_cfg.xml done

7. The OpenStorage plug-in installation is now complete.

8. Start the NetBackup Remote Manager and Monitor Service by entering the

following command: nbrmms


23


/usr/openv/netbackup/bin/nbrmms

9. To verify that the plug-in has been installed correctly, enter the command: /usr/openv/netbackup/bin/admincmd/bpstsinfo -pi. If the plug-in has been installed correctly, the output is similar to the following:

Plugin Name: libstspiIbmPtMT.so Prefix: IBM-ProtecTIER Label: IBM ProtecTIER Plugin Build Version: 9 Build Version Minor: 4 Operating Version: 9 Vendor Version: IBM ProtecTIER 3.1.8

Configuring the ProtecTIER OpenStorage plug-in on a NetBackup media server

This section describes how to configure the plug-in and register it to the NetBackup.

Complete the following steps using the ostp_cli executable to configure the server IP addresses on the plug-in, which were previously configured on the ProtecTIER server.

1. From the /opt/IBM/ost_plugin_tools directory, run ostp_cli to configure each of the

server IP addresses on the ProtecTIER system.

Note: For Microsoft Windows, the path to ostp_cli is PROGRAMFILES\IBM\ost_plugin_tools\ostp_cli, where PROGRAMFILES is the path

to the program-files directory, usually C:\Program Files. For a Windows 2008 installation, the plug-in must be run as Administrator. Select Start > Program > Accessories > Command Prompt, then right-click Command Prompt and select

Run as Administrator.

Figure 22: Start command shell from Windows 2003 to select Administrator account


24

Figure 23: Start command shell from Windows 2008 to select Administrator account

2. To add new IP addresses to the server’s configuration, enter the following command:

ostp_cli net_cfg_add_addr <sts_name> <address_set_index> <address:port>

where:

<sts_name> is the storage-server name created on ProtecTIER Manager. <address_set_index> is a zero-based index of an address set. An

address_set is a collection or group of IP addresses. Addresses are grouped by ProtecTIER cluster node, that is, all OpenStorage addresses belonging to the same node in a ProtecTIER cluster must go to the same address set.

Thus, there are two address sets for each sts_name with indexes 0 and 1. <address:port> is the OST IP address on the ProtecTIER Manager server

and the port number. The default OST port number is 23979 (which is

predefined on the system), as shown in Example 1.

Example 1: OST plug-in command line setup on a Windows media server

C:\Program Files\ibm\ost_plugin_tools>ostp_cli net_cfg_add_addr ptSTS 0

192.168.151.1:23979

Successfully added address C:\Program Files\ibm\ost_plugin_tools>ostp_cli net_cfg_show STS: ptSTS address-set 0: address 0: 192.168.151.1:23979


25

Note: The command must run individually on each server-side-configured virtual IP address.

Command options

Here is a list of ostp_cli command options for configuring the plug-in on the media

Command Parameters Description net_cfg_add_addr <sts_name> <address_set_index> <address:port>

<sts_name> is the storage server name.

<address_set_index> is a zero-based index of an address set.

<address:port> is the OST IP address on the ProtecTIER Manager server and the port number.

Add new IP addresses to the server’s configuration.

net_cfg_remove_addr_set <sts_name> <address_set_index>


<address_set_index> is a collection of nodes or their IP address (0 or 1).

Remove an address set from the addresses configuration. The last address set in an STS cannot be removed. Instead, remove the STS.

net_cfg_remove_addr <sts_name> <address_set_index> <address_index


<address_set_index> is a collection of nodes or their IP addresses (0 or 1).

<address_index> is the OST IP address.

Removes an IP address from the addresses configuration. The last IP address in an address set is not removable. Instead, remove the address set.

net_cfg_modify_addr <sts_name> <address_set_index> <address_index> <new_address:port>


<address_set_index> is a collection of nodes or their IP addresses (0 or 1)

<address_inex> is the OST IP address.

<new_address:port> is the modified IP address and port number of the node.

Modify an IP address in the address configuration.

net_cfg_rename_sts <sts_name> <new_sts_name>


<new_sts_name> is the modified storage server name.

Rename an STS in the addresses configuration.

net_cfg_remove_sts <sts_name>

<sts_name> is the storage server name. Remove an STS from the addresses configuration.

check_com N/A Verify if one or more of the IPs are unreachable.

net_cfg_show N/A Display the address configuration

cfg_show N/A Display the plug-in general configuration.

cfg_change <param_name> <value>

<param_name> is the general plug-in configuration parameter.

<value> is the respective parameter’s size.

Used to modify the plug-in general configuration.

get_cfg_path N/A Not for customer use. get_log_path N/A Not for customer use. create_paths N/A Not for customer use. net_cfg_create N/A Not for customer use. cfg_create [create_mode] N/A Not for customer use.

General plug-in configuration


26

This table has a partial list of commonly-used parameters to modify the plug-in’s general configuration. Enter the command: ostp_cli cfg_change <param_name> <value>

Parameter Value Description total-archive-size-mb 200 – 1000 MB The total space (in MB) dedicated to the logs and

long-term statistics files. The default is 500 MB. target-archive-size-percent

20 – 80 percent Log target archive size – after reaching the log-size percentage, delete the contents until the size is a fraction of its original size. The default is 80.

compression-enabled

0 = off, 1 = on Enable or disable compression of non-active long term statistics files. The default is 1 (on).

log-verbosity low, medium, high How much data to log. The default is low.

Configuring the ProtecTIER OpenStorage on NetBackup

This section describes how to configure NetBackup OST to use ProtecTIER.

Before you start the configuration, complete the following steps:

1. Configure the hardware (set up the OST-network connection)

2. Install and configure ProtecTIER 2.5 or higher with OST.

3. Install and configure the OST plug-in on the NetBackup Media Server.

On Windows and UNIX servers, you can use the GUI. This section describes how to configure the storage server, storage unit and disk pool using NetBackup GUI tools.

Storage-server settings

A storage server is defined on the ProtecTIER system and in the NetBackup Server plug-in. Input the storage-server name and its parameters. Figure 24 shows the NetBackup

Administrator Console. Select Master Server from the left pane to access the Storage Server setting. Then complete the following steps:

1. Select Configure Disk Storage Servers.


27

Figure 24: NetBackup Administrator Console window

2. Start the Storage-Server configuration wizard shown in Figure 25 and click Next.

Figure 25: Start the Storage Server Configuration wizard

3. For the Storage Type definition, select OpenStorage and click Next.


28

Figure 26: Storage type selection window

4. Input the following parameters into the fields shown in Figure 27:

Storage server type: <Vendor type> IBM-ProtecTIER Storage server name: <STS name>

Select media server: <server name> Media server name User name: <sts user name> Password: <sts user password>


29

Figure 27: Storage server parameters input window

5. Figure 28 shows a summary of the settings. Review it and, if you are satisfied, click Next; otherwise, click Back and make any necessary changes.

Figure 28: Storage server setting input parameter window

6. Verify and check the parameters and configuration (Figure 29) and the result of

verification (Figure 30).


30

Figure 29: Input parameter validation window

Figure 30: The results of verification

7. Complete the creation of STS by clicking Next (Figure 31).


31

Figure 31: Complete the creation of Storage Server

Creating a disk pool

Symantec NetBackup needs storage unit to back up data. You can create a disk pool

before creating a storage unit. Disk pool and storage that is defined on NetBackup can be used as the target of a backup policy. Therefore, if you plan to back up to ProtecTIER system, you need to create disk pool as the STS parameter and a NetBackup license to

use the disk-pool feature. Complete the following steps to create disk pool:

1. Click the Configure disk pool icon from main window to open Disk Pool Configure Wizard window. Select IBM-ProtecTIER and click Next.

Figure 32: Select ProtecTIER as storage type

2. In the Select Storage Server window, you can choose the storage server that is predefined in the NetBackup software. Select the STS and then click Next.


32

Figure 33: Select Storage Server window

3. In the Select Volumes window, select the LSUs to use for backup storage by selecting the LSUs’ check boxes and then click Next.

Figure 34: Select Volume window

4. Define the disk pool name by entering the name of disk pool and clicking Next.


33

Note: The High-water mark setting is a threshold that, when reached, signals to NetBackup that the disk storage unit is considered full. The default is 98 percent.

As the disk-storage capacity grows closer to the high-water mark, NetBackup reduces the number of jobs sent to the storage unit. NetBackup does not assign new jobs to a storage unit that is considered full. After the High-water mark is

reached, space is created on the disk-storage unit until the Low-water mark is met. The default is 80 percent. The Low-water mark cannot be higher than the igh-water mark. Refer to the Symantec NetBackup Administrator‘s Guide for

more details. This guide can be found at the following address: www.symantec.com/business/support/index?page=content&id=TECH52803

Figure 35: Disk-Pool Properties window

5. Verify that the disk-pool configuration is correct and then click Next.


34

Figure 36: Summary window for disk pool configuration

6. Complete the disk-pool creation by clicking Next.

Figure 37: Disk-pool creation complete


35

7. Click Next to create the storage unit.

Figure 38: Continuing to the creation of the storage unit

Creating a storage unit

NetBackup refers to physical storage as storage unit. It can be a robot, a path to a volume or a disk pool. This section uses disk pool as the storage unit. Complete the

following steps to create a storage unit:

1. If you clicked Next in step 7, the window to create the storage unit is opened as shown; otherwise, open it from the NetBackup Administration Console tree.

Figure 39: Start the creation of a storage unit

2. Input the storage unit’s name and click Next.


36

Figure 40: Storage-unit creation window

3. Complete the storage-unit creation.

Figure 41: Create storage-unit procedure completed

All the required procedures to configure OST with NetBackup are complete.

Creating a Symantec NetBackup OST policy

Perform these steps to create an OST policy on the NetBackup Administration console.


37

1. In the NetBackup Administration Console window, right-click Summary of all Policies and click New policy to create a new ProtecTIER OST policy

Figure 42: Creating a new ProtecTIER OST backup policy

2. Enter a new ProtecTIER OST backup policy name, select the USE Backup Policy Configuration Wizard check box, and click OK to continue as shown.

Figure 43: Specify a name for the new policy

3. In the Backup Policy Configuration Wizard, click Next to continue.


38

Figure 44: Backup Policy Configuration Wizard

4. Select the policy type and click Next to continue.

Figure 45: Specifying the policy type

5. Check Detect operating system… in the next window. Click Add, then enter the

host name to the Client List and press Next.


39

Figure 46: Specifying client

6. Click Add and then click Remote Folder icon, as shown here.

Figure 47: Specifying files and folders window

7. Select the files and directories for backup in the Browse window, then click OK.


40

Figure 48: Selecting files and directories for backup

8. Verify selected files and directories added successfully as displayed in the

following window, then click Next.

Figure 49: Verifying files and directories for backup

9. Select the desired type of backup in the next wizard page then click Next. For

this example, it is a Full Backup.

Note: There are two types of incremental backup in Symantec Backup.

Differential: backing up files that changed since the last full backup or

incremental backup Cumulative: backing up files that changed since the last full backup


41

Figure 50: Specifying backup type

10. Specify the backup rotation and retention parameters, then click Next.

Figure 51: Specifying backup rotation and retention parameters


42

11. Schedule the ProtecTIER OST backup window, then click Next.

Figure 52: Scheduling the ProtecTIER OST backup window

12. Click Finish to complete the ProtecTIER OST policy creation.

Figure 53: Completing policy creation

13. Complete the following steps to set ProtecTIER OST policy attributes.


43

Go to NetBackup Management > Policies, double-click Testing policy. Enter the required storage unit that allocated for this policy.

Select all check boxes that required for the selected policy. Click OK.

Figure 54: Setting ProtecTIER OST policy attributes


44

Summary

The IBM ProtecTIER is an enterprise-class, disk-based virtual tape software product that uses a unique data deduplication technology, called IBM HyperFactor. The ProtecTIER family is capable of inline deduplication throughput of up to 1000 MBps with a single node and 2000 MBps with a

dual cluster. It supports up to one petabyte of physical storage per system, which represents up to 25 petabytes of deduplicated capacity.

HyperFactor is designed for high data integrity; deduplicated data is only eliminated after a byte-

by-byte comparison. The redundant data is reduced as it is ingested, thus optimizing the process by eliminating the need for a dedicated post-process.

Symantec NetBackup OST is one of the latest innovative ideas that makes it easier to manage,

control, copy and store large amounts of backup data. The OST API allows NetBackup to interface directly with the ProtecTIER resources without having to emulate virtual tape.

OST communicates with ProtecTIER over the gigabit Ethernet interfaces. This eliminates the

need for fiber channel connectivity to all NetBackup Media servers. It provides the flexibility to support remote offices or other locations where only Ethernet or TCP/IP connections are available.

This technical content is intended to be a reference guide for users who want to use ProtecTIER

and Symantec NetBackup OpenStorage for their data-protection solution. This technical report is

not meant to be an implementation or solution guide.


45

Appendix A: Glossary Back end – the connection between the ProtecTIER system and the disk array is

referred to as a back-end connection.

Change rate – the percentage of change in data from one backup set to the next. The

daily change rate is the percentage of change from one day’s backup cycle to the next.

Disk array – the disk array attaches to the IBM System Storage TS7600 family through back-end connections and holds the repository of deduplicated backup data.

Factoring ratio – the ratio of nominal capacity to physical capacity. For example, if 150 TB of user data (nominal capacity) is stored on 10 TB of physical capacity; the factoring ratio is 15 to 1.

Front end – the connection between the ProtecTIER system and the backup server is referred to as a front-end connection.

Metadata –the data used to keep track of the information about the backup data,

including where it is stored on the disk.

Nominal capacity – the amount of user data that ProtecTIER is managing.

Physical capacity – the physical capacity used in the array.

Repository – the repository is the physical disk that holds the ProtecTIER deduplicated data. Two types of file systems make up the ProtecTIER Repository: metadata and user data.

TS7600 –the IBM family of deduplication solutions that operate on the ProtecTIER platform.

User data –the files and data sets that need to be backed up and stored on disk.


46

Appendix B: Resources These web sites provide useful references to supplement the information contained in this technical paper:

System Storage on IBM PartnerWorld® ibm.com/partnerworld/storage

IBM Systems on IBM PartnerWorld ibm.com/partnerworld/systems

IBM Publications Center

www.elink.ibmlink.ibm.com/public/applications/publications/cgibin/pbi.cgi?CTY=US

IBM Redbooks® ibm.com/redbooks

IBM developerWorks® ibm.com/developerWorks

Symantec NetBackup 7.x documentation

Symantec NetBackup Administrator’s Guide for Windows www.symantec.com/business/support/resources/sites/BUSINESS/content/live/TECHNICAL_SOLUTION/135000/TECH135525/en_US/357098.pdf

Symantec NetBackup Administrator's Guide for UNIX and Linux www.symantec.com/business/support/resources/sites/BUSINESS/content/live/TECHNICAL_SOLUTION/135000/TECH135524/en_US/357099.pdf


47


48

Trademarks and special notices

© Copyright IBM Corporation 2012. All rights Reserved.

References in this document to IBM products or services do not imply that IBM intends to make

them available in every country.

IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries or both. If these and other

IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or

common law trademarks in other countries. A current list of IBM trademarks is available on the Web at "Copyright and trademark information at www.ibm.com/legal/copytrade.shtml.

Symantec and the Symantec Logo are trademarks or registered trademarks of Symantec

Corporation or its affiliates in the U.S. and other countries.

Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries or both.

Intel, Intel Inside (logos), MMX, and Pentium are trademarks of Intel Corporation in the United States, other countries or both.

UNIX is a registered trademark of The Open Group in the United States and other countries.

Linux is a trademark of Linus Torvalds in the United States, other countries or both.

Other company, product or service names may be trademarks or service marks of others.

Information is provided "AS IS" without warranty of any kind.

Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers

are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability or any other claims related to non-IBM products. Questions on the

capability of non-IBM products should be addressed to the supplier of those products.

Any references in this information to non-IBM web sites are provided for convenience only and do not in any manner serve as an endorsement of those websites. The materials at those websites

are not part of the materials for this IBM product and use of those websites is at your own risk.

http://www.ibm.com/legal/copytrade.shtml

implementing ibm protectier deduplication with symantec

Documents