zmanda_sfx4540
TRANSCRIPT
-
8/14/2019 zmanda_sfx4540
1/19
Sun Fire
TM
X4540 Server asBackup Server for Zmanda'sAmanda Enterprise 2.6 Software
Thomas Hanvey (SunMicrosystems) and Dmitri Joukovski and KenCrandall (Zmanda)
September 2008
-
8/14/2019 zmanda_sfx4540
2/19
-
8/14/2019 zmanda_sfx4540
3/19
Sun Microsystems, Inc.
Table of Contents
Introduction.....................................................................................................................................................1
Configuration ..................................................................................................................................................2
Overview...............................................................................................................................................................2
Solaris OS Configuration.........................................................................................................................................3
Zpool Configuration...............................................................................................................................................3
ZFS Configuration...................................................................................................................................................5
Amanda Enterprise Edition Configuration.................................................................................................................5
Amanda Enterprise Edition Monitoring and Reporting.............................................................................................11
Recovery Using the Zmanda Management Console.................................................................................................12
Summary.......................................................................................................................................................14
For More Information .....................................................................................................................................14
Sun Fire X4540 Server as Backup Server for Zmanda's Amanda Enterprise 2.6 Software
-
8/14/2019 zmanda_sfx4540
4/19
-
8/14/2019 zmanda_sfx4540
5/19
1 Introduction Sun Microsystems, Inc.
Introduction
Explosive data growth, combined with demanding requirements for data availability, has placed a tremendous burden
on IT operations staff at businesses of all sizes. Yet, many organizations do not have the staff or budget to purchase
and manage complex and expensive backup and recovery software products.
The Sun FireTMX4540 server can deliver massive storage capacity and remarkable throughput so it is well-suited as a
nearline storage platform for backup and restore applications. Combining the power of the SolarisTM10 Operating
System with the data integrity and simplified administration of ZFS, the Sun Fire X4540 server can be an ideal
candidate for streamlining and improving backup and restore operations.
Amanda Enterprise Edition from Zmanda was designed to address these challenges, providing a backup and recovery
solution that combines fast installation, simplified management, enterprise-class functionality, and low-cost
subscription fees. As an open source product, Amanda Enterprise Edition uses only standard formats and tools,effectively freeing you from being locked into a vendor to recover your archived data.
This guide discusses how to quickly configure the Sun Fire X4540 server as a backup server for Amanda Enterprise
Edition software.
Sun Fire X4540 Server as Backup Server for Zmanda's Amanda Enterprise 2.6 Software
-
8/14/2019 zmanda_sfx4540
6/19
-
8/14/2019 zmanda_sfx4540
7/19
3 Configuration Sun Microsystems, Inc.
The complete Amanda Enterprise Edition deployment consists of the following:
Backup Server and Zmanda Management Console (ZMC) centralize all backup operations and control backup
media. You need at least one backup server for your environment.
Zmanda clients are installed on Solaris OS, Linux, Microsoft Windows, or Mac OS X servers, workstations, and
desktops.
Zmanda agents are installed in addition to Zmanda clients for hot backup of Oracle, Microsoft Exchange, and
Microsoft SQL Server.
Zmanda Internet Backup is an option for backup over the Internet to Amazon S3 (Simple Storage Service).
Zmanda Recovery Manager (ZRM) for MySQLTM is an option for comprehensive backup and recovery of MySQL
servers.
Note: Amanda Enterprise Edition also supports backup over NFS and CIFS. If you can remotely mount your file systemto an Amanda backup server, you can protect that system without installing the Zmanda client on that host. In fact,
this is the recommended method for backup and recovery of NetApp filers and other appliances that require agentless
backup.
Solaris OS Configuration
The Sun Fire X4540 server used for Amanda Enterprise Edition testing was running the Solaris 10 8/07 OS. This is the
minimum recommended version to use because various ZFS improvements were introduced in this build.
The Sun Fire X4540 server is powered by up to 8 CPUs operating at 2300 MHz and provides 48 SATA drives with total
capacity close to 50 Tbyte in a 4U enclosure. The two boot drives are mirrored using Solaris Volume Manager with
UFS. The rest of the drives are available for backup data.
Zpool Configuration
The decision about how to configure zpools needs to be based on a number of factors:
What is the required performance needed (IOPS/throughput)?
What is the required data protection level needed (RAIDZ, RAIDZ2, mirror)?
What is the required capacity?
After gathering and analyzing the requirements, a configuration that balances the needs of those requirements can be
chosen.
When configuring the system for network backups, the ability of the Sun Fire X4540 server to receive data over the
network is also a factor. For example, a 500-Mbyte/sec backup speed requirement cannot be met solely by using the
four pre-installed Gigabit Ethernet network ports. Additional network cards would be required to accommodate such
throughput.
Sun Fire X4540 Server as Backup Server for Zmanda's Amanda Enterprise 2.6 Software
-
8/14/2019 zmanda_sfx4540
8/19
-
8/14/2019 zmanda_sfx4540
9/19
5 Configuration Sun Microsystems, Inc.
c1t7d0 AVAIL
errors: No known data errors
First, we created the RAIDZ2 pool zmanda with six drives. Then we added six more drives and verified that we had a
pool with 10.9 Tbyte of physical space. Depending on which RAIDZ configuration you choose, the actual available
capacity might be different. See the zpool(1M) man page for more details.
The next step was adding two spare drives. Lastly, we checked the pool status and verified the availability of the
zmanda pool for configuring ZFS.
RAIDZ2 is a natural choice for a backup server, which contains information vital to business operations. RAIDZ2 can
survive up to two drive failures, regardless of whether they are due to corrupt data coming off the drives, a physical
failure of the drives, or drives that are missing. With a suitably large number of disks, RAIDZ2 should not impose a
greater penalty in capacity or performance than RAIDZ.
ZFS Configuration
The Sun Fire X4540 backup server is configured to write to virtual tapes on disks called vTapes in Amanda
terminology. For this sample installation, we chose to put all the Amanda vTapes on a single ZFS file system. On a
system where multiple backup sets might be running simultaneously, it would be advantageous to have separate ZFS
file systems and pools for each backup set, in order to spread reads and writes around the available disks.
For Amanda Enterprise Edition, you do not gain any advantage by having each individual vTape volume in a backup set
on its own file system or pool, because Amanda Enterprise Edition writes to or reads from only one vTape volume at a
time in each backup set.
Example of ZFS file system creation:
bash-3.00# zfs create -o mountpoint=/var/lib/amanda/vtapes zmanda/vtapes
bash-3.00# zfs list
NAME USED AVAIL REFER MOUNTPOINT
zmanda 203K 7.13T 49.0K /zmanda
zmanda/vtapes 49.0K 7.13T 49.0K /var/lib/amanda/vtapes
Amanda Enterprise Edition Configuration
The Sun Fire X4540 server is configured as a backup server. To install the Amanda Enterprise Backup Server with
Zmanda Management Console (ZMC), follow these overall steps, which are explained in more detail in subsequent
sections.
1. From the Blastwave web site, download the required dependency packages for running the Amanda Enterprise
Backup Server and ZMC on the Solaris 10 OS for systems with Intel or AMD OpteronTM processors, and then
install the packages.
Sun Fire X4540 Server as Backup Server for Zmanda's Amanda Enterprise 2.6 Software
-
8/14/2019 zmanda_sfx4540
10/19
6 Configuration Sun Microsystems, Inc.
2. From Zmanda Network, download the binary for Amanda Enterprise Edition for the Solaris 10 OS on Intel and
AMD Opteron processors, e.g.: http://network.zmanda.com/shop/home.php?cat=1 .
3. Extract the binary package and run the Zmanda Rapid Installer to install Backup Server and ZMC Edition.
4. After the installation is complete, the ZMC welcome page is displayed, and you can begin configuring backup
sets.
Installing the Required Dependencies
The required dependency packages can be obtained from the Blastwave web site at
http://blastwave.network.com/csw/stable/i386/5.10/ .
Once the packages have been downloaded, use the pkgadd(1M) utility to install the packages in the following order:
1. CSWcommon
2. CSWzlib
3. CSWiconv
4. CSWexpat
5. CSWggettext
6. CSWreadline
7. CSWgtar
8. CSWlibidn
9. CSWosslrt
10.CSWoldaprt
11.CSWzlib
12.CSWcurlrt
13.CSWlibnet
14.CSWsasl
15.CSWcurl
16.CSWsunmath
17.CSWmtx
(OPTIONAL: Install MTX [magnetic tape driver] if you are going to back up to a tape changer, library, or VTL)
18.CSWfindutils
19.CSWgfile
Installing the Amanda Enterprise Backup Server
The installation program for the Amanda Enterprise Backup Server is called the Rapid Installer.
The Rapid Installer contains both the Amanda Enterprise Backup Server and client, as well as the Zmanda
Management Console web user interface.
Note:The following tasks must be performed as super user (the root user).
Sun Fire X4540 Server as Backup Server for Zmanda's Amanda Enterprise 2.6 Software
http://network.zmanda.com/shop/home.php?cat=1http://blastwave.network.com/csw/stable/i386/5.10/http://blastwave.network.com/csw/stable/i386/5.10/http://network.zmanda.com/shop/home.php?cat=1 -
8/14/2019 zmanda_sfx4540
11/19
7 Configuration Sun Microsystems, Inc.
To run the Rapid Installer, first make sure that the binary file is executable:
# chmod +x amanda-enterprise-2.6.3-installer-S10-intel.bin
If you are installing from within a graphical environment, simply run the installer by
double-clicking it or executing it directly from the command line:
# ./amanda-enterprise-2.6.3-installer-S10-intel.bin
If you are installing from a text console or remotely (for example, using SSH) you can run the Rapid
Installer in text mode:
# ./amanda-enterprise-2.6.3-installer-S10-intel.bin -mode text
The Rapid Installer then starts. Follow the on-screen instructions. The installer performs several tasks after creating
and populating the Zmanda directories. These tasks are completed after the progress bar (which tracks only the
archive extraction) shows 100% completion. These tasks take time. Please wait until they are completed.
The following packages are installed:
Amanda Enterprise 2.6.3 Backup Server
Amanda Enterprise 2.6.3 client for the server
Zmanda Management Console with MySQL, PHP, Apache, PHPmyadmin, Perl, and various Perl modules and
their dependencies. These items are installed under the /opt/zmanda/amanda directory.
Note: After installing Amanda Enterprise Backup Server, make sure that the amandabackup user has permissions to
read and write in the /vtapes directory. Amanda Enterprise Backup Server on the Solaris 10 OS requires theamandabackup user to modify crontab entries on the server. Please add the amandabackup user to the
cron.allow configuration file.
Zmanda Management Console
In addition to a powerful command line interface (CLI), Amanda Enterprise Edition also provides ZMC.ZMC is a browser-based user interface for setting up and managing all backup and recovery activities. It is integrated
with the Zmanda Network, which provides certified Amanda Enterprise binaries, white papers, demos, technical
support, and a knowledge base to help you to deploy your backup solution.
ZMC provides context-sensitive help and the most current information about Amanda Enterprise Edition from theZmanda Network. After registering with the Zmanda Network, you will be notified of new software releases through
RSS feed.
Sun Fire X4540 Server as Backup Server for Zmanda's Amanda Enterprise 2.6 Software
-
8/14/2019 zmanda_sfx4540
12/19
8 Configuration Sun Microsystems, Inc.
ZMC provides you with an easy-to-use tool for managing all backup and recovery operations for multiple clients and
various databases. Using ZMC, a backup administrator can accomplish all day-to-day backup activities, such as:
Configure backup policies, schedules, and clients
Verify configuration and client-server communications
Start immediate backups
Monitor Amanda Enterprise Edition activities and access reports about backups and media
Create, edit, and delete backup users and backup sets
Restore files
Configuring Backup Sets
To get started with Amanda Enterprise Edition, you need to configure backup sets first. A backup setis a key policy
concept of Amanda Enterprise Edition that simplifies and optimizes the enterprise-wide backup system with multiple
clients protected in a similar way.The backup set defines the following:
List of hosts, applications, directories, excluded files, and other details of what to back up
Tape of media (disk, tape, VTL, Amazon S3) used to back up a given backup set
Backup time and parameters for backup-level scheduling
Each backup client belongs to at least one backup set. Backup sets are easy to copy, add, and modify. There are several
templates for common backup policies to help you get started with Amanda Enterprise Edition, such as:
Back up to disk
Back up to a single tape drive
Back up to a tape changer
Back up to Amazon S3
All backup, reporting, monitoring, and restore actions are performed on the backup sets. This enables the backup
administrator to abstract the backup policies and apply the same policy for multiple clients.
For this certification, we configured a backup set called test with five clients. You configure backup sets on the
Backup What page, shown in Figure 2. Figure 2 shows adding a Solaris backup client to a backup set. On this page, you
can also select encryption and compression for a client and specify what types of files to exclude from a backup.
Sun Fire X4540 Server as Backup Server for Zmanda's Amanda Enterprise 2.6 Software
-
8/14/2019 zmanda_sfx4540
13/19
9 Sun Microsystems, Inc.
Figure 2. Backup What Page
Figure 3 shows the Backup What page configured with five clients.
Figure 3. Backup What Page With Five Clients
The next step is to configure vTapes on the Backup Where page.
Sun Fire X4540 Server as Backup Server for Zmanda's Amanda Enterprise 2.6 Software
-
8/14/2019 zmanda_sfx4540
14/19
10 Sun Microsystems, Inc.
Configuring vTapes
When the Media Type of the backup set template is Disk, the vTape options shown in Figure 4 are presented.
Figure 4. Backup Where Page for Configuring vTapesDestination DirectoryThis field is the directory where the backup images will be stored, specified as a URI (in other words, the specification
must begin with file://).
By default, ZMC fills in the field with file://var/lib/amanda/vtapes/ . The
/var/lib/amanda/vtapes directory was created and verified as a part of the Amanda Enterprise Edition
installation and must exist. The subdirectory is created when you set up the backup set.
Different backup sets can use the same disk as a target as long as they are provided with separate directories.
The amount of free space available to hold backup images is an important consideration for fast retrieval of data. To
ensure effective restore capabilities, set aside sufficient disk space to hold more than one full backup set worth of
data. How many full backup sets you should keep on disk depends on the data and your site's requirements for quick
restores of accidentally deleted data. The more full backup images stored, the longer the retention of accidentally
deleted files. Start with enough space to hold three full backup set images and adjust this number as experience
dictates.
Number of SlotsThis field corresponds to the number of vTapes of the size specified previously that will be used to hold the backup
images.
Sun Fire X4540 Server as Backup Server for Zmanda's Amanda Enterprise 2.6 Software
-
8/14/2019 zmanda_sfx4540
15/19
-
8/14/2019 zmanda_sfx4540
16/19
12 Sun Microsystems, Inc.
Figure 6. Calendar View of Recent Backup Reports
Each backup run (successful or not) results in a report with details about all clients scheduled for that run, including:
List of all clients and applications in that backup run
Backup levels for each backup set
How much data for each client was backed up
Compression ratio achieved
Backup anomalies, such as errors and other unexpected events (for example, missing client)
This Summary Report is stored in ZMC and is sent by email to selected users. In case of a warning or an error, the
report provides a link to a relevant article in Amanda Enterprise documentation. You can configure Amanda Enterprise
to receive backup reports by email.
Media reports provide a visual overview of media utilization and performance, which helps you understand your data
growth, identify backup performance bottlenecks, and plan for when to add more media.
You can customize the reports to slice and dice your data. Specifically, you can monitor success and failures, backup
performance, compression, amount of data written, and many other parameters. The reports can be saved, for
example for compliance purposes, or exported into your dashboard monitoring application and analyzed for time
trends.
Sun Fire X4540 Server as Backup Server for Zmanda's Amanda Enterprise 2.6 Software
-
8/14/2019 zmanda_sfx4540
17/19
13 Sun Microsystems, Inc.
Recovery Using the Zmanda Management Console
As with backups, recovery using ZMC is based on a simple workflow:
Determine what data should be restored (restore what)
Determine where the data should be restored (restore where)
Run the restore process (restore)
Using the Restore What screen (shown in Figure 7), you select what to restore. This selection can be as simple as a
single file, database, or directory or more complex, such as all directories and files under a single directory.
Alternatively, you can start the restore process by clicking a time-stamp link included in any backup report. Cross-
platform recovery allows you to recover, for example, backups from a Solaris client on a Linux host.
Figure 7. Restore What Page
In the example in Figure 7, one of the five clients used for our certification is selected for recovery.
The Restore Where page is used to select where the data is to be restored. One of the key features of Restore Where is
to prevent potential conflicts in restoring data. If the existing files match the files to be restored, Restore Where can
be configured for the following options:
Keep existing files
Overwrite existing files Rename existing files
Rename restored files
Finally, the Restore page is for initiating the restore process. This is where the settings can be checked, and where
prompting for media is done (if required). Once ready, you start the restore process and monitor the progress until
successful completion.
Sun Fire X4540 Server as Backup Server for Zmanda's Amanda Enterprise 2.6 Software
-
8/14/2019 zmanda_sfx4540
18/19
-
8/14/2019 zmanda_sfx4540
19/19
15 For More Information Sun Microsystems, Inc.
Other resources:
Sun Fire X4540 server web site: http://www.sun.com/servers/x64/x4540/
BigAdmin Storage Resource Collection:http://www.sun.com/bigadmin/collections/storage.html
Sun Storage web site: http://www.sun.com/storagetek/index.jsp
Storage Stop Blog:http://blogs.sun.com/storage
Events of interest to users of Sun products:
Worldwide developer events and Sun Tech Days: http://developers.sun.com/events/
Current events: http://www.sun.com/events/index.jsp
Licensing InformationUnless otherwise specified, the use of this software is authorized pursuant to the terms of the license found at
http://www.sun.com/bigadmin/common/berkeley_license.html.
Sun Fire X4540 Server as Backup Server for Zmanda's Amanda Enterprise 2.6 Software
http://www.sun.com/servers/x64/x4540/http://www.sun.com/bigadmin/collections/storage.htmlhttp://www.sun.com/storagetek/index.jsphttp://blogs.sun.com/storagehttp://developers.sun.com/events/http://www.sun.com/events/index.jsphttp://www.sun.com/bigadmin/common/berkeley_license.htmlhttp://www.sun.com/servers/x64/x4540/http://www.sun.com/bigadmin/collections/storage.htmlhttp://www.sun.com/storagetek/index.jsphttp://blogs.sun.com/storagehttp://developers.sun.com/events/http://www.sun.com/events/index.jsphttp://www.sun.com/bigadmin/common/berkeley_license.html