digital archiving business benefits, challenges, and best practices christine rogers principal...

Digital ArchivingBusiness Benefits, Challenges, and Best Practices

Christine RogersPrincipal Product Manager

Oracle, StorageTek Archive SolutionsSeptember 30, 2014

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |


Program Agenda

Archiving Benefits

Deploying an Archive

Archive Success Stories

1

2

3


Archiving• Access strategic content

– Permanent record of fixed content– Allows for collaboration and global sharing of archive data

vs. Backup• Restore lost or corrupted content

– Business Continuity – day-to-day restores of applications, user files, emails, etc

– Disaster Recovery – massive restores of disk arrays, server nodes, or entire data centers


Factors Driving The “Keep Everything Forever” Mindset Today’s Archives

Digitization

Business OpportunityCompliance & E-Discovery

Preservation

Data Growth


Title-Only LayoutOracle Digital Archive Benefits

Lower Costs

Improve Efficiencies

Unlock Value

Save up to 80% on overall storage costs

Lower administrative burden with set and forget automated archive policies

Easily leverage your data through online file access


Lower Backup Costs: Save 5x on Software and 4x on StorageSave 80% by Archiving Rarely Used Data

$2,550,000

$640,000


Tiered Storage Drives Down Archive Costs

26xTiered Storage

Save

through

http://www.oracle.com/us/corporate/analystreports/industries/clipper-tco-storage-2013-1959019.pdf




Oracle Storage Archive AutomationEase Administrative Burden & Unlock Data Access

Tape Archive

Primary Disk

Disk ArchiveSt

anda

rd P

OSI

X Fi

le S

yste

m A

PI

Appl

icati

ons


How Do I Deal With?Oracle Solves Common Archive Concerns

1. Total cost of ownership and storage efficiency

2. Meeting retention requirements / infinite retention requirements

3. Managing data growth and complexity

4. Surviving tech refreshes and data migrations

5. Ensuring data protection, integrity and security

6. Maintaining access to data as applications become obsolete


ORACLE STORAGETEK DIGITAL ARCHIVE

SEAMLESSAutomated and Tiered Storage Provides Lowest TCO

PROACTIVE Intelligent Monitoring Ensures Data Access

FUTURE-PROOFLimitless Capacity and Performance for Worry Free Growth


Tape Archive

Primary Disk

Disk Archive

Tiered Storage Digital Archive

SeamlessHierarchical Storage Management, Automated Policies & Data MigrationOpen Formats


StorageTek Storage Archive Manager

Hierarchical Storage Management

Enterprise Scalability

Automated Data Movement

Polic

ies

To M

ove

Dat

a

High Availability

FlashDiskTape

Open Formats


Highest Scalability Hundreds of SAN clients Hundreds of file systems Billions of files Petabytes of disk cache Exabytes of archive

Enterprise Scalability and Performance

Fast Performance For large files sizes, existing

customers can ingest >5 GB/s For small (100KB files), ingest rates

of up to 10,000 IOPS have been observed


High Availability

• Automatic Failover– SAM servers are clustered with

automatic failover between servers

• Maintain Access to Data– Active server always has access

to primary disk cache, archive disk, and tape archive layers

Clustered StorageTek Storage Archive Manager Servers


FILE INDEX

Backup / Archive Software Not Required

FILE

Digital Tape Written with Open Format

Simplify File Access

Open Archive Formats Simplify File AccessOnly the tape is needed to retrieve the file


Horizontal Scalability: tape ingest performance improved 10x!• Use QFS clients for archive and

staging to/from tape

OpenStack Swift support for object based storage• Create private clouds

leveraging tiered storage

Automated Data Integrity Validation with Self-Healing• Supporting LTO5,6 and

T10000C,D drives

LTFS import / export support

New Advancements


ProactiveIntegrity Throughout Your Data’s Lifecycle

Data Write

Data Integrity ValidationTape Analytics Health

Analysis

Periodic Media Scan

Media Validation

Data Read

2

3

Data Integrity Validation

Records & Checks CRCs

1

4

Checks CRCs

Application


StorageTek Tape AnalyticsMonitoring Every Exchange in the Archive

Tape Analytics Analyzes Over 150 Exchange Health Attributes


When NERSC Scanned 24,000 Tapes (15 Million Meters) in Their Digital Archive… 99.99993%

Was Read Error FreeSource: Mark Peters, ESG Technology Brief, http://www.oracle.com/us/corporate/analystreports/corporate/esg-nersc-case-study-202702.pdf

National Energy Research Scientific Computing (NERSC)

REAL WORLD

EXAMPLE

How Reliable is Tape?

http://www.oracle.com/us/corporate/analystreports/corporate/esg-nersc-case-study-202702.pdf


How do we move to 100% Data Integrity?Since the NERSC study, Oracle has introduced:

STORAGETEK DATA INTEGRITY VALIDATION


Intelligently Stream Data to the Archive

• Archive Manager creates a CRC (T10 ANSI standard) for each record

• StorageTek T10000C/D checks CRC as each record is received

• The CRC of each record is written to tape with that record

• When a record is read from tape the CRC is always checked

StorageTek T10000 Tape Drives

StorageTek Data Integrity Validation

Records have CRC added at host

Records Sent to Tape with CRC

Record CRC checked; write

and read


• Schedule media validations to check the integrity of inactive media

• Data is kept inside library and tape drive

• Results of validation are sent to host

• StorageTek Storage Archive Manager can be set to self-heal

• Automatically select media to verify based on– Tape Analytics Health

Indicator– Date Since Last Accessed– Random Sampling– VOLSER Range– Newly Entered

• Select Type of Scan– Basic Verify (~1 minute)

• Validate the cartridge Media Information Region (MIR)

– Standard Verify (~15-30 minutes)

• Validate two upper and two lower data wraps on tape

– Complete Verify (~1 hour/TB)

• Validate entire contents of tape cartridge

– Complete Verify Plus (1+ hours/TB)

• Validate entire contents of tape cartridge, including DIV CRCs

Automated Media Validation


CUSTOMER PERSPECTIVE“We chose Oracle’s StorageTek solutions over the competition because no other company can offer the same tape storage density, data integrity validation and data assurance technology.”

Jake Carroll, Senior Information Technology Manager

COMPANY OVERVIEW• Leading center for neuroscience research• Industry: Education and Research• Employees: More than 300

CHALLENGES/OPPORTUNITIES• Improve productivity and enhance scientists’

confidence• Eliminate disruption to research activities caused by

system failures • Ensure compliance with stringent research funding

conditions

SOLUTIONS• StorageTek Storage Archive Manager• StorageTek SL3000 Modular Library System• StorageTek Tape Analytics

RESULTS• Enhanced the safety and reliability of valuable

research data• Retrieved data 66% faster• Slashed daily metadata backup time by 99%• Guaranteed sufficient storage and reduced costs

Queensland Brain Institute Increases DataResponse Speeds by 66%


Disk

SL8500SL3000

SL150

ZS3

FS1

750 TB

850 PB

50.3 PB

Future ProofIndustry Leading Capacity, Performance and Availability

3.5 PB

2.9 PB


High Availability

• Scale Non-disruptively• Service Non-disruptively• Replication and Mirroring• Online Data Migrations• End to End Data Integrity Validation

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 27

Front Porch Digital’s Content Storage Management Solutions are Purpose-Built for Large-Scale Rich Media

SAMMA

Emmy Award-winning migration process for converting content fromanalog to digital, for production, monetization, or preservation

DIVASolutions

Protect, manage, store,and deliver rich media,

in an integrated and streamlined workflow

LYNX

Media-grade privatecloud solution, enablingan integrated networkfor all digital content

distributed worldwide

• Simplifies the complex workflows inherent with migrating, managing, and distributing media assets

• Redefines archiving with instantaneous asset access and control on a technology-agnostic integration platform

• Leverages the scale and cost advantages the cloud offers via secure, private networks

• Automatically captures and migrates analog and digital audio and video


Combination of Oracle and Front Porch Digital Addresses the High-Performance Needs for Rich Media

DIVA LYNX

SAMMA

• Seamless and optimized rich media workflows increase lifetime value of digital content

• Integrates with 150+ technology partners for advanced orchestration and distribution

• Manage data growth on premise and in the cloud

Oracle Technology – Database, Java

Engineered Systems, Servers, Storage Oracle Web Center

Industry Leading Performance and Scalability

Optimized to work together to deliver enterprise-grade,high-performance for complex requirements

Automated asset management, archival, and distribution for efficient content monetization

On-premise or in the cloud, ensures content availability anytime, anywhere


CUSTOMER PERSPECTIVE“Oracle’s StorageTek T10000D tape drive delivers a tremendous competitive advantage for us. We can write 1.5x faster and each drive stores nearly 3.5x more data than our legacy system did—enabling us to purchase one tape library instead of three and to reduce operating costs.”Andy Hurt, Senior Information Technology Manager

COMPANY OVERVIEW• Leading center for neuroscience research• Industry: Media and Entertainment• Employees: More than 100

CHALLENGES/OPPORTUNITIES• Deploy highly available, affordable, and scalable

storage solutions to support the company’s cloud-based, media-content-storage management platform—LYNX

• Build a storage environment that can scale easily and cost-effectively to meet individual client needs and provide a competitive advantage for the rapidly growing media-storage-solutions provider

SOLUTIONS• StorageTek T10000D Tape Drives• StorageTek SL3000 Modular Library System• StorageTek Tape Analytics

RESULTS• Delivered high capacity and performance solutions for

storing 60 TB of media content delivered daily by customers

• Reduced management costs, and increased data reliability and access

• Reduced IT investment and operating expenses, such as data-center power and cooling costs

Front Porch Digital Reduces Operating CostsLeveraging StorageTek Libraries and Drives


The World’s Largest Archives rely onOracle StorageTek


Title-Only Layout

Lower Costs

Seamless

Improve Efficiencies

Proactive

Unlock Value

Future-Proof

Archiving With Oracle StorageTek


Learn More About Oracle’s Storage Solutions

• "New Medical Records Management Requirements: Healthcare Record Consolidation" – Monday, 2:45-3:30pm at the

Intercontinental

• “OZDLRA: A New Era in Data Protection" – Monday, 3:00-3:45

• "Oracle Zero Data Loss Recovery Appliance: Deployment Best Practices", – Tuesday, 3:45-4:30, Moscone

South – 305

• "The Storage Forum at Oracle OpenWorld 2014“– Wednesday, 3:30-6pm at the

Cityview @ Metreon

• "Maximize Data Value Through Extreme Scalability and Accessibility“ – Wednesday , 2-2:45pm at the

Intercontinental

• "Engineered System Disaster Recovery and Backup-and-Recovery Best Practices– Thursday, 12-12:45 at the

Intercontinental

Monday Tuesday Wednesday/Thursday

digital archiving business benefits, challenges, and best practices christine rogers principal...

Documents

oracle andor

global sharing of archive

automated archive policies

data growth

obsolete slide

archive costs http

data migrations

data protection