the value of global deduplication

40
© FalconStor Software 2012 · All Rights Reserved Duane Johnson Storage Architect | Solutions Ambassador The Value of Global Deduplication

Upload: falconstor-software

Post on 29-Nov-2014

484 views

Category:

Technology


0 download

DESCRIPTION

Business data continues to grow by up to 60% per year, outpacing both IT budget and staff. This exponential data growth can negatively affect backup windows, system performance, and scalability, all while increasing operational costs. However, there is a solution to this growing problem! Global Deduplication increases efficiency and lowers costs by reducing storage capacity needs and by providing load balancing and high availability (HA), allowing you to efficiently manage your entire storage environment. View this slide deck and watch this webinar recording to learn how your environment can benefit from deduplication. Duane Johnson, FalconStor Storage Architect, discusses why global deduplication is so critical for users with large amounts of data and how it allows them to: - Reduce the amount of storage required to protect data - Ensure faster backup and recovery of data - Utilize low-bandwidth replication for cost-effective protection - Improve the efficiency of data archiving

TRANSCRIPT

Page 1: The Value of Global Deduplication

© FalconStor Software 2012 · All Rights Reserved

Duane JohnsonStorage Architect | Solutions Ambassador

The Value of Global Deduplication

Page 2: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions2

FLEXIBLE DATA DEDUPLICATIONFOR ALL YOUR DATA.

Optimized.

All Your Data.

FalconStor® Virtual Tape Library (VTL) 7.5

Page 3: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions3

Our Business is Protecting Your Business

STORAGE VIRTUALIZATION & DATA MIGRATION

FalconStor® Network Storage Server (NSS)

DATA DEDUPLICATION

FalconStor® Virtual Tape Library (VTL)

FalconStor® File-interface Deduplication System (FDS)

BACKUP & DISASTER RECOVERY

FalconStor® Continuous Data Protector (CDP)FalconStor® Network Storage Server (NSS)

Page 4: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions4 © FalconStor Software 2012 · All Rights Reserved 4

Data Growth.

Page 5: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions5

Global Data Problem, Getting Worse

0%

100%

200%

300%

400%

Digital Universe

IT Budgets

IT Staff

ExplodingVolumes

Budget Pressure

Recovery & Discovery

Remote Office

Volume growing 50-60% per year, slowing DR

Storage growthoutpacing IT budget & staff

Losing information flow halts business

The corporate edge is still unprotected

*Source: IDC

Page 6: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions6

Deduplication Top Trends for IT“Every survey we do identifies that the number one pressure on IT managers is meeting the organization's requirements for more physical storage capacity,"

"Data deduplication technology can greatly reduce the demand for physical storage by identifying and compressing redundant data."

Aberdeen Research

• 67% of leading companies utilize data deduplication technology.• One half of highly performing organizations have virtualized most applications,

providing superior application mobility, provisioning and protection from server failures.

• 57% replicate data to remote locations. • Companies leading in the deployment of virtualization technology employ data

deduplication at three-times the rate of average companies.

Page 7: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions7

Deduplication Spending Still Strong

Source: 451 Group, Gartner and IDC

Page 8: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions8 © FalconStor Software 2012 · All Rights Reserved 8

Deduplication.(Efficient)

Page 9: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions9

Deduplication – Value Proposition

A B C D

Assurance Business Continuity

Cost Containment

Data Growth Management

• Eliminate tape transport for DR

• Improves SLA through direct DR access and faster restore

As simple as A B C D

• Reduce storage footprint

• Reduce power, cooling, and space (OPEX)

• Reduce WAN bandwidth cost

• Reduce IT staff time to manage backup and recovery

• Reduce the amount of storage required for data protection

• Reduce WAN bandwidth requirements by replicating only unique data

• Enable faster backup and recovery

• Eliminate the uncertainty of tape

• Improve the efficiency of data archiving

Page 10: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions10

Major Benefits of Deduplication

• Enables faster backup and recovery of data using disk technologies

• Reduces the amount of storage required to protect data • Purchase less hardware (reducing capital expenses)• Reduces the network bandwidth required to transfer data• Minimizes IT staff time to manage and supervise data

storage, backup, and recovery• Realigns staff time, allowing focus on more important projects• Improves the efficiency of data archiving• Reduces power, cooling, and space requirements for data

storage

Page 11: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions11

Backup TCO Equation• Throughput; Scalability, High Availability, Load

Balancing• High Data Growth (10-30%) breaks backup

– Deduplication helps– Adding infrastructure helps– Creates more points of management

• Global Deduplication – “the ability to manage multiple deduplication nodes as one”– Throughput; Scalability; High Availability; Load Balancing– Improve efficiency, reduce administration overhead– Tie back to lower cost, ease-of-use, performance and

scalability

Page 12: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions12 © FalconStor Software 2012 · All Rights Reserved 12

Global Deduplication.(More Efficient)

Page 13: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions13

Confusion of Global Deduplication

• Application – All application data no matter the source is deduplicated in the same repository

• WAN Optimization – Replication of only one copy of data no matter how many remote location copies

• Clustered nodes – Shared deduplication repository– If a node fails, all can still be restored – A need for scaling - data reduction efficiencies continue to be

obtained – no silos of storageThe FalconStor Deduplication Solution provides all of these features and benefits of TRUE GLOBAL Deduplication

Page 14: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions14

Application Deduplication

Virtual Machine Repository

Database Backup Utilities

Standard Network Backup

W: \\Archive\PowerPointW: \\Archive\legal W: \\Archive\code buildsW: \\Archive\medical

Oracle RMAN

Nearline Archive and Data Migration

NetBackup,Backup Exec,

Legato, BakBone,

Commvault, CA, etc.

Mimosa,Archiver,Arkivo,SmartMove,etc.

Page 15: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions15

WAN OptimizationMulti-site WAN efficient replication for cost effective DR

Local deduplication

Data repository

Central site

WAN

Remote sites

Only deduplicateddata over the WAN

Global deduplication

Page 16: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions16

Node 2

Clustered Node - Global Deduplication

Repository

Storage

Node 1 Node 2 Node 3 Node 4 Standby

VTL

Active Deduplication Nodes

Node 1 Node 8

Data repository

Page 17: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions17

Why Global Deduplication• Reduce Cost

– Increase efficiency, lower physical storage cost– Increase overall dedupe ratio

• Ease of Implementation– Silo’s increase management cost and impact administration overhead– Eliminate need to load-balance backup at the application layer

• Improves backup/recovery– Even large single nodes do not perform as well as multiple global dedupe nodes– Throughput, not capacity, causes customers to purchase more silo appliances– Inline dedupe requires scheduled defragmentation, impacts restore performance

• Better integration with existing backup process– Doesn’t matter which node does backup or dedupe– Without global dedupe, need to introduce a process to divvy up large backup jobs

• Scalability– Better scalability as customer data and performance requirements grow– No concern about where and what you need to do with a backup as you scale

• Availability– FalconStor VTL includes HA, no concern about single point of vulnerability

Page 18: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions18

Backup Server

Virtual Library

Virtual Library

Virtual Library

Backup Server

iSeries Server

Direct Tape Out

LTO-1

DLT

AIT

DDSLTO-4

Tape Consolidation

Multi-Export

Tape Encryption

Tape Shredding

iSCSI

High speed backup VTL/Deduplication Cluster

Comprehensive Media Management

Virtual LibraryOpen Storage

8 Gb FC

FalconStor Global Deduplication Architecture

Page 19: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions19

Breaking The Barriers With v7 Data Deduplication

2 PB of usable deduplication

repository

FalconStor VTL

(Block)

Physical tape for long-term archive

Oracle R-Man

SQL Backtrack

Business Applications

NFS/CIFS/OST

Archive and Migration

Backup,

Virtual Machine

Repository

FalconStor FDS(File)

Mainframe

FC/OST

Independent scalability of compute and storage resources

Page 20: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions20

FalconStor Replication Advantages

VTL Storage Appliance

VTL Storage Appliance

Replication (FC/IP)

• Consolidate multiple sites into one repository• Move only unique information across

the wire• Full AES 256 Encryption

DR site

VTL-VA on ESX

Deduplication N+1 HA cluster

(Up to 4 active nodes)

VTL (Up to 8 nodes)

Active-Active failover

Data Center

Physical Tape for long-term archive

Global Deduplication

Page 21: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions21

Case for Global Deduplication

• Greater than 10-20TB requires Global Deduplication• 10-20TB over 12 hours = 230-460 MB/sec performance• Example: 140TB Data Center

– 7 servers, 20TB each– 12 hour backup windows– Distributed weekly full– Incremental 6 servers (avg 5-10%) = 1-2 TB/server = 6-12TB

• Nightly backup requirement 26-32 TB/night• Performance requirement 700-888 MB/sec (2.5-3.2 TB/hr)• This would require 3-4 silo target appliances• One Scalable/HA FalconStor VTL/SIR Cluster Solution

Page 22: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions22

A Need for Global Deduplication

• Data is growing too fast and users cannot meet backup windows or restore fast enough to meet SLA

Data Growth Management

• Need to control acquisition and operating costsReduced Cost

• Need for scalable performance, load balancing, increased deduplication efficiency, and HAPerformance

• Single unified deduplication repository – higher efficiencyEfficiency

• Eliminates storage silos, and the need to load-balance backup at the application layer, reduces complexityScalability

• Reduce administrative overhead – ease of use, performance, and scalabilityAdministration

Page 23: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions24

Why FalconStor VTL for Global Deduplication• True Global Deduplication• Scales capacity or compute cycles as needed• FalconStor® Single Instance Repository (SIR) performance

scales up to 512TB of managed capacity per node• FalconStor VTL scalability through clustering:

– Up to 8 node cluster with a single point of management– Manages up to 32 petabytes of data in one single cluster– Up to 12 GB/s data ingest rate

• FalconStor SIR scalability through clustering:– Up to 4+1 cluster with a single point of management– Up to 512TB of capacity per node, equivalent to 5PB per node– Up to 2 GB/s of data deduplication speed

• HA – No Single Point of Vulnerability• Seamless Tape Media Management – Direct Tape Out

Page 24: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions25 © FalconStor Software 2012 · All Rights Reserved 25

Optimized.

Page 25: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions26

• Flexible Deduplication– NEW! Inline deduplication

• Decreases storage, reduces overall costs and improves efficiency• Reduces storage requirements by up to 40%

• Inline, Post, Concurrent or None• Flexible and Fast! Optimized!

– Inline 28+ TB/Hour per 4 Node Cluster– Post Process 40+ TB/Hour per 4 Node Cluster

Optimized.

Page 26: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions27

Flexible Deduplication

• Align capacity with business goals – Post/Concurrent

• Higher speed, no impact on backup window

Post/Concurrent

Deduplication

Page 27: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions28

• Align capacity with business goals – Inline deduplication

• Decreases storage, reduces overall costs and improves efficiency

Flexible Deduplication

Inline

Deduplication

Page 28: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions29

Flexible Deduplication

• Align capacity with business goals – None

• For data that does not compress well• Not all vendors allow this

None

Page 29: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions30

Dedupe 3Dedupe 2Dedupe 1

Replicate 1

Backup 1 Backup 2 Backup 3 Dedupe 1 Replicate1

Dedupe 2 Replicate 2

Dedupe 3 Replicate 3

Backup 1 Backup 2 Backup 3 Dedupe 3 Replicate 3

Dedupe 1 Replicate 1

Dedupe 2 Replicate 2

Backup 1 Backup 2 Backup 3

Replicate 2 Replicate 3

Deduplication Methods

Page 30: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions31

Turbo Feature Optimizes Post/Concurrent

Dedupe 1 Replicate 1

Dedupe 2 Replicate 2

Dedupe 3 Replicate 3

Dedupe 3 Replicate 3

Dedupe 1 Replicate 1

Dedupe 2 Replicate 2

Backup 1 Backup 2 Backup 3

Backup 1 Backup 2 Backup 3

Page 31: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions32 © FalconStor Software 2012 · All Rights Reserved 32

Available.

Page 32: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions33

Available.

• Scalable Expansion– Simplifies configuration of a deduplication server– No more fixed sizes, allowing any number of disks to be

added to the system– Single Instance Repository and Cluster Expansion

• Can be configured to easily add nodes (servers)• Example: Expand SIR from 1 node to 2 or from 2 nodes to 4

– Overall investment savings

Page 33: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions34

Available.

• Enhanced Replication – Saves system utilization for business applications– Efficient bandwidth use in LAN and WAN environments

• Ability to compress during replication means faster replication and less storage being used

– Ability to compress backups and metadata

Page 34: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions35

Scalable Without Forklift Upgrades

Our Difference

• Quickly handle data growth • Users start with initial performance

and capacity requirements and can easily expand

• Minimal production downtime• Your Data…Available

0 1 2 3 4 5 6 7

0 1 2 3

4 5 6 7

Before

After

0 1 2 3 4 5 6 7 VTL: Virtual Tape LibrarySIR: Single Instance Repository

Page 35: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions36 © FalconStor Software 2012 · All Rights Reserved 36

Secure.

Page 36: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions37

Secure.

• Peace of Mind that your data is safe– AES Encryption– Tape Shredding– FIPS Support– Full Replication Encryption

Our Difference

• Safety without sacrifice• Fully configurable so your data is

safe in motion• Full encryption• Now with FIPS support• Your Data. Secure.

Page 37: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions38

Resources

• www.falconstor.com/vtl– One stop shopping location for everything on FalconStor VTL– Demo, datasheet, download and more!

Page 38: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions39

FLEXIBLE DATA DEDUPLICATIONFOR ALL YOUR DATA.

Optimized.

All Your Data.

[email protected]

Page 39: The Value of Global Deduplication

Copyright © 2012 FalconStor Software · All Rights Reserved

FalconStor VTL v7.5 Deduplication Solutions40

Next Steps

• For more information visit:– Website: http://www.falconstor.com/VTL– Solution Videos: http://www.falconstor.com/videos– Contact Sales or Local SE: [email protected]

• Watch a Demo!– http://www.falconstor.com/demos

Page 40: The Value of Global Deduplication

© FalconStor Software 2012 · All Rights Reserved

Contact usCorporate Headquarters

2 Huntington QuadrangleMelville, NY 11747

USATel: +1 631.777.5188

Support: +1 [email protected]

Asia Pacific Headquarters6F-1, No.521, Sec. 1, Wunsin Rd.

Taichung 40848Taiwan

Tel: [email protected]

European Headquarters58 rue Pottier

78150 Le ChesnayFrance

Tel: [email protected]

Thank You &Questions?

[email protected]