architecting next generation enterprise network storage

IMEX©2000-2005 IMEX Research All rights Reserved

IMEXRESEARCH.COM

Architecting Next Generation

Anil Vasudeva Principal Analyst & President [email protected]

Enterprise Network Storage


Agenda

Strategic Storage PlanStrategic Storage Plan

Managing Hurdles (Knowledge, Budget, Management)

Data Protection Data Protection

Issues (Existing Techniques/Pains)

Techniques (Mirroring, Snapshots, Replication, CDP)

Lowering TCOLowering TCO

Tiered Storage (Aligning Cost of Stg. w Value of Data)

Standardization/Interchangeability (Investment Protect,Virtualize)

Autonomics (Lights Out Management)

FuturesFutures

Information Classification & Mgmt (Reference Metadata Engines)


Budget MandatesBudget Mandates

CEOs Mandate for CIOs: Do more for less

Migrate to Nex-Gen Infrastructure while protecting existing IT investments

Justify ROI/TCO (Acquisition + Operating Expenses)

Knowledge of Emerging TechnologiesKnowledge of Emerging Technologies

Keeping pace with new technologies, products, standards & management

Avoiding Pain Points - Backing up whole files, despite very little changed

Full restores when only a few bytes need to be put back

ManagementManagement• Managing Hodge-podgy growth and complexity

Standardizing on few configurations to reduce complexity

Establishing Data protection, Business Continuance/Disaster Recovery

ILM/Regulatory Compliance

Implementing Virtualization, Provisioning & Lights-out Storage Automation

Data Storage Hurdles

““Manage your data before it manages youManage your data before it manages you””


Chaos in the Enterprise . . .

Server/OS

Network

Application

Storage

Test

Backup

Disaster Recovery

Database

Financials

TM

D/R plan (MF only)

STK Silos Tape

TM

TM

TM

IBM3090-600JMVS/ESAIMS / ADABAS

BU by FDR Upstream

HPUX 10, 11.0, 11.2 MPE Sybase 11.9, 12

Fujitsu DS90UX P/M

8mm BackupLegato to DLT

IBM ADSM3490

HP OmniBack

SunSolaris 3.2, 3.4, 3.5Oracle 7.5, 8.0

IBM RS6000AIX 4.1, 4.2, 4.3DB2/6000

Compaq ProLiant 2500,5500NT 3.5, 4.0 SQL

Cheyenn e to 4mm

Batch

IBM AS/400OS/400

InventoryExchange

CAD/CAME-commerce

Lotus NotesOLTP

CICS

File transfers AIX to HP/UX via Platinum 9.9

FTP between Sun - NT

Database extracts MVS to SP2 via MQ Series 4.4

PeopleSoft

(1) Scales poorly (2) Difficult to manage (3) Reliability is questionable (4) Management costs out of control


Data Explosion

0

1

2

3

4

5

6

7

8

9

10

2003 2004 2005 2006 2007 2008

Peta

byte

s of

Sto

rage

0

5

10

15

20

25

30

Stor

age

Reve

nues

$B

PB NormalPB with Accelerators*

*Realtime Data, VoIP, HPC, Grids, WebServices/XML

Storage Revenues


DataCenter Automation Targets

Servers Utilization

ServersServers/Admin

StorageTerabytes/DBA

NetworksNtwk Ports/Admin

SystemAvailability

20-25%80+%

15-30500+

1TB100TB

50-100500+

HAL- 3 (99.9%)

HAL- 5 (99.999%)

NowTargeted

Data: IMEX Research 2004


Market Segments by Applications

*IOs per sesond for a required response time ( ms)

(RAID - 0, 3)

500100MB/sec101 505

1K

10 K

100

10

1

eCommerceeCommerceTransaction Transaction ProcessingProcessing

OLTPOLTPOLTP

Data Warehousing

Visual DB

DSS(RAID - 1, 5, 6)

IOPs

(L

aten

cy)

StreamingStreamingStreamingAudioAudio

VideoVideo

Scientific ComputingScientific Computing

ImagingImaging

HPCHPCHPC

TPC

HPCHPC


Storage Data -Types & Characteristics

• High $/GB • Low $/GB

• Milliseconds

• Moderate $/GB

• 1/10thsec to sec

Online Offline/VaultedMidline Nearline

• Med to Low $/GB

• Minutes to hours • Hours to days

Res

pons

e Ti

me

Current Business Critical Active data Hi-transaction data

Aged, Reference data - Images, records, BU emails Unalterable - regulatory

Centralized backup- Disk-to-Disk-to-Tape Staging to tape

% O

nD

isk

• 50% • 35% • 15% • Tape

Recoverable DataReference Data Buffered Data Dynamic DataArchived for BC/DR- Local, - Remote

Pric

e

Source:Maxtor


Tiered Storage for Data Life Cycles

Age of Data/Freq. of Access

Migrate back to high performance if need be

Restored from tape if need be

Spee

d of

Acc

ess/

Freq

uenc

y of

Cha

nge

Backup & Restore SW

Volatile Data

Fixed Data

Tape Archive


Corporate Data Usage

Nea

rline

Stor

age


GoalsGoals• Operational Resilience

– Designing HA systems to meet RTO (a function of both type of failure & recovery technology deployed)

• Business Continuance– Designing Reliable Data Copy

systems to meet RPO (point in time to which data reverts to after an outage & recovery)

• Disaster Proof Processes (Including planned outages)

• Understanding Business Needs– Time to get back online– Critical Tier 1,-2,-3 applications– Max sustainable downtime

Data Protection

Recovery TimeObjective

RTOT-1 T0 T+1

Time at which Data Integrity last known

Time at which

Disruptive Event

Happens

Time at which

Recovery is Complete

Recovery Point Objective

RPO

Recovery Point

http://images.google.com/imgres?imgurl=http://www.oldemillhouse.com/catalog/images/ballwatchclock.jpg&imgrefurl=http://www.oldemillhouse.com/catalog/images/&h=350&w=350&sz=17&tbnid=fF6q8lZddIQJ:&tbnh=116&tbnw=116&hl=en&start=12&prev=/images%3Fq%3Dclock%26svnum%3D10%26hl%3Den%26lr%3D%26rls%3DGGLD,GGLD:2004-36,GGLD:en%26sa%3DN


Data Protection Technologies

Archiving Archiving

BackupBackup

MirroringMirroring• Asynchronous, Synchronous

SnapshotsSnapshots• Delta Snapshots, Full Snaps/Split

Mirrors

ReplicationReplication• Offsite Tape Storage, Host- Host,

Array-Array• Network based

CDPCDP

Archiving

Continuous Data Protectn

Snapshots

Traditional Backup

Mirroring


Enterprise Data

Center

Departmental Small Medium Business

(SMB/SME)

Workgroup

Desktop SOHO and Mobile

Existing Deployed Storage Networks (Block and File) Scalability

“SAN in a Can” (Block & File) Simplified Use and Install

Low Cost Min. Features Easy to Use Self-Installable

Performance and capacity alone are no longer distinguishers attributes between enterprise and distributed storage

NASFile

(NFS & CIFS)

Convergence

Multi-Protocol

& Interface

Storage Market Requirements

IP SAN (Block or File)

(iSCSI)CO

ST

FUN

CTI

ON

S

FC SAN, IP SAN (Block) (FCP & FICON)


Disk Storage Systems Market

DAS: -10%0

5,000

10,000

15,000

20,000

25,000

2003 2004 2005 2006 2007 2008

Rev

$M

SAN

DAS

NAS

SAN: 13%

NAS: 15%

cagr


End to End Internet

Web

Web

Web

Web

Web

Web

Web

Web

Data CenterApplicationsEdge

Directory Security Policy Management

Software OS Platform

AppApp

AppApp

AppApp

AppApp

DBDB

DBDB

DBDB

IP Storage Network

FC SAN IP SAN NAS NAS

InternetCoreOptical

Edge

HA, Secure Data Center

http://images.google.com/imgres?imgurl=www.thomas-pr.com/136/photos/TP-200%2520kiosk.jpg&imgrefurl=http://www.thomas-pr.com/136/photos/tp200.html&h=2450&w=2011&prev=/images%3Fq%3Dkiosk%26start%3D20%26svnum%3D10%26hl%3Den%26lr%3D%26ie%3DUTF-8%26oe%3DUTF-8%26sa%3DN


3 Tier Computing Infrastructure

Uniform and ubiquitous physical Connectivity – “Wire Once”

Any user to any server via Internet

Any server to any server via the LAN

Any sever to any storage via the SAN

Dynamic Logical Binding of…

server network identification

server OS version

server application assignment

application data volumes

Resulting in

Application Mobility across servers

Data mobility across storage

ApplicationEnd-Users

Tier –1 Network Services:

- Web Servers, - Firewalls,

- Load balancers

Tier-2 Application Services:

- Application Servers

Tier-3 Data Base Services

- Database Servers- Storage

Storage

Internet

LAN

SAN


The iSCSI SAN

To Other LANs,Servers or IP SANs

Ethernet Header CRCIP TCP DATA

Client requests data from App Server

Ethernet CRCHeader IP

TCP iSCSI SCSI DATA

iSCSI-equipped App Server (“initiator”) requests data from an iSCSI storage (“target”)

Storage Arrays(iSCSI Target)

Application & DB Servers

(iSCSI Initiator)

Client Workstations

SAN GigE

Switches

LANEthernet Switches


iSCSI on roadmap of storage vendorsC

OS

T

SERVICE LEVEL

High EndHigh End FC & iSCSIFC & iSCSI

MidMid--TierTier NAS & iSCSINAS & iSCSI

MidMid--TierTier FC & iSCSIFC & iSCSI

EntryEntry FC & iSCSIFC & iSCSI

SAN(Fibre

Channel)NAS

(IP)iSCSI

(IP)

•iSCSI delivers low-cost Networked Storage–Higher availability,Increased usage

–Centralized management,Storage functionality


iSCSI SAN market on fast track

WW SAN Revenues

$-

$500

$1,000

$1,500

$2,000

$2,500

$3,000

$3,500

$4,000

$4,500

2001A 2002A 2003E 2004E 2005E 2006E

$M iSCSI

IB

Fibre Channel


Tiered Storage Devices by Price/Performance

Drive Interface

Drive Types

FC Drive

FC RAIDSAS RAID

Dual-PortSAS

SATA Drive

PC Chipset

5400 RPM7200 RPM

SATA

SAS HBA/RAID

SASSAS

SAS Drive

10K RPM15K RPM

SAS HBA

SATA

Dual Mode SAS/SATAHBA & RAID

ServersMidline Storage

Mainstream NAS/SAN

Large Enterprise SAN & NAS

Desktop PCEntry NAS

Workstations


Future: IP Storage Management on a chip

Host Services Integration StorageProvisioning Layer

IP SAN Management Layer

Appliance Service Layer

File system monitoring

IP SAN ManagementManagement

ConsoleManagement of

iSCSI HBAsMultiPath IO Supp

and FailoverSecurity

(iSNS, CHAP, SRP)

Virtualization Mirroring Snapshot Fail-Over

iSCSI Target ManagementLVM, Error Handling, SCSI Daemon, API Interoperability

HW Acceleration: TOE, iSCSI Offload, IPsec

Storage provisioning Win, LINUX, Solaris


System Cost vs. High Availability

S/390MVSIBM Propl

S/390MVSIBM Propl

Bull Dell Fujitsu HP IBM NEC Siemens Stratus

Bull Dell Fujitsu HP IBM NEC Siemens Stratus

IBMIBM

Sun-SolarisHP-UXIBM-AIXNCR-SVR4

Sun-SolarisHP-UXIBM-AIXNCR-SVR4

Prop.

AS400

WinUNIX

Cluster Win

DowntimeHrs./Syst/Yr

99.999% 99.9% 99.0%

$10K

System Availability99.99%

0.1 101 100

Avg.Syst

Price

$100 K

$1 M

$10 M

z/390

z/390Sysplex

ClusteredUNIX

Clustered LinuxLinux


Application-Driven Storage Virtualization

Moving from storage associated with

servers...

ApplicationApplicationApplication

...to storage associated with application

processes

New Model Allows applications to move storage from the

virtualized pool, wherever they may be

Old Model Server Hardware is the

initiator. Storage Drives are the Target


Storage Sub Systems

Application & DB Servers

Clients

SAN

LAN Ntwk Mgmt WS

Storage Mgmt WS

Mgmt WS

Intelligent Uniform IP-based

Infrastructure

Present Data Center Infrastructue Future Infrastructue

Holy Grail - Future Intelligent IP Infrastructure

architecting next generation enterprise network storage

Technology