education applying ilm principles to reduce ... - snia-dmf.org fileeducation applying ilm principles...

EDUCATION

Applying ILM Principles to Reduce Costs in the Data Center

Edgar St.Pierre, EMC2Version 7This is a temporary field to track iterations.

Version 7Version 7This is a temporary field to This is a temporary field to track iterations. track iterations.

EDUCATION

Applying ILM Principles to Reduce Costs in the Data Center - Property of SNIA© 2005 Storage Networking Industry Association. All Rights Reserved. 2

SNIA Legal Notice

• The material contained in this tutorial is copyrighted by the SNIA.

• Member companies and individuals may use this material in presentations and literature under the following conditions:– Any slide or slides used must be reproduced without

modification– The SNIA must be acknowledged as source of any

material used in the body of any document containing material from these presentations.

• This presentation is a project of the SNIA Education Committee.

EDUCATION


Storage Network Industry Association

• SNIA is the trade group for storage networks– “ensuring that storage networks become complete and trusted solutions across the IT

community”– http://www.snia.org

• SNIA’s “Dictionary of Storage Networking Terminology” online resource– http://www.snia.org/dictionary

• SNIA’s Data Management Forum, and its ILM Initiative, is an excellent information resource for data and information lifecycle management

– http://www.snia.org/dmf

• Information on the Institute and an online version of the tutorial cross reference is available at http://www.snia.org/tech_center/institute/

EDUCATION


Agenda Outline

At the end of this presentation, you will understand:At the end of this presentation, you will understand:Why ILM MattersWhy ILM MattersHow to build a compelling business case for ILMHow to build a compelling business case for ILMHow ILM principles can be applied How ILM principles can be applied todaytodayHow to reduce costs with ILM How to reduce costs with ILM todaytodayHow ILM will help you in the futureHow ILM will help you in the future

EDUCATION


Definition of ILM

The policies, processes, practices, services and tools used to align the business value of information with infrastructure from the time information is created the most appropriate and cost-effective through its final disposition. Information is aligned with business requirements through management policies and service levels associated with applications, metadata and data.

ILM is a standards-based, business-driven management practice

EDUCATION


Value Proposition for ILM

1 2 3 4 5

$10.00

$X

Today = > $20 per GB

Implementation Phase

Without ILM

REDUCE THE TCO of Storage

With ILM

EDUCATION


ILM Principles

Information is data with contextInformation runs the businessInformation is your competitive advantage

The business unit understands informationAnd its value – or cost if it is missing

The infrastructure will become a utilitySo ultimately, it’s all about the data

ILM enables growth of resources & processesAutomation of processes & infrastructureBusiness driven

EDUCATION


An ILM Framework for the DatacenterAn ILM Framework for the An ILM Framework for the DatacenterDatacenter

Bus

ines

s Fr

amew

ork

Bus

ines

s Fr

amew

ork

Business Business ProcessProcess

Def

ine

Def

ine

Data Management ServicesData Management Services

Network Network InfrastructureInfrastructure

Compute Compute InfrastructureInfrastructure

Storage Storage InfrastructureInfrastructure

IT InfrastructureIT Infrastructure

Info

rmat

ion

Policies, Instrumentation, FiltersPolicies, Instrumentation, Filters

Goals ManagementGoals Management

RequirementsRequirements

Business RequirementsBusiness Requirements

Information Management ServicesInformation Management Services

ApplicationsApplications

ILM

Fra

mew

ork

ILM

Fra

mew

ork

Req

uire

men

tsR

equi

rem

ents

Input RequirementsRegulatoryCorporate guidelinesInformation ServicesBudget

Rationalize GoalsApply policiesBalance Risk vs. CostDeliver cost-effective infrastructure

Manage the dataMonitorAdjustReport

EDUCATION


ILM Roadmap

Enterprise ILMPhase 5 • Heterogeneous interoperability • Standard practices across multiple sites

Automated ILM IslandsPhase 4 • Automate with ILM Management tools

ILM Solution StacksPhase 3 • Operate to ILM practices per SLAs

Standardize Data & Storage ServicesPhase 2• Classify data against SLOs• Tier storage & data services

into consistent configurations in support of SLOs

Consolidate Data Services, Implement Network Storage• FoundationPhase 1

Time

EDUCATION


Why Classify DataAlign data requirements and storage servicesAlign data requirements and storage services

Data Classification enablesData Classification enablesMore efficient storage utilizationMore efficient storage utilizationConsolidated Operational Recovery practicesConsolidated Operational Recovery practicesConsolidated Disaster Recovery practicesConsolidated Disaster Recovery practicesArchiving to meet compliance needsArchiving to meet compliance needs

Build a business caseBuild a business caseImproved alignment of IT with business prioritiesImproved alignment of IT with business prioritiesReduced hardware costsReduced hardware costsImproved utilization & managementImproved utilization & managementReduced footprint Reduced footprint Improved environmental resource utilizationImproved environmental resource utilization

Practiced by many IT thought leaders todayPracticed by many IT thought leaders todayIn various phases of definition & implementationIn various phases of definition & implementationCornerstone for ILMCornerstone for ILM

EDUCATION


A Methodic Approach

BusinessCase Analysis

Architect &Design

Implement& Operate

Quality& Knowledge

• Business & IT Alignment Map

• Architecture Requirements Defined

• Operational Policy & Process Model

• Data Classification Policies defined

• SLA Validation & IT Services / Data Classification Menu

• Integration Roadmap

• To provide Corporation with the necessary business and IT services

• Financial projections, financial metrics, and assessment of contingencies and risks

• Engage stakeholders: Gain support across the corporation to enter into an ILM driven initiative to reduce costs thru consolidation and operational improvements

• Project Implementation and Integration

• Consolidation of Operational & System Objects

• Business Case Metrics Validation & TCO Model Completion

• Data Policy Model Validation

• Test, Measure & Validate

• Training & Skills Competency Model

• Professional Certification

• Quality Assurance Program

• Corporate & Market Communications Program

Stage 1 Stage 2 Stage 3 Ongoing

EDUCATION


Stakeholder Communication

Business Priority

Compelling Event (s) Major Initiatives Major Risks Measurement

CEO Market Share Competitive Pressure National Expansion Cost vs. Revenue

Expectations

Bottom Line Profitability over the

next Qtr.

CFO Meet Compliance Regulatory Matter Corporate Compliance Program Audit

Documented Requirements &

Records

CIO Reduce CostsApplication Upgrades /

Technology shifts

Business Case Analysis / Resource

training

TCO & ROT* / Resource

misalignment

Lower costs by 15% in 1st YR

LOB VPApplication

Availability & Performance

Meet Development Timelines Launch New Product Late to market Meet Project

Requirements

LOB VP Provisioning & Capacity

Significant Data Growth

Operational Policies/Services

Catalog

Alignment of Expectations, Costs

to Bus.

Defined/Priced Services Menu

LEGAL Data Retention & Retrieval Audits

Regulatory Compliance (SOX

etc.)

Prioritizing the right Data

Defined Retention Periods

*ROT = Return on Time

EDUCATION


Understanding Risk & Impact

Low riskQuantified Short term

Low riskQuantified Short term

Higher riskSpeculative

Long term

Higher riskSpeculative

Long term

Hard benefitsHard benefits Soft benefitsSoft benefitsImpactImpact

CostReductionand/orRevenueIncrease

CostReductionand/orRevenueIncrease

$2M reduction in IT costs in year one

Defined Data Management Model supports 20%+ reduction in storage costs New Application launches

Improved by 3X

Business ContinuityProgram in place

Compliance/Regulatory program defined/tested

Future markets identified for growth enabled

New IT Services Menu

Major productivity increase from IT staff

New OfferingsDefined & In Development

Improved customersatisfaction

EDUCATION


A Methodic Approach


Architect &Design

Implement& Operate

Quality& Knowledge

• To provide Corporation with the necessary business and IT validation model


• Engage stakeholders: Gain support across the corporation to enter into an ILM driven initiative to reduce costs thru consolidation and operational improvements















• Corporate & Market Communications Program√

2-4 Weeks 4-6 Weeks 6+ Weeks Ongoing

EDUCATION


What is Data Classification?

Process & policies to define service requirements for dataAllows IT to create multiple service level offeringsAllows LOB to select services based on value of dataMay use software to enable some of the process

Represent corporate requirements:Security officer: Secret, confidential, proprietary, …Records Manager: retention time, …Compliance officer (HIPAA, SOX, …): authorization, retention, …

Represent LOB requirements:Application performance, availability, recoverability, …Staff response time, asset reporting, …

IT Organization needs data classification:Method to rationalize requirements into service level offerings

EDUCATION


Pre-Data Classification:Many infrastructure silos

Business

LOB

Applications

Easier for LOB to understand; but higher TCOEasier for LOB to understand; but higher TCO

EDUCATION


With Data Classification:Standard Configurations

Business Applications

LOB

SLA 1 SLA 2 SLA 3 SLA 4

Improved service levels and/or lower TCOImproved service levels and/or lower TCO

EDUCATION


How is Data Classified?

Data Policies, SLOs & Data Classification are tightly coupled

Classify by applicationAll data assigned same classificationSimple; good start; a first approximationNet effect: ranking of applications to services

Classify by groups of dataProduction dataArchive dataCompliance data

Classify by metadataTime last accessed, owner, etcE.g., HSM for a file server

Classify by informationContent-driven alignment of data and SLOs

EDUCATION


Tiers of Service

Define Service Level Agreement frameworkClass of infrastructureAvailability requirementsData ArchivalData RecoveryHelpdesk functionsOthers …

Focus on what level of service is required for dataNot on how it is deliveredTechnology changes, service levels don’t

Only create SLOs that are important to your business

EDUCATION


Use SLOs relevant to yourbusiness (1)

Mission Critical Business Critical Business Important Development

Availability 99.99% 99.9% 99% 97%

Unsched. Downtime < 1 hour/year < 10 hours/year < 100 hours/year No commitment

Advanced Notice 2 weeks 1 week 2 days None

Dependencies Requires SLA1 for all SLA 1 or 2 for storage

Requirement SLO Group SLO Group SLO Group SLO Group

Planned Downtime < 1 hour/month < 2 hour/month < 8 hours/month Intermittent

Accessibility High performance Standard Economy Offline

Throughput Performance-optimized configuration Default configuration Cost-optimized configuration

Mixed

Up to 10% of current file system allocation within 4business days

File

N/A

Migrate Offline No access in n days No access in n days No access in n days N/A

Offline import response time

< 30 minutes100 requests/ week

< 45 minutes100 requests / week

2 hours50 requests / week N/A

N/A: must import from offline

Migrate to Economy No access in n days No access in n days N/A

Compute Style (choice) Read-intensive, write-intensive, or mixed

Read-intensive, write-intensive, or mixed N/A: must import from offline

Threshold based Automated provisioning

Up to 20% of current fileSystem allocation within 1business Day

Up to 20% of current filesystem allocation within 2business days

Up to 10% of current offline allocation within 1business Day

Data Access (choice) Block Block or File N/A

EDUCATION




Site DR Immediate Fast Standard Non-critical

RTO 15 minutes 1 hour 8 hours 24 hours

Recoverable images Point-in-time only Two 13 weekly, 7 daily 4 weekly, 7 daily

Retention N/A – Point in time only 24 hours Daily: 30 days; Weekly: 52 weeks

Daily: 7 days; Weekly: 13 weeks

Protection success rate 99.999% 97% 90% 90%

Dependencies Requires DR SLA3 fallback and SLA1 Accessibility

Requires DR SLA3 fallback and SLA 1 or 2 Accessibility


RPO 1 hour 12 hours 48 hours 96 hours

Operational Recovery Immediate Fast Standard Non-critical

8 hours

24 hours

Application or file

Recoverable images 12 2 One onsite; others offsite One onsite; others offsite

Retention 48 hours 48 hours Same as DR SLA 3 Same as DR SLA 4

Protection success rate 99% 95% Same as DR SLA 3 Same as DR SLA 4

Dependencies Require SLA1 Accessibility SLA 1 or 2 Accessibility

RTO 15 minutes 1 hour 24 hours

RPO 4 hour 8 hours 24 hours

Granularity Application only Application or file Application or file

EDUCATION




Helpdesk Platinum Gold Silver Bronze

Restore from backup response time

< 30 minutes100 requests/ week

< 45 minutes100 requests / week

2 hours50 requests / week

4 hours50 requests / week

Forecasting Monthly Quarterly Yearly Yearly

Incident classification andnotification

Sev. 1 < 15 minutesSev. 2 < 30 minutesSev. 3 < 1 daySev. 4 < 1 day



Sev. 1 < 25 minutesSev. 2 < 40 minutesSev. 3 < 1 daySev .4 < 1 day

Asset reporting tosupport chargeback

Weekly Bi-weekly Monthly Monthly


Security Public Internal Confidential Secret

Classification Level

Compliance HIPPA SEC 17a4 Sarbanes-Oxley None

Compliance categories

EDUCATION


A Methodic Approach


Architect &Design

Implement& Operate

Quality& Knowledge



• Support a decision to enter into an ILM driven initiative that will reduce costs thru consolidation and operational improvements















• Corporate & Market Communications Program√


EDUCATION


Inactive Data Consume Resources

Often 80% of all stored files have not been accessed in last 30 daysPrimary storage of inactive data is increasingly costly and inefficient

Estimate based on analysis of 1995-2004 industry reports and field experience.

20% “active” data estimate from “Five Ways to Manage Your Data Storage”, Kristine Russell, Health Management Technology

0500

1000150020002500300035004000

1995

1996

1997

1998

1999

2000

2001

2002

2003

2004

Inactive DataActive DataG

igab

ytes

Typical Enterprise Data Growth

80%

20%

80%Inactive Data

Active Data

EDUCATION


Tiers of Storage

Many ways to implement:Static

Deploy n-tiers of storage in data centerAssign application to most appropriate tier

Staged data migrationDeploy n-tiers of storage for one applicationBatch data movement between tiers Example: offline archives

Dynamic data movementDeploy n-tiers of storage to one applicationAutomate data movement between tiers (example: HSM)Driven by defined Data Policy

EDUCATION


Dynamic Data Movement

Open systems: this is not just HSM anymore!Application integrated and business-driven:

Files (unstructured data)Tried and true HSM between multiple tiers of online disk-based storage, tape, optical, etc., with application transparencyNext generation data movement without HSM recall requirements

Databases (structured data)Both native and 3rd party solutions migrate transactions from production to historical storage with application transparency

Email & Messaging (semi-structured data)All email servers support interfaces that allow external management of email storage with user transparency

Policy-based: all support many policy types for data movement between tiers

Data Policies drive data movement policiesTime, user, content, etc.

EDUCATION


Tiers of Storage & Improved Service Levels

• Full backup to tape takes 10 hours

– 80% inactive reduces to 2 hours!

• Full recovery takes 15 hours

– 80% inactive reduces to 3 hours!

EDUCATION


Other Opportunities

Operational RecoveryImproved Service Levels

E.g., Near instant restore using snapshots, CDPReduced Costs

Consolidation of available servicesDisaster Recovery

Improved Service LevelsDeliver network capacity to data that needs it

Reduced CostsDon’t mirror all of an application’s data

HelpdeskImproved Service Levels

Set expectations among staff and businessReduced Costs

Do more with same or fewer resources

EDUCATION


A Methodic Approach


Architect &Design

Implement& Operate

Quality& Knowledge



• Support a decision to enter into an ILM driven initiative that will reduce costs thru consolidation and operational improvements















• Corporate & Market Communications Program√ √


EDUCATION


In the end: Satisfy the LOB & Make company successful

Value Measurement for IT

Decrease costs

Improve operations

Increase revenues

Help customers

Simplify LOB / IT Interactions

Low * Med * High

LOB Importance

Our Ability to Deliver

LOB Importance


LOB Importance


LOB Importance


LOB Importance


Help LOB to…Illustrative

EDUCATION


More on Tiers of Technology

Check outSNIA Tutorial:

ILM: Using Data Classification &Tiers of Storage


ILM: Using Data Classification &Tiers of Storage


Fixed ContentManagement


Fixed ContentManagement


Data Protection I


Data Protection I


Data Protection II


Data Protection II

EDUCATION


Please send any comments on this tutorial to SNIA: [email protected]

Many thanks to the following individuals for their contributions to this tutorial:

Alex AdamopoulosNik SimpsonEdgar St.PierreDan Tanner

EDUCATION

Appendix: Bonus Slides

EDUCATION


ILM Initiatives Support The Business

Business PrioritiesBusiness Priorities CorporateGovernance

Changes

CorporateGovernance

ChangesBusiness PrioritiesBusiness Priorities

Meet RequiredRegulatory

Requirements

Meet RequiredRegulatory

RequirementsBusiness PrioritiesBusiness Priorities

Support SOXCompliance

Program

Support SOXCompliance

Program

Application& System

Performance

Application& System

Performance

UndefinedData Policy

Model

UndefinedData Policy

Model

IncreasedBC/DRCosts

IncreasedBC/DRCosts

InformationGrowth 100XInformation

Growth 100X



DataPolicy Model

DataPolicy Model

DataClassification

DataClassification

OperationalPolicy

OperationalPolicy

IT Value toThe BusinessIT Value to

The BusinessSecure all

InformationSecure all

InformationDrive IT

OperationalExcellence

Drive ITOperationalExcellence

Business InitiativesBusiness Initiatives

IT PrioritiesIT Priorities

IT InitiativesIT Initiatives

Issues, Hurdles, RisksIssues, Hurdles, Risks

ILM InitiativesILM Initiatives

EDUCATION


Acme Data Classification MenuMission Critical Business Critical Business Important Development

RTO 15 minutes 1 hour 8 hours 24 hours

RPO 1 hour 12 hours 48 hours 96 hours

Backup success rates 97% 95% 90% 90%

Archive Policy No access in 90 days No access in 30 days No access in 90 days No access in 180 days

Cost $$$$ $$$ $$ $

Incident classification andnotification




Sev. 1 < 25 minutesSev. 2 < 40 minutesSev. 3 < 1 daySev .4 < 1 day


Availability 99.99% 99.9% 99% 97%

Threshold based Automated provisioning

Up to 20% of current fileSystem allocation within 1business Day

Up to 20% of current filesystem allocation within 2business days

Up to 10% or current filesystem allocation within 4business days

Up to 20%of file systemallocation within 1 businessweek scratch basedallocation

Restore Requests 100 requests/ week 100 requests / week 50 requests / week 50 requests / week

Archive access time Seconds Seconds Up to 4 Hours 24-48 hours

Forecasting Monthly Quarterly Yearly Yearly

Asset reporting tosupport chargeback Weekly Bi-weekly Monthly Monthly

EDUCATION


Inactive Data Consume Resources

•• Often 80% of all stored files have not been accessed in last 30 Often 80% of all stored files have not been accessed in last 30 days days •• Primary storage of inactive data is increasingly costly and inefPrimary storage of inactive data is increasingly costly and inefficientficient

Estimate based on analysis of 1995-2004 industry reports and field experience.

20% “active” data estimate from “Five Ways to Manage Your Data Storage”, Kristine Russell, Health Management Technology

0500

1000150020002500300035004000

1995

1996

1997

1998

1999

2000

2001

2002

2003

2004

Inactive DataActive DataG

igab

ytes

Typical Enterprise Data Growth

80%

20%

80%Inactive Data

Active Data

EDUCATION


Tiers of Storage & Reduced Storage Acquisition Costs

•• 5TB on high5TB on high--end storage @ $50 per GBend storage @ $50 per GB–– Cost = $250,000Cost = $250,000

•• If 80% of data is “inactive”If 80% of data is “inactive”–– Migrate 4TB data to lowMigrate 4TB data to low--end disk @ $5/GBend disk @ $5/GB–– Savings to you = $180,000Savings to you = $180,000–– Migrate to tape ($1/GB), savings = $196,000Migrate to tape ($1/GB), savings = $196,000

EDUCATION


Tiers of Storage & Improved Service Levels

•• Full backup to tape takes 10 hoursFull backup to tape takes 10 hours–– 80% inactive 80% inactive reduces to 2 hours!reduces to 2 hours!

•• Full recovery takes 15 hoursFull recovery takes 15 hours–– 80% inactive 80% inactive reduces to 3 hours!reduces to 3 hours!

EDUCATION


Tiers of Storage &Reduced Tape Costs

•• 5 TB full backup to tape @ $1/GB = $5,0005 TB full backup to tape @ $1/GB = $5,000–– Full backup every week with 6 month retention Full backup every week with 6 month retention –– Total annual tape cost = $130,000Total annual tape cost = $130,000

•• Migrate 80% of “inactive” dataMigrate 80% of “inactive” data–– Reduces total annual tape cost to $26,000Reduces total annual tape cost to $26,000

•• Savings to you = $104,000Savings to you = $104,000

Delivers Immediate ROI Delivers Immediate ROI

EDUCATION


Tiers of Networked Storage

FC • For continuous access• Highest reliability & performance

SAS • For continuous access• Highest reliability & excellent performance

SATA • Highest capacity with good online access

MAID • Highest levels of capacity; slightly delayed access• Low footprint & power consumption

CAS • Specialized storage for online access • Regulatory control, single-instance & reference data emphasis

Tape • May be near-line (in library) or offline (shelf or vault) = access delays• “Unlimited capacity” & off-site custody/safety possible• Data not in format or available for failover.

•• Few will implement all or even most levels; most will pick & choFew will implement all or even most levels; most will pick & choose.ose.•• “Level” indicates characteristics, not strict place or value in “Level” indicates characteristics, not strict place or value in hierarchy.hierarchy.•• Innovations will drive characteristics, value, & relative positiInnovations will drive characteristics, value, & relative position changes.on changes.

education applying ilm principles to reduce ... - snia-dmf.org fileeducation applying ilm principles...

Documents