long live das! - veritasvox.veritas.com/legacyfs/online/veritasdata/3.15pm_1704_long live... ·...

Long Live DAS!

Ryan Jancaitis – Product Management - Symantec

Frank Ober – Data Center Solutions Architect - Intel

SYMANTEC VISION 2014 Long Live DAS! 2

SYMANTEC VISION 2014

1. IDC, Digital Universe study, December 2012 2. IDC, Worldwide Disk-Based Data Protection and Recovery 2012-2016 Forecast, December 2012

1.2ZB

7.9ZB

40ZB

61.8%

THE WORLD’S DATA IN 2010

THE WORLD’S DATA BY 2015

THE WORLD’S DATA BY 2020

UNSTRUCTURED DATA GROWTH RATE TO 2014

The Storage Conundrum

Long Live DAS! 3


Data Center Challenge: A Tier-1 Bottleneck

Tier-1 App Faster/More CPU Faster/More RAM

Faster Internals

10/40/100 GbE InfiniBand

RDMA

IOPs Maxed Wide Stripe

Over-Allocation

Tier-1 != $/IOP Tier-1 = $/GB

Tier-1 Storage

VMAX is a “Capacity Tier” - John Roese, CTO, EMC

4 Long Live DAS!


SSDs are Fundamentally Changing the Data Center

“HDD revenue will stay flat in 2014, with estimates at $32 billion ” – HIS

Long Live DAS! 5

“Worldwide SSD revenue is now expected to grow at a CAGR of 20% for 2012–2017.” – Nov 13 IDC

“SSDs will continue to complement (slower) hard disk drives while replacing the fastest 15,000-RPM drives.” - Gartner

“Worldwide SSD shipments across all market segments are projected to increase by 46% in

2013 and grow at a 31% 2012–2017 CAGR. “ – Nov 13 IDC

“All Flash Array Forecast $1.5 Billion by 2015” – IDC


Any form Factor flash optimization Right $/IOPS with Flash/SSD

Optimize SSD

• App aware Storage Tiering

• Optimize Storage with Compression & Dedup

• Migration to ANY storage

Optimize R+W Performance

• Remove logjams in SAN

• Rely on commodity SAN storage

• Optimize Read & Writes

Enable True DAS

• Mix of SATA & Flash for SLA

• Benefits of SAN in DAS

• Linearly scale as need grows

• Reduce Host protocol overhead

• Enable Scale-out architecture on host

• Migrate to All Flash with ease

Eliminate Host Bottleneck

Less Disruptive

Marginal Benefit

SSD in SAN

High Performance

Expensive SAN

All-Flash in SAN

Lower latency

SAN for efficiency

In-server SSD

SSD closest to CPU

Avoid SAN

Eliminate the SAN

Long Live DAS! 6


PCI Express* SSD vs Multi SATA* SSDs

SATA SSDs advantages

• Matured hardware RAID/Adapter for management of SSDs

• Matured technology/eco system for SSDs

• Cost & performance balance

Quick Performance Comparison

• Random WRITE IOPS: 6 x S3700 = one PCIe SSD 1.6T (4 lanes, Gen3)

• Random READ IOPS: ~8 x S3700 = 1 x PCIe SSD

Mix-Use PCIe and SATA SSDs

• hot-pluggable 2.5” PCIe SSD has same maintenance advantage as SATA SSD

• TCO, balance on performance and cost

Performance of 6~8 Intel S3700 SSDs is close to 1x PCIe SSD

4K random workloads (IOPS)

Measurements made on Hanlan Creek (Intel S5520HC) system with two Intel Xeon X5560@ 2.93GHz and 12GB (per CPU) Mem running RHEL6.4 O/S, Intel

S3700 SATA Gen3 SSDs are connected to LSI* HBA 9211, NVMe SSD is under development, data collected by FIO* tool

0

100000

200000

300000

400000

500000

600000

100% read 50% read 0% read

6x800GB Intel S3700

1x NVMe 1600GB

IOPS

Long Live DAS!


Intel® Data Center Family of SSDs – Why They Matter

9

Feature Benefits Full Data Path Protection Data + Non Data Path Protects against unexpected data corruption throughout the drive

Power Loss Data Protection PLI + PLI check Protects data against unexpected power loss

Intel Developed Controller √ Intel Quality & Reliability

Consistent Performance √ Tighter IOPS and lower max latencies for consistent and

predictable performance

AES 256b encryption 256b Enhanced data protection for data at rest

Max Capacities 800GB – 1.6TB Q2’14 – 2.0 TB Q4’14 Increased capacities for growing storage needs

NAND Technology 20nm & 25nm w/ & w/o HET* Leading edge NAND technology provides a better cost structure

OEM Validation √ Major server OEM qualified, warranted, and serviced

NVMe Protocol PCIe Connection & NVMe Protocol Lowest latency storage driver available! @ 6µs

*Other names and brands may be claimed as the property of others.

Long Live DAS!


Intel® Data Center Family of SSDs

Protect against possible corruption of in-transit and stored data through every element of the SSD

Including SRAM, DRAM, and NAND memory

Starting when the data enters the drive until the point it leaves

Host SATA

Frontend SATA3

Interface CRC

NAND

NAND ECC

LBA Tag Check

Internal CRC

Transfer

Buffer

S/DRAM ECC

LBA Tag Check

Internal CRC

10 *Other names and brands may be claimed as the property of others.

Long Live DAS!



• Power Loss Data Protection Features

Power Failure Detection Circuit

Power Loss Tolerant Charge Storage

Enhanced Firmware Data Safe Mode

Hot Plug Inrush Current Mitigation

http://hardware.slashdot.org/story/13/12/27/208249/power-loss-protected-ssds-tested-only-intel-s3500-passes

11 *Other names and brands may be claimed as the property of others.

http://intel.ly/1ghGULV

Long Live DAS!


















http://intel.ly/1ghGULV



12

• QoS spec is unique to Intel® Data Center SSDs

Specified maximum latency

Better RAID system performance

Consistently high IOPS and low latency

DC S3500: 4K Random Write Workload2

Tight Predictable IOPS

IOP

S

Time seconds

0

5000

10000

15000

20000

0 200 400 600 800 1000

0

5000

10000

15000

20000

0 200 400 600 800 1000

Competitor SSD: 4K Random Write Workload1

Loose Unpredictable IOPS

IOP

S

Time seconds


Long Live DAS!


Intel SSD Labs (Folsom, CA)

13

• ISV-OEM enablement

• Oracle

• SQL Server

• NoSQL

• VMWare

• Hyper-V

• Openstack

• Hadoop, Splunk, Big Data

Big Data and HPC

Virtualization

And Internal Cloud

Direct Attached Storage

Databases and

Applications

Long Live DAS!


SSD in Databases…

• Top DB SSD use cases:

• Log Writer – Traditional & In Memory

• Caches - b-Cache, Intel CAS or TempDB

• MS SQL – Buffer Pool Extension (2014*), Oracle Smart Flash Cache (2010)

• Pure SSD is always the best approach for DB’s

• #1 Industry Trend = movement to In Memory DB’s (IMDB)

• Case Studies

• Symantec White Paper on HA / FSS - http://bit.ly/QhTJzd

• Intel® SSD DC S3700 for Oracle* Log Writer http://intel.ly/1fkobDJ

• Oracle* TimesTen + Intel® SSD DC S3700 http://intel.ly/1ewyjEm

• Aerospike* Acceleration w/Intel® SSD http://bit.ly/1hF8p6w

14

Opportunity for Case Study?


Long Live DAS!

http://bit.ly/QhTJzd

http://intel.ly/1fkobDJ

http://intel.ly/1ewyjEm

http://bit.ly/1hF8p6w


Solid-state proliferation requires data

management efficiency software.

Gartner, 2012

SSD + Software

Long Live DAS! 15

Gartner: Understanding Application Workloads is Understanding SSDs © 2012


Any form Factor flash optimization Right $/IOPS with Flash/SSD

Optimize SSD

• App aware Storage Tiering

• Optimize Storage with Compression & Dedup

• Migration to ANY storage

Optimize R+W Performance

• Remove logjams in SAN

• Rely on commodity SAN storage

• Optimize Read & Writes

Enable True DAS

• Mix of SATA & Flash for SLA

• Benefits of SAN in DAS

• Linearly scale as need grows

• Reduce Host protocol overhead

• Enable Scale-out architecture on host

• Migrate to All Flash with ease

Eliminate Host Bottleneck

Less Disruptive

Marginal Benefit

SSD in SAN

High Performance

Expensive SAN

All-Flash in SAN

Lower latency

SAN for efficiency

In-server SSD

SSD closest to CPU

Avoid SAN

Eliminate the SAN

SmartIO FSS

Long Live DAS! 17


Introducing SmartIO

Volume Manager Read Cache

File System Read Cache

File System Write-Back Cache

• Linux Only in 6.1 • New CLI: sfcache • Granular, Online Control

• I/O Optimization • Application Integration • HCL Independence

• Boot Persistence

Highlights

Long Live DAS! 18


Write-Back Standalone Server

Application

SAN Storage

SF Cache Layer

Write-Back Cluster File System

Application

SAN Storage

CFS Distributed Cache Layer

Write WRITE

Cache Reflection

Lazy Flush

3

1

Lazy Flush

ACK

1 2

3

1

ACK

2

SmartIO Write-Back

Long Live DAS! 19


SmartIO Benefits

Increased Application

Performance

Improved Storage

Utilization

Reduced Storage Costs

Cascaded Performance

Benefits

Bring Data Closer to Application De-Couple IOPs and Capacity

Increase Application Density Maximize Back-end Resources

Long Live DAS! 20


SmartIO: Increased Application Performance

21

Overview

• More than 2x OLTP transactions per minute

• Application Insight

• Oracle

• Sybase

• Adjust heuristics based on workload type

• No Application downtime

• No Application re-architecting

Results

2.5x

Server Dell 820 - 32 Cores - 256 GB RAM

Storage IBM DS8100 – 16 GB Cache – 64 Spindles

SSD 1 TB PCIe

Workload OLTP – 150 Users – 5000 Warehouses – 7

GB SGA

Configuration

Long Live DAS!


SmartIO: Reduced Storage Costs

22

Overview

• Combine “Tier-2” Storage with SmartIO

• Over 2x performance than “Tier-1” array

• 60% Cost Savings

• De-couple IOPs from Capacity

• Reduce infrastructure required to maximize HDD performance

Results

Tier-1

Server Dell 820 - 32 Cores - 256 GB RAM

$13.54/TPM

Storage EMC VMAX – 16 GB Cache –

128x15k RPM Disks

Tier-2

Server Dell 820 – 16 Cores – 128 GB

RAM

$5.78/TPM Storage EMC Cx4 – 16 GB Cache – 80x15k

RPM disks

SSSD 1 TB PCIe

Configuration

Long Live DAS!


SmartIO: Improved Storage Utilization

23

Overview

• More than 2x OLTP transactions per minute

• SmartIO frees up backend:

• Spindles

• Cache

• 2x the workload density on same array

• No performance degradation

Results

Servers Dell 820 - 32 Cores - 256 GB RAM

Storage IBM DS8100 – 16 GB Cache – 64 Spindles

SSD 1 TB PCIe

Workload OLTP – 150 Users – 5000 Warehouses – 7

GB SGA

Configuration

Long Live DAS!


SmartIO: Cascaded Performance Benefits

24

Overview

• Node 1 running SmartIO

• 4x performance improvement

• Node 2

• No SSD

• No SmartIO

• 60% performance improvement

• Reduced workload from Node 1 benefits Node 2

Results

Servers

Node 1 Dell 820 - 32 Cores - 256 GB RAM

Node 2 Dell 720 – 16 Cores – 96 GB RAM

Storage IBM DS8100 – 16 GB Cache

SSD 1TB PCIe

Workload OLTP – 150 Users – 5000 Users – 7

GB SGA

Configuration

Long Live DAS!


Introducing: Flexible Storage Sharing

Flexible Storage Sharing

• Build true DAS cluster

• HDD

• SSD

• Hybrid

• Ease of administration

• Virtualization support

• RDMA Interconnect

• InfiniBand

• Ethernet

• Built on existing technologies

Features

• Reduced Infrastructure • Improved Flexibility • All CFS/SFRAC use cases

Benefits

10GE/IB

Highly Available Applications

Highly Available File Systems

Long Live DAS! 25


Oracle 11gR2 1.4 TB Data Files

2000 Warehouses 100 Users

CFS+Intel: Managed Performance

512GB

80 Cores

Storage Foundation 4.5x SAN performance

20% SAN Cost*

* Pro-rated cost for EMC VMAX 20K using 1/5th of Available Capacity

But… What about redundancy? What about high availability? What happens if hardware fails?

Long Live DAS! 26

3700 Series 800 GB

Redo Logs: 4k 2-way Stripe

Data Volumes: 8k 3-way Stripe


Data Volume: 8k 3-Way

Stripe/Mirror

Redo Logs: 4k 2-Way

Stripe/Mirror


IB

Cluster File System

Oracle 11gR2 1.4 TB Data Files

2000 Warehouses 100 Users

With… Full Data Redundancy Fast-failover capabilities Disaster Recovery App/Server Administrator Control

4x SAN performance

22% SAN Cost*

* Pro-rated cost for EMC VMAX 20K using 1/5th of Available Capacity

Long Live DAS! 27



Long Live DAS! 28

• Do not put redo logs on Solid State Disk (SSD)1 • Although generally, Solid State Disks write performance is good on

average, they may endure write peaks which will highly increase

waits on 'log file sync'

1Document 1376916.1 Troubleshooting: "Log File Sync" Waits


Data Volume: 8k

4-Way Stripe

Redo Logs: 4k Striped

CFS+Intel: Flexible Performance

IB

Cluster File System

Long Live DAS! 29

Performance Configuration

• 577, 000 TPmC

• 700% Improvement over SAN

IB

Cluster File System

Warehouse Configuration

• 1.5 hr Load time

• 2x vs SAN

• 17k QPH

• 4x vs SAN

Data Volume: 8k

2-Way Stripe/Mirror

Redo Logs: 4k 2-way

Stripe/Mirror


Next Steps

Long Live DAS! 30

Community and Blogs (@IntelSSD)

Steve Shaw: (Oracle/Linux) https://communities.intel.com/people/steveshaw/content

Chris Black:https://communities.intel.com/people/ChristianBlack/content

Frank Ober:https://communities.intel.com/people/FrankOber/content

Community and Blogs (@SymantecStorage)

Symantec/Intel Whitepaper

Symantec Connect

Symantec.com

6.1 Trialware

https://communities.intel.com/people/steveshaw/content



https://communities.intel.com/people/FrankOber/content






http://www.symantec.com/content/en/us/enterprise/white_papers/b-storage-foundation-intel-joint-whitepaper-WP-21327636.en-us.pdf

http://www.symantec.com/connect/sfha61

http://www.symantec.com/connect/sfha61

http://www.symantec.com

http://www.symantec.com/storage-foundation/trialware

Thank you!

Copyright © 2014 Symantec Corporation. All rights reserved. Symantec and the Symantec Logo are trademarks or registered trademarks of Symantec Corporation or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. This document is provided for informational purposes only and is not intended as advertising. All warranties relating to the information in this document, either express or implied, are disclaimed to the maximum extent allowed by law. The information in this document is subject to change without notice.

Long Live DAS!

long live das! - veritasvox.veritas.com/legacyfs/online/veritasdata/3.15pm_1704_long live... ·...

Documents