- neustrelitzkonferenz-nz.dlr.de/pages/storage2012/present/2. konferenztag/09... · functionality...

Evolution und Trends der Storage Technologien

Christian BanduletPrincipal Sales Consultant15/06/12

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

christian.bandulet@oracle.com

Oracle’s Complete Storage PortfolioEngineered for Oracle Software

SSD F20 F5100

Tape and Virtual Tape

SL8500SL3000

LTOT9840

T10K SL24/48

NAS Storage

Flash Storage

SAN Storage

Axiom 600ZFS StorageAppliances 6000/2500

series

Storage Management: OEM, ASM, DTrace Analytics, CAM, ACSLS, ELSAutomated Tiering: Partitions, SAM QFS, Hybrid Storage Pools, VSMData Reduction: 11g ACO, EHCC, RMAN, ZFSSA Dedup/CompData Protection: Data Guard, RMAN, OSB, ZFSSA Snap/Rep, MaxRepSecurity/Encryption: ASO, Oracle Key Manager, Disk/Tape Encryption

Storage Software

Best-of-breed Compute, Storage, Network, Software

Simplicity, Return of Investment

HIGHER

Oracle’s Optimized Solutions(Reference Configurations)

Efficiency: From Best-of-Breed to Engineered Systems... and from Applications to Storage

A typical n x m DC-Architecture requires● n*m Product Skillsets● n*m Management Requirements● n*m Availability and Security Concepts● n*m Product Lifecycles & Service Contracts● mn Solution Stacks

Layer 1

m Products

Layer 2

Layer n

Integration, Lifecycle Mgmt.

•Are your DC Architecture 'n' & 'm's ● affordable?● sustainable ??● necessary to support your Business ???

Typical Public Cloud Complexity● One Stack

IT Diversity drives Complexity and Cost80% of IT Budget is spent on Maintenance, with Integration being the Lion Share

HIGHER

Engineered Systems

SPARC SuperCluster

Engineered Systems – The Family

• Expedited time to value• Easier to manage and upgrade• Lower cost of ownership

ExalyticsExadataDatabaseMachine

ExalogicElastic Cloud

Database Appliance

SPARCSuperCluster

Big Data Appliance

• Reduced change management risk• One-stop support• Extreme performance

Gartner Hype Cycle for Storage Technologies 2011

• Moore’s Law has out-stripped improvements to disk drive technology by two orders of magnitude during the last decade

• Today’s servers are hopelessly unbalanced between the CPUs need for data and the HDDs ability to keep up

HDD vs. CPU Relative Performance Improvement

2001 2002 2003 2004 2005 2006 2007 2008 2009 2010

Server and Storage Disconnect

Where to Deploy Flash Storage?

HBA/NIC/HCA/CNA

Application

Memory

PCIe CTR

StorageNetworkStorageNetwork

SSDFmod

Fmod DRAM

Where to Deploy Flash Storage?

Where to Deploy Flash Storage?www.nvmexpress.org

Application

Memory

HBA/NIC/HCA/CNA

FmodFmod

•Mapping between SCSI and

NVMe specifications

•End-to-end data protection

(compatible with T10 DIF and DIX)

•Support for I/O virtualization

architectures like SR-IOV

Become More Efficient...

Thick Thin Thinner Green Tape Gone

FullProvisioning

ThinProvisioning

ResourceOptimization:Compression

De-DupSingle

InstancingAuto-Tiering

Low rotational HDDs,

Spin DownMAIDFlash

HSM,Archive

Deletion

Resource optimization facilitates: backup to disk with improved restore times, store on Flash, more frequent backups & snapshots, improved RPO/RTO, replication to DR site, reduction of OPEX/CAPEX, longer retention

times on disk, ...

Prosperity Data Shift...

DRAM Flash PerformanceHDD TapeCapacity

Store Big D

ata forlonger and longer tim

Field Proven Controller Architecture

LoopSwitch

Server

Storage

The Vertical Consolidation• Blurring the line between storage and server

Storage

Server

StorageStorage

ServerServer

Storver

Sun ZFSSA Basic Architecture

Solaris/ZFS

TCP/IP

Adapter Driver

SAS ExpanderSAS Expander

SAS HBA SAS HBA

SAS Expander SAS Expander

Solaris/ZFS

SAS HBA SAS HBA

Intelligent Storage Node

Storage Virtualization - PartitioningMake One Box Look Like Hundred Boxes...

Hypervisor

Guest OSData Service

Hardware

CPU Memory NIC HBA

Guest OSData Service ...

The Clustered/Grid Storage (R)evolution

Storage

DAS NAS SAN ClusterGrid

http://en.wikipedia.org/wiki/Swarm_intelligence

Storage Grid ?

Storage Grid & Data AvailabilityData Placement

Storage Node Storage Node Storage Node Storage Node

Object 1

= Data

= Parity

Object 2

Object 3

Storage Grid

Storage Grid & Data AvailabilityReplication

Storage Node Storage Node Storage Node Storage Node

Object 1

Object 2

Object 3

Storage Grid

Resource Lifecycle Management

Storage Grid

Svc1 Svc1 Svc1Svc1 Svc2Svc2 Spare

Storage Grid - expand

Svc1 Svc1 Svc1Svc1

Storage Grid - repurposed/new services

Svc1 Svc1Svc1

Svc3 SpareNew

Minimal application impactExpand a Storage Grid

Install an elementAuto-discover, bindProvisionRedistribute workload

Decommision elementsDrain dataDe-presentUnbindRetire and de-install

Also applies to replacements/upgrade

Host Host Host Host Host Host Host Host

IB FC IP

I/O RoutingI/O Redirection

Single Storage ImageISD ISD

ISDISD

Remote

Global Namespace

Global Namespace ?

NAS Appliancewith NFSv4.1

pNFS extensions

Global Namespace

NAS Appliancewith NFSv4.1

pNFS extensions

NFSv4.1 + pNFS

NFSv4.1

File: NFSv4.1Block: iSCSI, FCP

one-to-one, stripe, replication, concatenation

Storage Protocol:SCSI, NFS, OSD

Control Protocol

NFSv4.1 client with pNFS

NFSv4.1 client w/o pNFS

Scalable/Clustered NAS with NFSv4.1 pNFS aka NAS Virtualization

NFS Server NFS Server NFS Server NFS Server

Hybrid Storage Cloud Gateway Appliance

Intelligent Storage Node

HypervisorGuest OS

Data Service

HardwareCPU Memory NIC HBA

Guest OSData Service ...

Hybrid StorageGateway

Appliance

- data can be transparently stored locally or de-staged to the cloud- bridge between on-premises storage systems and a cloud storage Service- public cloud storage providers rely on Internet protocols like REST APIs over HTTP

Cloud ?

NIST Definition of Cloud Computing

Cloud Service Models

Application and Data

Middleware

Database

Operating System

Virtualization

Servers

Storage

Networking

IaaS:- Amazon Elastic Compute Cloud (EC2)- Amazon Simple Storage Service (S3)

- Rackspace- Verizon- AT&T

- GoGrid

Middleware

Database

Operating System

Virtualization

Servers

Storage

Networking

PaaS:- targeted at application

developers- developers control

applications not providers- provides runtime/development

frameworks and tools(authentication, session mgmt,

inter-system integrationtransactional integrity, …)

- deployment of user applications- MS Azure

- Google App Engine- Amazon Elastic Beanstalk

Middleware

Database

Operating System

Virtualization

Servers

Storage

Networking

SaaS:- SAP Business by Design

- Salesforce.com- Application Service Provider (ASPs)

- Email, web conferencing,- productivity suites (e.g. word

processing), collaboration

Oracle Cloud – Unparalleled Depth & Breadth

Oracle

… …

Other Providers

… …

• Comprehensive and integrated set of functional apps supported

• Optimized solutions across the entire IT stack

• SaaS Players: Island solutions with limited ability to support functional expansion (SaaS)

• IaaS/PaaS: Layer solutions without end-to-end optimization

From Compute Centers to Data Centers

Compute

Data Data

Data Data Data Data

Compute Compute Compute Compute

Application-Awareness

Server

Application Context

Application

Storage Device

• Application Context:– I/O patterns, data layout, intrusion detection, data

relationships, consumer information, spatial, etc. – e.g. which blocks are stale/empty or belong to a file– e.g. relationships among data, users and applications

Active Storage – Distributed Data ManagementApplication De-compositioning

Storage Device

Application Context

Server

Application Context

Application

• Runs application-specific code– e.g. indexing, search, caching

• Enables adaptive-computing

Application

Ethernet 1, 10 Gbps

InfiniBand

IPTCPFCIP

IPTCPiFCP

Fibrechannel

1, 2, 4, (8), 10 Gbps 10, 20 Gbps

iSCSI FCoE InfiniBand

Data Center Ethernet

SCSI Layer

Operating System / Applications

(1), 10 Gbps

* Includes FC Layer

Encapsulation Technologies

Source: Cisco

InfiniBand Roadmap June'2011http://www.infinibandta.org/content/pages.php?pg=technology_overview

FDR/EDR/HDR/NDR: 64/66 bit encoding; FDR cabling backward compatible with QDR...

“Data is getting BIGGER!!!50%/yr Growth Rate

Source: IDC, White Paper Sponsored by EMC, The Digital Universe Decade - Are You Ready? Doc.# IDC_925, May 2010

*Source: SearchStorage Magazine, July 2011

Fueling the Digital Universe: The Digital Shadow

Source: IDC's Digital Universe Study, sponsored by EMC, June 2011

Y Yotta 10**24 1.000.000.000.000.000.000.000.000 Quadrillion Z Zetta 10**21 1.000.000.000.000.000.000.000 Trilliarde E Exa 10**18 1.000.000.000.000.000.000 TrillionP Peta 10**15 1.000.000.000.000.000 BilliardeT Tera 10**12 1.000.000.000.000 Billion griech. teras, MonsterG Giga 10**9 1.000.000.000 Milliarde griech. gigas, riesigM Mega 10**6 1.000.000 Million griech. mega, großk Kilo 10**3 1.000 Tausend griech. chilioi, tausendh Hekto 10**2 100 Einhundertda Deka 10**1 10 Zehnd Dezi 10**-1 0,1 Zehntel lat. decem, zehnc Zenti 10**-2 0,01 Hundertstel lat. centum, hundertm Milli 10**-3 0,001 Tausenstel lat. mille, tausendμ Mikro 10**-6 0,000.001 Millionsteln Nano 10**-9 0,000.000.001 Milliardstelp Pico 10**-12 0,000.000.000.001 Billionstelf Femto 10**-15 0,000.000.000.000.001 Billiardstela Atto 10**-18 0,000.000.000.000.000.001 Trillionstelz Zepto 10**-21 0,000.000.000.000.000.000.001 Trilliardstel y Yocto 10**-24 0,000.000.000.000.000.000.000.001 Quadrillionstel

e.g. Femtolaser, Femtowaage...

Global Digital Data Growth Growing Leaps and Bounds by 40+% YoY!

Object ID

Data:Structured

Semi-Structured

Unstructured

Metadata owner, permissions, type, last mod. date, ...

Attributes user/application defined

Policies e.g. replication

Methods e.g.encryption

Data For Clouds – File ObjectsA File System Can Handle Any Type Of Data...

Data:Structured

Semi-Structured

Unstructured

Metadata

Traditional Files

FileObjects

Data:Structured

Semi-Structured

Unstructured

Metadata

Attributes

Policies

Methods

ExtendedAttributes

Big Data is a Big Deal

Transactional Data

Decide

Big Data ?

Accenture Technology Vision 2012

Big Data is a Big Deal

Transactional DataBig Data

Decide

- correlate structuredand unstructured data

- capturing a tweetwith a comment

about your productbecomes more valuable

if you can correlateit with you most valuable

customer...

New Data Source - Predicting

What is my customer going to buy in the future?React in real-time...

What has my customer bought in the past?React in low frequency depending on

data warehouse refresh intervals...

e.g. providing a personalized car insurance plan based on your

unique driving behavior

Big Data Technology Continuum

Oracle Products for Big Data Management

HIGHER

Engineered Systems

Oracle’s Complete Storage PortfolioEngineered for Oracle Software

SSD F20 F5100

Tape and Virtual Tape

SL8500SL3000

LTOT9840

T10K SL24/48

NAS Storage

Flash Storage

SAN Storage

Axiom 600ZFS StorageAppliances 6000/2500

series

Storage Management: OEM, ASM, DTrace Analytics, CAM, ACSLS, ELSAutomated Tiering: Partitions, SAM QFS, Hybrid Storage Pools, VSMData Reduction: 11g ACO, EHCC, RMAN, ZFSSA Dedup/CompData Protection: Data Guard, RMAN, OSB, ZFSSA Snap/Rep, MaxRepSecurity/Encryption: ASO, Oracle Key Manager, Disk/Tape Encryption

Storage Software

Evolution und Trends der Storage Technologien

Christian BanduletPrincipal Sales Consultant15/06/12

- neustrelitzkonferenz-nz.dlr.de/pages/storage2012/present/2. konferenztag/09... · functionality...

Documents

how to set up fmod, cocos2d-x, and openal ... - intel ·...

fmod - massachusetts institute of...

für eine intelligente mobilität! urbane mobilität · mit...

archivieren mit hitachi’s content archive platform...

enterprise content management - dlr...

intelligente sensoren für industrie 4 · 2017-08-28 · 1....

schienengipfel 2016 - bahnindustrie · businesscircle.at...

firelight technologies fmod ex - documentation.help ·...

fmod studio case study. its easy reuse common components ...

audio engine programming lecture 4 introduction to fmod...

ember 2016 marktchancen iran - roedl.de · 2. konferenztag,...

samfs bei lufthansa systems inodebegrenzung und...

powerpoint-präsentation -...

fmod designer

campus innovation 2011 und ix. konferenztag studium und...

computer games 2011 - universität...

computer audio/fmod cgdd 4603. why fmod? sound you might...

application engineered storage - dlr...

university of bath · in summary, our results illustrate...

strategietagung die digitale zukunft der versicherungen ·...