new generation software-defined storage · software-defined storage . 1 new software-defined...
TRANSCRIPT
0
New Generation
Software-defined
Storage
1
New Software-defined Storage from Fujitsu
Fujitsu is announcing the second generation
of ETERNUS CD10000 S2 – its software-
defined, hyper-scale storage system.
General availability:
EMEA and Americas – from October 1,
2015
Japan and APAC – end of 2015
Copyright 2015 FUJITSU
2
Introducing ETERNUS CD10000
Software-defined, hyper-scale
storage system
Scalable architecture up to hundreds
of storage nodes / 50+ PB
Based on Ceph open source technology
Appliance approach combining
hardware, software and services
Unified hardware and software
management
ETERNUS CD10000
End-to-end maintenance and support
Object
Access
Block
Access File Access (planned)
ETERNUS CD10000 Unified Management
Ceph Storage Software
ETERNUS CD10000 storage nodes
Copyright 2015 FUJITSU
3
What ETERNUS CD10000 delivers
ETERNUS
CD10000
Unlimited
Scalability
TCO
optimized
Automation
Immortal
System
Zero
Downtime
Copyright 2015 FUJITSU
4
ETERNUS CD10000 vs. Build Your Own Storage
This is an integrated storage system rather than a stack of components.
Based on Ceph open source storage software
Optimized component evaluation, integration and sizing
End-to-end maintenance with consistent updates
Unified management of hardware & software – one system image
Highly automated storage node provisioning or exchange
Adding functionality where Ceph has gaps
Copyright 2015 FUJITSU
5
ETERNUS CD10000 S2 Improvements
Reduces the costs of
exponential data growth
$
01
Provides business
continuity for mass data
02
Shortens time to production
with validated solutions
03
Copyright 2015 FUJITSU
6
ETERNUS CD10000 S2 Improvements
Reduces the costs of
exponential data growth
$
01
Provide business continuity
for mass data
02
Shorten time to production
with validated solutions
03
Copyright 2015 FUJITSU
7
Reducing The Costs of Exponential Data Growth
Allows customers to balance costs,
capacity and performance depending
on use case
Reduces the capacity cost of
redundant data copies
Enables smaller granularity to scale
reducing upfront investment in
unneeded capacity
Increases storage density to store
more data at less space
Copyright 2015 FUJITSU
8
Density Node
4-node
min. configuration
Density Node
42-node configuration
Density Node Flex Node
with 1×
Capacity
Extension
Flex Node
with 2×
Capacity
Extension
Flex Node
with 3×
Capacity
Extension
Flex Node
New Storage Nodes For Different Needs
1 Based on a four storage node configuration, redundant internal network, erasure code, maintenance not included. List prices vary significantly depending on configuration and system parameters
Flex Node
Capacity and performance can be easily
scaled by adding nodes / node extensions
Optional use of PCIe SSDs
Focus: balancing performance and capacity
Density Node
Maximize density with 60 TB in a 1U node
2+ PB in a rack saving data center space
Focus: minimum storage costs and density
92 TB 140 TB 188 TB
~ 0,78 € per GB1 ~ 0,42 € per GB1
Copyright 2015 FUJITSU
44 TB 60 TB 240 TB
… …
2.5 PB
9
Erasure Code Reduces Costs Of Data Redundancy
Optimized Erasure Code developed by Fujitsu contributes to the Ceph open source community
But increased capacity needs
200% overhead for 3 copies
Full copies of stored objects deliver
high redundancy and fast recovery
Creating redundancy with
50% overhead (factor 1.5)
Erasure code uses one stored object plus parity
information (e.g. 4 data chunks + 2 coding chunks)
Ceph Storage Cluster
Object
Erasure Coded Pool
1 2 3 4 x y
Ceph Storage Cluster
Object
Replicated Pool
Copy
Copy Copy
Copyright 2015 FUJITSU
10
Efficiency Gains with ETERNUS CD10000 S2
Up to six times lower costs
per GB with Flex Nodes
Up to 75% reduction in capacity
investment in data redundancy with
Erasure Coding
Up to ten times lower costs
per GB with Density Nodes
Up to ten times higher storage
density with Density Nodes
Compared to ETERNUS CD10000 S1
Up to 50% lower power consumption
with Density Nodes
Copyright 2015 FUJITSU
11
ETERNUS CD10000 S2 Improvements
Reduce costs of
exponential data growth
$
01
Provides business
continuity for mass data
02
Shorten time to production
with validated solutions
03
Copyright 2015 FUJITSU
12
Disaster Resilience With One Stretched Cluster
The Ceph cluster in an ETERNUS CD10000 is stretched to two or more sites
The easiest way to build disaster resilience for storage
Site A Site B
LAN/
WAN
Ceph
Cluster
CD10000
storage
nodes
But: may create latency while waiting for the conclusion of the remote copy write
Object Copy 1 Copy 2
Copyright 2015 FUJITSU
13
New: Disaster Resilience Between Two Clusters
Data from site A are synchronized with site B via gateways
Discrete clusters mean that site A performance is not affected by site B
Read Affinity directs data access to the nearest data copies, accelerating read performance
Site A Site B
LAN/
WAN
Zone 1
Site A
Zone 2
Site A
Ceph
Cluster
A
CD10000 Gateway Node CD10000 Gateway Node
Zone 2
Site B
Zone 1
Site B
Ceph
Cluster
B
CD10000
storage
nodes
SYNC
AGENT
Copyright 2015 FUJITSU
14
New: Backup-in-a-Box
Backup-in-a-Box
Pool based backup
Full, incremental, synthetic full
Pool or object-based recovery
To the original pool or to another
CD10000 storage nodes
Ceph
Cluster
Pool A Backup
Pool Pool B
Copyright 2015 FUJITSU
15
ETERNUS CD10000 S2 Improvements
Reduce costs of
exponential data growth
$
01
Provide business continuity
for mass data
02
Shortens time to production
with validated solutions
03
Copyright 2015 FUJITSU
16
Validated Solutions For Rapid Project Success
ETERNUS CD10000
Object
Access
Block
Access File Access (planned)
ETERNUS CD10000 Unified Management
Ceph Storage Software
ETERNUS CD10000 storage nodes
Open
Stack
Sync
& Share
Online
Archives
Cloud
Backup Validated solutions based on
existing customer scenarios
Enables fast implementation
of software-defined storage for
Copyright 2015 FUJITSU
OpenStack
Enterprise sync and share
Online archives / content depots
Cloud back-up
17
Survey – OpenStack Summit Vancouver (May 2015)
Source: OpenStack Organization, 2015
Ceph is the No. 1 storage platform for OpenStack.
Block Storage Drivers: Production
1%
1%
2%
3%
4%
10%
7%
10%
23%
37%
2%
2%
1%
5%
4%
9%
5%
11%
16%
44%
HP3PAR
Dell EqualLogic
VMWare VMDK
SolidFire
EMC
GlusterFS
NFS
Net App
LVM (default)
Ceph RBD
May 2015 November 14
Copyright 2015 FUJITSU
18
RH
EL
OS
P
PRIMEFLEX for OpenStack
Complete reference architecture for rapid implementation of OpenStack environments
API Clients Dashboard
(Horizon) Cloud Forms
Portal Fujitsu
Catalog Manager
OpenStack Cloud APIs
Physical Infrastructure (PRIMERGY, ETERNUS, Network)
ETERNUS CD
Block RBD
S3 RGW
Object RADOS
Admin
Server
Required
Services
Auth
entication
Keysto
ne
Ima
ge
s
Gla
nce
Obje
ct
Sw
ift
Volu
me
Cin
der
Netw
ork
N
eutr
on
Orc
hestr
ation
H
eat
Tele
metr
y C
elio
mete
r
Compute Nova
Hyperv
isor
KV
M
Hyperv
isor
ES
Xi
Hyperv
isor
Hyper-
V
vCenter W2k12
Puppet,
Foreman
DHCP,
PXE, …
Maria DB
RabbitMQ
Operating System: Red Hat Enterprise Linux
Copyright 2015 FUJITSU
19
ETERNUS CD10000 For Online Archives
ETERNUS CD10000
Object
Access
Block
Access File Access (planned)
ETERNUS CD10000 Unified Management
Ceph Storage Software
ETERNUS CD10000 storage nodes
Online Archives
based on iRODS
Example: University, Germany
Uses iRODS application for library services
integrated with ETERNUS CD10000
Copyright 2015 FUJITSU
iRODS is an open source data
management software in use at research
organizations and government agencies
Organizes and manages large depots
of distributed digital data
Automates data workflows and enables
secure collaboration
20
ETERNUS CD10000 For Sync and Share
ETERNUS CD10000
Object
Access
Block
Access File Access (planned)
ETERNUS CD10000 Unified Management
Ceph Storage Software
ETERNUS CD10000 storage nodes
Sync & Share
based on ownCloud, Seafile
Customer Example: Logistics Company
Runs ownCloud sync and share services for
tens of thousands of users on ETERNUS
CD10000
Runs IT processes on the logistics chain of
partners and suppliers
Customer Example: University
Research institution with >100,000 students
Supports collaboration between students by
running Seafile sync and share solution on
ETERNUS CD100000
Copyright 2015 FUJITSU
21
For backups and archives
Efficient backup as service platform
for internal/external service providers
Using ETERNUS CD10000 As Backup Storage
Two options to implement
Block
S3
Backup Pool
Backup Server
Rados Gateway
Backup Server
10 Gb/s
Media
Agent
Ceph Block
Driver
Media
Agent
S3 API
Copyright 2015 FUJITSU
Access via Ceph Block Device
Access via Amazon S3 API
22
Extending a single cluster
between two sites for flexible
DR with one system
Asynchronous replication
between two discrete clusters
Backup-in-a-box
OpenStack
Enterprise File Sync & Share
Online Archiving
Cloud Backup
New Flex Node provides a
perfect balance of perfor-
mance, capacity and costs
New Density Node offers high
capacity at minimum space
and costs
New erasure code enables
data redundancy with reduced
storage capacity and costs
ETERNUS CD10000 S2 Improvements
$
Copyright 2015 FUJITSU
23
Making
software-
defined storage
rock-solid
ETERNUS
CD10000 S2
24