maginatics cloud storage platform - mcsp 3.0 technical highlights

28
Rohit Goyal [email protected] Sr. Technical Marketing Engineer Maginatics Cloud Storage Platform (MCSP) MCSP 3.0 Technical Highlights

Upload: maginatics

Post on 08-Sep-2014

246 views

Category:

Technology


1 download

DESCRIPTION

The 3.0 release of the Maginatics Cloud Storage Platform (MCSP) includes great improvements in Data Protection, Multi-tier Caching and APIs, as well as other significant new features that make Maginatics the ideal choice for enterprise businesses with demanding storage requirements.

TRANSCRIPT

Page 1: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Rohit Goyal [email protected]

Sr. Technical Marketing Engineer

Maginatics Cloud Storage Platform (MCSP) MCSP 3.0 Technical Highlights

Page 2: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Data Protection

Page 3: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Data Protection

3

One-Click Disaster Recovery

•  Hot-standby MVF VMs •  AES-256 bit encrypted backups •  Reduced RPO, RTO, and RCO Amazon High Availability •  Multi-Availability Zone (AZ) Support •  Tolerate single or dual AZ outage(s) •  Relational Database Support (RDS) •  Fast MagFS Agent failover •  Seamless failover

VMware vSphere High Availability •  VMware vSphere HA •  Fast MagFS Agent failover •  Tolerate ESX Host, disk or memory failure •  Application restart or migration

Page 4: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Healing

4

Healing

•  Fast VM recovery •  Requires less resources (no DR cluster is needed) •  No downtime for the namespace

Page 5: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Share 1 Share 2 Share 3

Management

Share 1 Share 2 Share 3

Management

Database(s)

System Config System Config

Database(s)

Object Storage

Backing up share metadata

Primary Site DR Site

Object Storage

Restoring share metadata

1

2

One-Click Disaster Recovery

Page 6: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Region

Mgmt

Availability Zone Availability Zone

S3 Object Storage

RDS

Availability Zone

Share 1 Share 1 DNS Server RP: Elastic IP Discovery Service FQDN: Inst. Name Sync. Service

RP: Elastic IP Discovery Service FQDN: Inst. Name Sync. Service

Public DNS Discovery Service FQDN: Int. Name Sync. Service

VPC

MCSP Deployment: Single-Node Redundacy

Page 7: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Share 2 Share 2 Public DNS Discovery Service FQDN: Inst. Name Sync. Service

Public DNS Discovery Service FQDN: Inst. Name Sync. Service

Region

Mgmt

Availability Zone Availability Zone

S3 Object Storage

RDS

Availability Zone

Share 1 Share 1 DNS Server RP: Elastic IP Discovery Service FQDN: Inst. Name Sync. Service

RP: Elastic IP Discovery Service FQDN: Inst. Name Sync. Service

Public DNS Discovery Service FQDN: Int. Name Sync. Service

VPC

MCSP Deployment: Dual-Node Redundacy

Page 8: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

VMware vSphere High Availability

8

Primary ESX host

VMware vSphere

Application Failover

VMware vSphere

Secondary ESX host

1

2

Application Restart

Page 9: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Share 1 Share 2 Share 3

Management

Maginatics Virtual Filer

1 2

Share 1 Share 2 Share 3

Management

Share 1 Share 2 Share 3

Management

3

Lost Virtual Machine Restored Functionality

•  Maginatics Management Dashboard •  Single click Recovery •  Easy to find problem VM

Healing Maginatics VMs

Page 10: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Snapshots

10

MVF Metadatabase

VM

Full

MVF Snapshot

/snapshot /snapshot1 /snapshotX

Database Artifact Snapshot 1 Snapshot X

Incremental

Metadata Database

LVM Pool

/dev/sdb1 /dev/sdc1 /dev/sdd1

Logical Volume(s)

Volume Group(s)

Physical Volume(s)

Incremental

Page 11: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Multi-tier Caching

Page 12: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Site Cache v1.0 (Read Cache) and CDC

12

Site Cache

•  Local Virtual Machine •  Shared cache within office •  Improved READ performance •  LAN speed (100Mbps) •  Auto-discover nearest site cache (15ms RTT) •  MagFS Agents work with both Site Cache and CDC enabled

Content Delivery Cache (CDC) •  Amazon infrastructure •  Shared regional cache •  Improved READ performance •  52 AWS edge locations (typically 5-10ms from client) •  Optimized data paths (Amazon, high speed network backbone)

Page 13: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

MCSP provides several caching mechanisms for shared data access across dispersed clients

Site Cache 1ms

CDN 1–5ms

Object Storage 10–300ms

Client Cache < 1ms

LAN

Edge Network

WAN

Office ‘A’ Office ‘B’

Edge Node

MagFS Agent MagFS Agent MagFS Agent MagFS Agent

Page 14: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

The first cold read fetches chunks of a file from the cloud object storage

Site Cache 1ms

CDN 1–5ms

Object Storage 10–300ms

Client Cache < 1ms

LAN

Edge Network

WAN

Office ‘A’ Office ‘B’

Edge Node

MagFS Agent MagFS Agent MagFS Agent MagFS Agent

1

Page 15: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

In the process, all MCSP layers of caching in the read path get populated – CDN, Site Cache, Client cache(s).

Site Cache 1ms

CDN 1–5ms

Object Storage 10–300ms

Client Cache < 1ms

LAN

Edge Network

WAN

Office ‘A’ Office ‘B’

Edge Node

MagFS Agent MagFS Agent MagFS Agent MagFS Agent

1

Page 16: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Subsequent reads from any client in the same branch (LAN) get cache hits from the Site Cache

Site Cache 1ms

CDN 1–5ms

Object Storage 10–300ms

Client Cache < 1ms

LAN

Edge Network

WAN

Office ‘A’ Office ‘B’

Edge Node

MagFS Agent MagFS Agent MagFS Agent MagFS Agent

1 2

Page 17: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Subsequent reads from any client in the same region (common edge node) get cache hits from CDN

Site Cache 1ms

CDN 1–5ms

Object Storage 10–300ms

Client Cache < 1ms

LAN

Edge Network

WAN

Office ‘A’ Office ‘B’

Edge Node

MagFS Agent MagFS Agent MagFS Agent MagFS Agent

1 2 3

Page 18: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Additionally, the MagFS Agent has 3 levels of local caching: Kernel (IO Buffer), L1 (In memory) and L2 (Disk)

Site Cache 1ms

L2 (disk) L1 (in memory)

Kernel (IO Buffer)

CDN 1–5ms

Object Storage 10–300ms

Client Cache < 1ms

LAN

Edge Network

WAN

Office ‘A’ Office ‘B’

Edge Node

MagFS Agent MagFS Agent MagFS Agent MagFS Agent

MagFS Agent

1 2 3 4

5

Page 19: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Site Cache 1ms

L2 (disk) L1 (in memory)

Kernel (IO Buffer)

CDN 1–5ms

Object Storage 10–300ms

Client Cache < 1ms

LAN

Edge Network

WAN

Office ‘A’ Office ‘B’

Edge Node

MagFS Agent MagFS Agent MagFS Agent MagFS Agent

MagFS Agent

Our unique, multi-tier caching layers hide WAN latency and enable high throughput transfers (reads).

Page 20: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

APIs

Page 21: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

MCSP 3.0 - RESTful APIs

21

•  Control any aspect of Management via Web UI or our new RESTful APIs •  Full, programmatic control over a MCSP cluster •  Automate any or all aspects (e.g., provisioning, managing and

monitoring) •  On-demand resource configuration •  Automate cloud resource usage for bursty workloads •  IaaS cost reduction (e.g., expand storage when required)

Page 22: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Provisioning and Management APIs

22

0

50

VM lifecycle mgmt.

MCSP lifecycle mgmt.

Manual •  EC2 Management Console •  vSphere Client/vCenter

Manual •  UI Driven

Programmatic •  Cloud Formation •  vSphere APIs

Programmatic •  RESTful API

Page 23: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

MCSP 3.0 - Simplified Operation

23

Home Folder Redirection •  Auto-mount home folders •  Simplifies user experience when accessing MCSP •  Simplifies integration within AD scripted infrastructure to mount

network shares Access Based Enumeration

•  Hide files and folders based on ACLs •  Enhanced security when sharing infrastructure

across teams and organizations (users only see what they can access)

ACL Manipulation tool •  Simplifies the task of managing file system ACLs independently of

the IDM in use Multi-Share Web Services

•  Pool multiple Web Servers together •  Multiple share access, single interface

Page 24: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Operating Environment Enhanced Compatibility

24

Two File System Modes

•  Mixed Mode (default) •  Full Windows file system semantics and POSIX compatibility •  Unicode support with respect to file names •  Windows PCs, Mac and Linux interoperability •  File locking supported on Windows PCs and Mac •  Case insensitive

•  POSIX Mode •  POSIX file system semantics only (e.g., case sensitivity) •  Unicode support with respect to file names •  Linux and Mac interoperability •  Case sensitive

Page 25: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

With MCSP v3.0 - Admin Auditing Logs

25

Management UI - Active Directory Integration

Page 26: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Licenses

26

From v3.0 onward, licenses are cluster-based and not tied to a share. E.g., a 10 TB license can be used for 10 x 1 TB shares or 1 x 10 TB share at your discretion. Licenses issued for <3.x deployments will not be compatible with 3.x. Equally the new MCSP 3.x license format is not backward compatible with older versions. •  30 day grace period in which to update your license

•  Alerts are visible on the Management Server UI and via System Notifications (email)

•  We required the FQDN of your Management Server to generate a 3.x

license •  Existing, valid license will be updated for 3.x at no charge. Your

existing license length and capacity will not be impacted.

Page 27: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

MCSP 3.0 - EMC ViPR object storage support

27

EMC ViPR Platform

ViPR Controller

Provisioning Self-Service Reporting Automation

ViPR Data Services

Third-Party Isilon

Atmos

VMAX VNX VPLEX

Commodity XtremIO Centera

Maginatics Virtual Filer

Elastic NAS NAS Consolidation

Page 28: Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Thank you. 28