maginatics cloud storage platform - mcsp 3.0 technical highlights

Rohit Goyal rohit@maginatics.com

Sr. Technical Marketing Engineer

Maginatics Cloud Storage Platform (MCSP) MCSP 3.0 Technical Highlights

Data Protection

Data Protection

3

One-Click Disaster Recovery

•  Hot-standby MVF VMs •  AES-256 bit encrypted backups •  Reduced RPO, RTO, and RCO Amazon High Availability •  Multi-Availability Zone (AZ) Support •  Tolerate single or dual AZ outage(s) •  Relational Database Support (RDS) •  Fast MagFS Agent failover •  Seamless failover

VMware vSphere High Availability •  VMware vSphere HA •  Fast MagFS Agent failover •  Tolerate ESX Host, disk or memory failure •  Application restart or migration

Healing

4

Healing

•  Fast VM recovery •  Requires less resources (no DR cluster is needed) •  No downtime for the namespace

Share 1 Share 2 Share 3

Management

Share 1 Share 2 Share 3

Management

Database(s)

System Config System Config

Database(s)

Object Storage

Backing up share metadata

Primary Site DR Site

Object Storage

Restoring share metadata

1

2

One-Click Disaster Recovery

Region

Mgmt

Availability Zone Availability Zone

S3 Object Storage

RDS

Availability Zone

Share 1 Share 1 DNS Server RP: Elastic IP Discovery Service FQDN: Inst. Name Sync. Service

RP: Elastic IP Discovery Service FQDN: Inst. Name Sync. Service

Public DNS Discovery Service FQDN: Int. Name Sync. Service

VPC

MCSP Deployment: Single-Node Redundacy

Share 2 Share 2 Public DNS Discovery Service FQDN: Inst. Name Sync. Service

Public DNS Discovery Service FQDN: Inst. Name Sync. Service

Region

Mgmt

Availability Zone Availability Zone

S3 Object Storage

RDS

Availability Zone

Share 1 Share 1 DNS Server RP: Elastic IP Discovery Service FQDN: Inst. Name Sync. Service

RP: Elastic IP Discovery Service FQDN: Inst. Name Sync. Service

Public DNS Discovery Service FQDN: Int. Name Sync. Service

VPC

MCSP Deployment: Dual-Node Redundacy

VMware vSphere High Availability

8

Primary ESX host

VMware vSphere

Application Failover

VMware vSphere

Secondary ESX host

1

2

Application Restart

Share 1 Share 2 Share 3

Management

Maginatics Virtual Filer

1 2

Share 1 Share 2 Share 3

Management

Share 1 Share 2 Share 3

Management

3

Lost Virtual Machine Restored Functionality

•  Maginatics Management Dashboard •  Single click Recovery •  Easy to find problem VM

Healing Maginatics VMs

Snapshots

10

MVF Metadatabase

VM

Full

MVF Snapshot

/snapshot /snapshot1 /snapshotX

Database Artifact Snapshot 1 Snapshot X

Incremental

Metadata Database

LVM Pool

/dev/sdb1 /dev/sdc1 /dev/sdd1

Logical Volume(s)

Volume Group(s)

Physical Volume(s)

Incremental

Multi-tier Caching

Site Cache v1.0 (Read Cache) and CDC

12

Site Cache

•  Local Virtual Machine •  Shared cache within office •  Improved READ performance •  LAN speed (100Mbps) •  Auto-discover nearest site cache (15ms RTT) •  MagFS Agents work with both Site Cache and CDC enabled

Content Delivery Cache (CDC) •  Amazon infrastructure •  Shared regional cache •  Improved READ performance •  52 AWS edge locations (typically 5-10ms from client) •  Optimized data paths (Amazon, high speed network backbone)

MCSP provides several caching mechanisms for shared data access across dispersed clients

Site Cache 1ms

CDN 1–5ms

Object Storage 10–300ms

Client Cache < 1ms

LAN

Edge Network

WAN

Office ‘A’ Office ‘B’

Edge Node

MagFS Agent MagFS Agent MagFS Agent MagFS Agent

The first cold read fetches chunks of a file from the cloud object storage

Site Cache 1ms

CDN 1–5ms

Object Storage 10–300ms

Client Cache < 1ms

LAN

Edge Network

WAN

Office ‘A’ Office ‘B’

Edge Node

MagFS Agent MagFS Agent MagFS Agent MagFS Agent

1

In the process, all MCSP layers of caching in the read path get populated – CDN, Site Cache, Client cache(s).

Site Cache 1ms

CDN 1–5ms

Object Storage 10–300ms

Client Cache < 1ms

LAN

Edge Network

WAN

Office ‘A’ Office ‘B’

Edge Node

MagFS Agent MagFS Agent MagFS Agent MagFS Agent

1

Subsequent reads from any client in the same branch (LAN) get cache hits from the Site Cache

Site Cache 1ms

CDN 1–5ms

Object Storage 10–300ms

Client Cache < 1ms

LAN

Edge Network

WAN

Office ‘A’ Office ‘B’

Edge Node

MagFS Agent MagFS Agent MagFS Agent MagFS Agent

1 2

Subsequent reads from any client in the same region (common edge node) get cache hits from CDN

Site Cache 1ms

CDN 1–5ms

Object Storage 10–300ms

Client Cache < 1ms

LAN

Edge Network

WAN

Office ‘A’ Office ‘B’

Edge Node

MagFS Agent MagFS Agent MagFS Agent MagFS Agent

1 2 3

Additionally, the MagFS Agent has 3 levels of local caching: Kernel (IO Buffer), L1 (In memory) and L2 (Disk)

Site Cache 1ms

L2 (disk) L1 (in memory)

Kernel (IO Buffer)

CDN 1–5ms

Object Storage 10–300ms

Client Cache < 1ms

LAN

Edge Network

WAN

Office ‘A’ Office ‘B’

Edge Node

MagFS Agent MagFS Agent MagFS Agent MagFS Agent

MagFS Agent

1 2 3 4

5

Site Cache 1ms

L2 (disk) L1 (in memory)

Kernel (IO Buffer)

CDN 1–5ms

Object Storage 10–300ms

Client Cache < 1ms

LAN

Edge Network

WAN

Office ‘A’ Office ‘B’

Edge Node

MagFS Agent MagFS Agent MagFS Agent MagFS Agent

MagFS Agent

Our unique, multi-tier caching layers hide WAN latency and enable high throughput transfers (reads).

APIs

MCSP 3.0 - RESTful APIs

21

•  Control any aspect of Management via Web UI or our new RESTful APIs •  Full, programmatic control over a MCSP cluster •  Automate any or all aspects (e.g., provisioning, managing and

monitoring) •  On-demand resource configuration •  Automate cloud resource usage for bursty workloads •  IaaS cost reduction (e.g., expand storage when required)

Provisioning and Management APIs

22

0

50

VM lifecycle mgmt.

MCSP lifecycle mgmt.

Manual •  EC2 Management Console •  vSphere Client/vCenter

Manual •  UI Driven

Programmatic •  Cloud Formation •  vSphere APIs

Programmatic •  RESTful API

MCSP 3.0 - Simplified Operation

23

Home Folder Redirection •  Auto-mount home folders •  Simplifies user experience when accessing MCSP •  Simplifies integration within AD scripted infrastructure to mount

network shares Access Based Enumeration

•  Hide files and folders based on ACLs •  Enhanced security when sharing infrastructure

across teams and organizations (users only see what they can access)

ACL Manipulation tool •  Simplifies the task of managing file system ACLs independently of

the IDM in use Multi-Share Web Services

•  Pool multiple Web Servers together •  Multiple share access, single interface

Operating Environment Enhanced Compatibility

24

Two File System Modes

•  Mixed Mode (default) •  Full Windows file system semantics and POSIX compatibility •  Unicode support with respect to file names •  Windows PCs, Mac and Linux interoperability •  File locking supported on Windows PCs and Mac •  Case insensitive

•  POSIX Mode •  POSIX file system semantics only (e.g., case sensitivity) •  Unicode support with respect to file names •  Linux and Mac interoperability •  Case sensitive

With MCSP v3.0 - Admin Auditing Logs

25

Management UI - Active Directory Integration

Licenses

26

From v3.0 onward, licenses are cluster-based and not tied to a share. E.g., a 10 TB license can be used for 10 x 1 TB shares or 1 x 10 TB share at your discretion. Licenses issued for <3.x deployments will not be compatible with 3.x. Equally the new MCSP 3.x license format is not backward compatible with older versions. •  30 day grace period in which to update your license

•  Alerts are visible on the Management Server UI and via System Notifications (email)

•  We required the FQDN of your Management Server to generate a 3.x

license •  Existing, valid license will be updated for 3.x at no charge. Your

existing license length and capacity will not be impacted.

MCSP 3.0 - EMC ViPR object storage support

27

EMC ViPR Platform

ViPR Controller

Provisioning Self-Service Reporting Automation

ViPR Data Services

Third-Party Isilon

Atmos

VMAX VNX VPLEX

Commodity XtremIO Centera

Maginatics Virtual Filer

Elastic NAS NAS Consolidation

Thank you. 28