orchestrating open source components for home sans · open source components . for home sans. ......

Storage Developer Conference 2009 © 2009 Sound Paradigm Software Engineering Services Pvt. Ltd. All rights reserved.

Orchestrating

Open Source Components

for Home SANs

Abhinav Jawadekar


Agenda

Networked Storage Requirements for HomeOptions and ApproachesOpen Source ComponentsOrchestration ConsiderationsChallenges

2


Home Compute and Communication Environment

Desktop PCsLaptop PCsNetbook PCsHandheld Mobile DevicesMultimedia DevicesMany compute and communication systems with a lot of dataHuge need for consolidation and central management

3


Sharing

Share data among compute and communication devicesShare storage devices among compute and communication devices

USB disks (pen drives, USB hard disks)CD/DVD drivesDevice attached hard disks

Access managementConnectivity

4


Features

Data RepositoryCompute and communication device backup

Storage Tiers Solid state diskHigh capacity hard diskCloud storage

Data protection, backup to secondary device and cloudExpandabilityRecovery Point more important than Recovery Time

High Availability NOT a requirementPerformance only moderately important

5


Usability

Easy to understand and intuitive to useDefault options should suffice common usageShould work well with removable devices

6

Storage Developer Conference 2009 © 2009 Sound Paradigm Software Engineering Services Pvt. Ltd. All rights reserved. 7

File and underlying storage infrastructure sharing File (folder/share) level access controlIP based file sharing protocols

Backup + much moreData/file sharing over internetHigh capacity data repositoryInternet APIs

Raw device (block) accessStorage infrastructure sharingPass-through access to external devices such as USB drives, CD/DVD drives etc.Device level access control based on computer systemEnabled by iSCSI technology

Network Attached Storage Cloud Storage Storage Area Network

SAN, NAS and Cloud storage – A Home needs it all!

Options


Home Networked Storage Environment

8

Application Plug-ins

Orchestration Glue

Device M

anagement

Aggregation

Provisioning

NAS

SAN


Approaches

Network BasedNetwork router as the intelligence and gatekeeper of the home IT infrastructureMay or may not have native storageDevice interfaces such as USBIdeal for home and low end SMBs

Storage ApplianceA low-end storage array based on industry standard serverHas native storageDevice interfaces such as USBSuitable for SMBs and high-end tech savvy homes

9


Linux Storage Components for SAN

Linux raw device access/dev/sdx

Software RAID – MDDisk redundancy

Logical Volume Manager - LVMAggregationProvisioning

iSCSI Enterprise Target – iETDevice and storage presentation

10


Orchestration considerations: Software RAID - MD

11

Disk redundancy with RAID levels 1, 4, 5, 6, 10 etc.Dynamic resizing, hot replacement, hot spares – many sophisticated and complex features

Focus on Mirroring or RAID – 1Easy to understandMore granular redundancy not requiredAbility to move disks easily is crucial

All RAID levels provided by MDFeatures such as hot spares, remove and replace drivesDynamic expansion and changes

Relevant Features Network Based Storage Appliance


Orchestration considerations: Logical Volume Manager - LVM

12

Aggregate raw disk devices as well as md devicesProvision required sizes of logical volumesStriping, mirroring and concatenationDynamic expansion, snapshots etc.

Tight coupling with md for simplicity with either raw or value added shared disksOnly concatenationDynamic expansionSnapshots only for applications such as backup

Allowing user the choice of coupling with mdConcatenation and stripingDynamic expansionSnapshots



Orchestration considerations: iSCSI Enterprise Target - iET

13

Present block devices and file based raw data as iSCSI LUsTarget level access controlCHAP AuthenticationDynamic Target and LUN creation

Block device (pass through or LV) presentationOnly one LUN (0) per target to ensure simplicityIntegration with DHCP/DNS to know potential hostsTarget level access controlDynamic Target creation

Block device (pass through or LV) presentationTarget and LUN hierarchyIntegration with DHCP/DNS to know potential hostsTarget level access controlCHAP AuthenticationDynamic Target and LUN creation



Orchestration Glue and User Interface

Essential but missing partsOrchestration Glue

Programmatic logic required for systematic coordination of raw devices, MD, LVM and iET

Web UISimple and IntuitiveMust provide easy to understand big picture

Should differentiate between Network Based and Storage Approaches in terms of details and sophistication

14


Challenges and TBDs

Simple language that is appropriate for intended audienceiSCSI Initiators for hand held and mobile devicesMore thought to iSCSI based plug-n-playBetter pass-through device supportPlug-ins requiring no direct client involvement

Cloud backupCloud storage applicationsStorage Tier applications

Glue logic to coordinate among SAN, NAS and Cloud application

15


Technology Options

FreeNASOpenSolaris

16


Conclusion

Homes need SAN, NAS and Cloud StorageIP based protocols and open source software components provide the vehicle and functionalityOrchestrating glue, an intuitive Web UI and most importantly simple language that can be easily understood by a layperson are the main challenges

17


Q & A

Thanks!

Abhinav [email protected]

18

mailto:[email protected]

http://www.soundparadigm.com/

orchestrating open source components for home sans · open source components . for home sans. ......

Documents