7 distributed storage_open_stack

39
Distributed Storage in OpenStack Vijay Bellur GlusterFS co-maintainer Red Hat

Upload: openstackindia

Post on 08-May-2015

2.736 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: 7 distributed storage_open_stack

DistributedStorageinOpenStack

VijayBellurGlusterFSco-maintainer

RedHat

Page 2: 7 distributed storage_open_stack

AgendaStorageinOpenStack

TodayFuture

DistributedStorageOptionsPros/Cons

DistributedStoragewithGlusterFSArchitecture&ConceptsIntegrationwithOpenStackBenefits

Q&A

Page 3: 7 distributed storage_open_stack

StorageinOpenStackProminentUseCasesToday:SwiftCinderEphemeralGlance

Page 4: 7 distributed storage_open_stack

ProminentUseCasesToday

Page 5: 7 distributed storage_open_stack

EMERGINGUSECASES:SavannaManilaRakshaTroveDRaaS

Page 6: 7 distributed storage_open_stack

Savanna

Page 7: 7 distributed storage_open_stack

Raksha

Page 8: 7 distributed storage_open_stack

ManilaManilaaimstobethesharedfilesystemmanagementprojectforOpenStack.ProvidestenantspecificfilesharesPlannedforincubationinIcehouseInterestfromseveralNASvendorsMoredetailsavailableathttps://launchpad.net/manila

Page 9: 7 distributed storage_open_stack

TroveDatabaseasaServiceforOpenstackSnapshotstoSwiftLogstoManila?

Page 10: 7 distributed storage_open_stack

DRaaS

OngoingeffortsinvariousservicestoprovideDisasterRecovery.

Page 11: 7 distributed storage_open_stack

DistributedStorage-OptionsSomeopen:

CephGlusterFSSheepdog

andsomenotsoopen:GPFSScality

Page 12: 7 distributed storage_open_stack

SDS-WhyAdvantagesofSoftwareDefinedDistributedStorage:Runsoncommodityhardware

CostEffectiveLeveragerecentHardwareinnovationsFlexibleScale-outapproachblendsinwithecosystem

ResilienttonodefailuresHighAvailability

EnablesLiveMigration

Page 13: 7 distributed storage_open_stack

SDS-WhyNOTPerformanceLocationawarenesshelpsTiereddistributedstoragecanactuallyimproveperformance!

Page 14: 7 distributed storage_open_stack

DistributedStorage-GlusterFS

Page 15: 7 distributed storage_open_stack

GlusterFSGlusterFSisanopensourcedistributedfilesystemcapableofscalingtoseveralpetabytes.

AggregatesstoragebuildingblocksoverInfinibandRDMAorTCP/IPinterconnecttoprovideunifiednamespace.

Filesystemisstackableandcompletelyinuserspace.

Page 16: 7 distributed storage_open_stack

GlusterFSDeployment

Page 17: 7 distributed storage_open_stack

GlusterFSArchitecture&Concepts

Page 18: 7 distributed storage_open_stack

GlusterFSTranslatorsBuildingblocksforGlusterFSprocessTranslatorscanbestackedtogethertoachievedesiredfunctionalityCanbeloadedonclientorserverstacks-mostlydeploymentagnostic

Page 19: 7 distributed storage_open_stack

GlusterFSTranslators

Page 20: 7 distributed storage_open_stack

GlusterFSConcepts

Page 21: 7 distributed storage_open_stack

GlusterFSBrickAbrickisthecombinationofanodeandanexportdirectoryEachbrickinheritslimitsoftheunderlyingfilesystemIdeally,eachbrickinaclustershouldbeofthesamesize

Page 22: 7 distributed storage_open_stack

GlusterFSVolumeAvolumeisalogicalcollectionofbricksAvolumeisidentifiedbyanadministratorprovidednameVolumescanbeeitherdistributed,striped,and/orreplicatedMostadministrativeactionstiedtoavolumetoday

Page 23: 7 distributed storage_open_stack

DistributedVolumeDistributedfilesacrossvariousbricksofthevolumeDirectoriesarepresentonallbricksofthevolume

Page 24: 7 distributed storage_open_stack

ReplicatedVolumeCreatessynchronouscopiesofalldirectoryandfileupdatesProvideshighavailabilityofdatawhennodesfailuresoccurTransactiondrivenforensuringconsistency

Page 25: 7 distributed storage_open_stack

StripedVolumeFilesarestripedintochunksandplacedinvariousbricksRecommendedonlywhenverylargefilesgreaterthanthesizeofthebricks

Page 26: 7 distributed storage_open_stack

DistributedReplicatedVolumeDistributefilesacrossreplicatedbricksProvidesbothScaleoutandhighavailabilityMostpreferredmodelofdeploymentcurrently

Page 27: 7 distributed storage_open_stack

GlusterFSVolumeExampleExample:Createasixnodedistributedandreplicated

volumewithatwo-waymirror

$sudoglustervolumecreatemyvolume\replica2\transporttcp\server1:/export/brick/myvolume\server2:/export/brick/myvolume\server3:/export/brick/myvolume\server4:/export/brick/myvolume\server5:/export/brick/myvolume\server6:/export/brick/myvolume$sudoglustervolumestartmyvolume$sudomount-tglusterfsserver1:myvolume/mnt/gluster/myvolume

Page 28: 7 distributed storage_open_stack

AccessingGlusterFSvolumes

Page 29: 7 distributed storage_open_stack

GeoReplicationMaster-slavesetupAsynchronousincrementalreplicationDisasterrecovery

Page 30: 7 distributed storage_open_stack

GlusterFSwithOpenStack

Page 31: 7 distributed storage_open_stack

GlusterFSforGlanceSharedstoragecapacityGeoReplicationStorageresizing

Page 32: 7 distributed storage_open_stack

GlusterFSforEphemeralStorage(Nova)

SharedstoragecapacityLiveMigrationsProtectionusingreplicatedstorageEnhancedperformanceusinglibgfapi

Page 33: 7 distributed storage_open_stack

GlusterFSforCinderSharedstoragecapacityGeoReplicationHypervisorassistedsnapshotsMostlyCompletecapabilitymatrix

Page 34: 7 distributed storage_open_stack

GlusterFSforSwift

Dataaccessovermultipleprotocols

Sharedstoragecapacity

GeoReplication

SwiftGrizzlysupported

SwiftHavanasupportinprogress

Page 35: 7 distributed storage_open_stack

OpenStack+GlusterFSSwiftUseCase

Page 36: 7 distributed storage_open_stack

GlusterFSperformance

Page 37: 7 distributed storage_open_stack

GlusterFSBenefitsUnifiedAccessforBlock,File,ObjectandHDFSModularextensiblearchitectureGeo-replicationChoiceofinterconnects-RDMA,GigE,10GELocalityCompute/VirtualizationtransparentstoragemaintenanceIntegratedwithRDOandRHOS

Page 38: 7 distributed storage_open_stack

GlusterFSresourcesMailinglists:

[email protected]@nongnu.org

IRC:#glusterand#gluster-devonfreenode

Links:http://www.gluster.org

http://hekafs.orghttp://forge.gluster.org

Page 39: 7 distributed storage_open_stack

ThankYou

Questions??