tiering in glusterfs: hardware config considerations
TRANSCRIPT
![Page 1: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/1.jpg)
TIERING IN GLUSTERFS:
Hardware Config Considerations
Veda Shankar, Red Hat
April 2016
![Page 2: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/2.jpg)
AGENDA • Introduction • Basics: Concepts • Basics: Data Placement • Basics: Accessibility and Deployment • Tiering Architecture • Tiering Commands • Tiering Volume Settings • Tiering Performance • Tiering Demo
![Page 3: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/3.jpg)
![Page 4: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/4.jpg)
![Page 5: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/5.jpg)
![Page 6: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/6.jpg)
![Page 7: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/7.jpg)
![Page 8: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/8.jpg)
![Page 9: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/9.jpg)
Distributed Volume
![Page 10: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/10.jpg)
Two-way Distributed Replicated Volume
![Page 11: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/11.jpg)
Three-way Distributed Replicated Volume
![Page 12: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/12.jpg)
Dispersed Volume (Erasure Coded)
![Page 13: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/13.jpg)
![Page 14: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/14.jpg)
![Page 15: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/15.jpg)
Distribute-ReplicateVolume(Primary)
Distribute-ReplicateVolume(Primary)
![Page 16: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/16.jpg)
Tiering Architecture
![Page 17: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/17.jpg)
Benefits of Tiering
![Page 18: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/18.jpg)
Tiering Commands
A8achthe:ertothevolumebyexecu:ngthefollowingcommand:# gluster volume tier test-volume attach replica 2 server1:/gluster/ssd1 server2:/gluster/ssd2 Usethesetcommandtosetthevarious:ervolumeconfigura:onop:ons:# gluster volume set test-volume <option name> <value>Thestatuscommanddisplaysthe:eringvolumeinforma:on.# gluster volume tier test-volume status !Todetachthehot:erfromthevolume,firstini:atethedetachstartcommandandthenmonitortomakesurethatthedetachprocesshascompletedsuccessfully.Finallyusethecommitop:ontocompletethedetachprocess.# gluster volume tier test-volume detach start !# gluster volume tier test-volume status !# gluster volume tier test-volume commit !
![Page 19: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/19.jpg)
Tiering Volume Options Op#on Descrip#on Allowed
ValuesDefaultValue
cluster.read-freq-threshold Specifiesthenumberofreads,inapromo:on/demo:oncycle,thatwouldmarkafileHOTforpromo:on.AnyfilethathasreadhitslessthanthisvaluewillbeconsideredasCOLDandwillbedemoted.
0-20 0
cluster.write-freq-threshold
Specifiesthenumberofwrites,inapromo:on/demo:oncycle,thatwouldmarkafileHOTforpromo:on.AnyfilethathaswritehitslessthanthisvaluewillbeconsideredasCOLDandwillbedemoted.
0-20 0
cluster.:er-promote-frequency Specifieshowfrequentlythe:erdaemonmustcheckforfilestopromote. 1–172800seconds
120seconds
cluster.:er-demote-frequency
Specifieshowfrequentlythe:erdaemonmustcheckforfilestodemote.
1–172800seconds
3600seconds
cluster.:er-mode Ifsettocachemode,promotesordemotesfilesbasedonwhetherthecacheisfullornot,asspecifiedwithwatermarks.Ifsettotestmode,periodicallydemotesorpromotesfilesautoma:callybasedonaccess.
Test|cache cache
![Page 20: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/20.jpg)
TieringVolumeOptions Op#on Descrip#on Allowed
ValuesDefaultValue
cluster.:er-max-mb SpecifiesthemaximumnumberofMBthatmaybemigratedinanydirec:onfromeachnodeinagivencycle.
1–100000(100GB)
4000MB
cluster.:er-max-files
Specifiesthemaximumnumberoffilesthatmaybemigratedinanydirec:onfromeachnodeinagivencycle.
1–100000files
10000
cluster.watermark-hi Upperpercentagewatermarkforpromo:on.Ifhot:erfillsabovethispercentage,nopromo:onwillhappenanddemo:onwillhappenwithhighprobability.
1–99% 90%
cluster.watermark-low
Lowerpercentagewatermark.Ifhot:erislessfullthanthis,promo:onwillhappenanddemo:onwillnothappen.Ifgreaterthanthis,promo:on/demo:onwillhappenataprobabilityrela:vetohowfullthehot:eris.
1–99%
75%
![Page 21: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/21.jpg)
QCT Storage Servers
![Page 22: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/22.jpg)
Test Configuration
TwoQuantaPlexT21P-4U/DualNodeservers(fourGlusterfsnodes)wereconfigured,eachnodewitha40GbEinterface,withthetestworkloaddrivenby16clientnodes.Clientshavea10GbEinterface.
![Page 23: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/23.jpg)
Test Configuration
SixQuantaGridD51PH-1Userverweretestedwithclusterandpublic10GbEnetworks.Thetestworkloadwasdrivenby16clientnodes.
![Page 24: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/24.jpg)
![Page 25: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/25.jpg)
![Page 26: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/26.jpg)
![Page 27: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/27.jpg)
![Page 28: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/28.jpg)
![Page 29: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/29.jpg)
![Page 30: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/30.jpg)
![Page 31: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/31.jpg)
DEMO
![Page 32: Tiering in GlusterFS: Hardware Config Considerations](https://reader033.vdocuments.net/reader033/viewer/2022051504/5862a7241a28ab0e308e6f9f/html5/thumbnails/32.jpg)
THANK YOU!
bit.ly/glustertestdrive
Test drive: