vsan implementation & design · 2 implementing stretched vsan robert hegeman technisch...

33
STRETCHED VSAN Robert Hegeman & Daniël Zuthof Equinix Managed Services NLVMUG UserCon 21 maart 2019

Upload: others

Post on 31-Dec-2020

24 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

STRETCHED VSAN

Robert Hegeman & Daniël ZuthofEquinix Managed Services

NLVMUG UserCon

21 maart 2019

Page 2: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

2

Implementing Stretched vSAN

Robert Hegeman

Technisch Architect

VMware VCIX {DCV,NV}

Daniël Zuthof

Technisch Architect

VMware VCDX-DCV #235

@Robert_hegeman @DanielZuthof

Page 3: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

http://www.yellow-bricks.com/stickersshirts/

Page 4: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman
Page 5: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

De oplossing

Preferred Secondary

Page 6: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

vSphere - DRS

Page 7: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

vSphere - Availability

Page 8: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

vSphere - Support

Page 9: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

Networking - Data traffic

https://storagehub.vmware.com/t/vmware-vsan/vmware-r-vsan-tm-network-design/stretched-cluster-deployments/

Page 10: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

Networking - Witness traffic

https://storagehub.vmware.com/t/vmware-vsan/vsan-stretched-cluster-guide/witness-traffic-separation-wts-3/

Page 11: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

Witness host

https://blogs.vmware.com/virtualblocks/2018/05/16/witness-host-traffic-tagging/

Page 12: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

Sizing - Cluster

https://docs.vmware.com/en/VMware-vSAN/index.html

Page 13: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

Sizing - Host

Page 14: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

Limitaties

Page 15: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

NORMAL

15

Witness

VM

VMDK

WITNESS SITE

PREFERRED SITE SECONDARY SITE

1

1

1

1

1

1

3

Images from Stijn Depril (VMware), thanks mate!http://www.stijnsthoughts.be/

Page 16: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

WITNESS FAILS

16

Witness

VM

VMDK

WITNESS SITE

PREFERRED SITE SECONDARY SITE

1

1

1

1

1

1

3

Page 17: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

ADDITIONAL HW FAILS

17

Witness

VM

VMDK

WITNESS SITE

PREFERRED SITE SECONDARY SITE

1

1

1

1

1

1

3

Page 18: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

ADDITIONAL HW FAILS

18

Witness

VM

VMDK

WITNESS SITE

PREFERRED SITE SECONDARY SITE

1

1

1

1

1

1

3

OBJECT UNAVAILBLE

Page 19: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

SITE FAILURE / SITE PARTIONING

19

Witness

VM

VMDK

WITNESS SITE

PREFERRED SITE SECONDARY SITE

VM

VMDK

HA RESTART

Page 20: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

ISL DISCONNECT

20

Witness

VM

VMDK

WITNESS SITE

PREFERRED SITE SECONDARY SITE

VM

VMDK

VM

VMDK

VM

VMDK

VM

VMDK

VM

VMDK

VM

VMDK

VM

VMDK

VM

VMDK

HA POWER OFF

Page 21: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

Takeaways

vSAN Getting StartedHOL-1908-01-HCI

http://www.yellow-bricks.com/2018/12/12/new-book-vmware-vsan-6-7-u1-deep-dive/https://labs.hol.vmware.com/HOL/catalogs/catalog/876

Page 22: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

THANK YOU

Page 23: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

ADDITIONAL SLIDES

Page 24: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

De voordelen

• Eenvoud• Variant van standard vSAN

• Standaard hardware

• Laagdrempelige configuratie

• Schaalbaar• Scale-out

• Scale-up

• Flexibel• RPO policy gebaseerd

• HW vendor onafhankelijk

Page 25: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

Use cases

• Herstel na calamiteit (DR)

• Voorkomen calamiteit

• (Datacenter) onderhoud

Page 26: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

vSphere

• DRS regels

• Beschikbaarheid

• Cold read cache (hybrid)

• VMware HA

• Isolation address

• Isolation response

• Datastore heartbeating

Page 27: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

vSphere - vervolg

• Enable Support insight

• Hardware en firmware (HCL!)

• vSAN Ready Nodes

• Ondersteuning van leverancier

• Geteste combinatie

Page 28: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

Networking - Data traffic

• Voorkeur VMware voor L2

• Data niet via witness site

• Maximaal 5 ms round trip

• Bandbreedte ISL >= 10 Gbit

• Voorkeur redundante ISL

• Jumbo frames niet vereist

https://storagehub.vmware.com/t/vmware-vsan/vmware-r-vsan-tm-network-design/stretched-cluster-deployments/

Page 29: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

Networking - Witness traffic

• Voorkeur VMware voor L3

• Gebruik static routes

• Gebruik externe routers

• Witness traffic separation

• Mixed MTU (Jumbo) mogelijk

• Maximaal 200 ms round trip

• Bandbreedte >= 100 Mbit

https://storagehub.vmware.com/t/vmware-vsan/vsan-stretched-cluster-guide/witness-traffic-separation-wts-3/

Page 30: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

Witness host

• Default portgroups niet aanpassen

• Gebruikt standard switches

• Gebruikt static routes

https://blogs.vmware.com/virtualblocks/2018/05/16/witness-host-traffic-tagging/

Page 31: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

Sizing - Cluster

• Uniform cluster nastreven

• Components (max. 9000 per host)

• Min. 2 data nodes, max. 30

• Witness hosts per cluster altijd 1

• Optioneel: RAID 1/5/6 binnen site

Page 32: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

Sizing - Host

• Vrije disk / PCIe sloten

• Min. 2 disk groups

• Write cache max. 600 GB

• Grote hybrid caching SSD zinvol

• Max. 1 GB memory read cache

Page 33: vSAN Implementation & Design · 2 Implementing Stretched vSAN Robert Hegeman Technisch Architect VMware VCIX {DCV,NV} Daniël Zuthof Technisch Architect VMware VCDX-DCV #235 @Robert_hegeman

Limitaties

• SMP-FT

• Supported for single site

• Not supported on stretched

• Due to latency when replication VM state

• iSCSI target

• Not supported on stretched

• Initiator can be on remote site

• No read locality