morphlabs open stack_capacity_planning_130829
TRANSCRIPT
© 2013 Morph labs Inc . A l l R igh ts Reserved
PRESENTED BY : Christopher Aedo, CTO
CO NF ID EN T I A L & PR O PR IE TA RY
OpenStack Capacity Planning8-29-2013
1
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Who the hell am I?
•Christopher Aedo ([email protected])
•Morphlabs CTO
•20+ year IT veteran (started at Arthur Andersen but NOT responsible for ENRON debacle!)
•Familiar with this “OpenStacks” thing
•Work with many very very smart people at Morphlabs, and in the OpenStack community
•Met Vint Cerf once!
•That’s what I look like in the Grand Canyon
2
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Morphlabs Profile
3
Headquartered in Los Angeles• Venture Funded $22M • 55 Employees• Operations in Japan, Philippines and Singapore• US Operations established in 2009
Successful Open Source Entrepreneurs• Apache Geronimo > IBM Websphere • Apache ActiveMQ > Progress Software
Deployments in the US and Asia
OpenStack Foundation Founding Member
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Agenda
Provide a useful structure and related information to help guide your thinking when it comes to planning an OpenStack deployment.Areas covered:
•Hypervisor choice
•Workload considerations
•Compute node capacity thoughts
•Storage (block and object)
•REVISIT THIS SLIDE WHEN OTHERS ARE COMPLETE!
4
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Thank You!
Tom FifieldDiane FlemingAnne GentleLorin HochsteinAdam HydeJonathan ProulxEverett ToewsJoe Topjian
5
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
oh crap!
6
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Want the easy answers?
7
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Unlimited budget
8
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Unlimited time
9
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Organized team of geniuses
10
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Total agreement on expectations
11
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Getting started
12
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Getting started
13
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Spare server
14
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Devstack!
15
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
First crossroad...
16
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Private cloud
17
Source: http://www.privatecloudandhosting.info/wp-content/uploads/2013/04/private-cloud1.png
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
You know your users and workload
18
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
19
Public Cloud!(I couldn’t find an image that screamed “Public Cloud” unfortunately.)
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Users and workload likely unknown
20
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Profile your workloads if possible
•Load test!
•Benchmark!
•Get a sense of IOPS with iostat!
•Quick, someone yell out their favorite profiling methodology!
21
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
22
Hypervisor
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
23
Hypervisor
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
24
Compute Density
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Compute Density
25
(overcommit fraction * physical cores)---------------------------------
vcores per instance
ephemeral storage desiredvs.
physical storage available
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Major vectors
•Budget•New/existing equipment•Space/power, desired performance•How much compute per node?•How much RAM per node?•How much storage per VM?•How many IOPS will you need?
26
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Speaking of IOPS
FOR EXAMPLE:• Model: Western Digital VelociRaptor 2.5" SATA hard drive
• Rotational speed: 10,000 RPM
• Average latency: 3 ms (0.003 seconds)
• Average seek time: 4.2 (r)/4.7 (w) = 4.45 ms (0.0045 seconds)
• Calculated IOPS for this disk: 1/(0.003 + 0.0045) = about 133 IOPS
27
Source: http://www.techrepublic.com/blog/the-enterprise-cloud/calculate-iops-in-a-storage-array/
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Factual Statistic
87% of the people viewing this presentation would appreciate a graph right about now.
28
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Storage and IOPS dictate density possible
29
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Thinking about density
32 physical cores96 virtual cores (3x overcommit)1tb storage (@10gb/vcore)192gb RAM needed (overcommit possible)50 IOPS/VM (that’s on the low side)5000 IOPS required~125 IOPS per 10k SAS12 100gb disks RAID10: ~1500 IOPS
30
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Thinking about density
~125 IOPS per 10k SAS12 100gb disks RAID10: ~1500 IOPS50 IOPS/VM (that’s on the low side)30 VMs12 physical cores (3x overcommit)60 gb RAM (@2gb/vcore)300 gb storage (@10gb/vcore)
31
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
32
Storage
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
33
Storage
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
34
Storage
NEED MORE STORAGE!
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
35
Storage
I’LL GET MORE TAPES
FAST!
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
36
Storage
DID YOU SEE BREAKING BAD LAST
NIGHT?
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
37
Storage
OMFG YES!
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
38
Storage
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
STORAGE
39
Storage
SO... THOSE TAPES, SOON? NOW?
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
NETWORKING
40
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
NETWORKING
41
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
NETWORKING
42
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
43
Cloud Controller
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Outgrowing your cloud controller
44
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Outgrowing your cloud controller
45
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Outgrowing your cloud controller
46
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
Outgrowing your cloud controller
47
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
MONITORING
48
© 2013 Morph labs Inc . A l l R igh ts Reserved
T I T L E : D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g8 - 2 9 - 2 0 1 3
49
Contact: Christopher [email protected]
Thank You!