john d. rowell - scaling heterogeneous systems on the cloud
DESCRIPTION
TRANSCRIPT
Scaling heterogeneous systems on the cloud
John D. [email protected]
@jdrowell
http://www.flickr.com/photos/klearchos/4632744945Thursday, March 24, 2011
Works fine on my machine
http://www.flickr.com/photos/klearchos/4632744945Thursday, March 24, 2011
Yeah but does it scale?
Thursday, March 24, 2011
What to scale
Storage capacityProcessing power
ConcurrencyAvailability
http://www.flickr.com/photos/kwl/3219157599Thursday, March 24, 2011
Any complex system won't be homogeneous
Web serversDatabases
CachesQueuesWorkers
http://www.flickr.com/photos/core-materials/3838557749Thursday, March 24, 2011
Different subsystems scale differently
Master / SlaveClient shardingMap / Reduce
Workers
http://www.flickr.com/photos/licassuncao/2500282164Thursday, March 24, 2011
No failure is not an option
MonitoringAuto respawnLive spares
http://www.flickr.com/photos/bfishadow/5197774708Thursday, March 24, 2011
No sysadm? No problem!
Full featured APIsThresholds
Remote monitoringCloud monitoring
http://www.flickr.com/photos/deltamike/3536991945Thursday, March 24, 2011
Scaling Vertically
Stop and GoStick to 32 or 64bits
Rolling upgrade
http://www.flickr.com/photos/doctorvee/3766965528Thursday, March 24, 2011
Scaling Horizontally
Network latencyBandwidth use
Security
http://www.flickr.com/photos/thefangmonster/4024861156Thursday, March 24, 2011
Where's the node?
Cluster is dynamicNo broadcast or multicast
Use the API Luke
http://www.flickr.com/photos/silvery/2414538926Thursday, March 24, 2011
Make all nodes equal
DynamoMemcached
ZeroConf
http://www.flickr.com/photos/jurvetson/3327872958Thursday, March 24, 2011
Scale-friendly systems
Web serversRiak
memcachedElasticSearch
http://www.flickr.com/photos/xiaming/50391986Thursday, March 24, 2011
Scale semi-friendly systems
MongoDBMySQL
PostgreSQL
http://www.flickr.com/photos/fenng/5489161388Thursday, March 24, 2011
Scale un-friendly systems
Redis*Queues
Stream consumers
http://www.flickr.com/photos/addedentry/631590447Thursday, March 24, 2011
One AMI to rule them all
/opt is your frienddata on EBS
cloud-init
http://www.flickr.com/photos/thecaucas/3573910044Thursday, March 24, 2011
There is no spoon
Leverage your servicesKey/value =~ scoreboard
Queue =~ Job list
Thursday, March 24, 2011
There is no spoon
Leverage your servicesKey/value =~ scoreboard
Queue =~ Job list
Thursday, March 24, 2011
Caveats
Estimate cluster sizeNon-linear scalability
http://www.flickr.com/photos/justin_glass/3793492335Thursday, March 24, 2011
Thank you!
John D. [email protected]
@jdrowell
http://www.flickr.com/photos/klearchos/4632744945Thursday, March 24, 2011