Download - Bridging the Developer and the Datacenter
![Page 1: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/1.jpg)
BridgingtheDeveloperandtheDatacenter
June2009
![Page 2: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/2.jpg)
BriefHistory• 8yearsinmanagedservicesindustry
• Foundedfirstcompanyin2001,soldin2004• FoundedReduxin2004,soleowner• Managing200servers,1200VMsacrosstwofaciliCesin
Portland
• StrongOSSAdvocates–Adium,ImageMagick,Pidgin,SimpleMachines,CaminoBrowser
PropertyofNetworkRedux,LLC
![Page 3: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/3.jpg)
Whyshouldwebuildabridge?• HostedapplicaConsrequirecommunicaConbetween
datacentersanddevelopers
• Providedeveloperswiththetoolstopowerdecisionmaking
• BecomelessreliantonhosCngprovidersfortroubleshooCng
• UnderstandthehosCngservicestack
PropertyofNetworkRedux,LLC
![Page 4: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/4.jpg)
TheNetwork
• Ethernetisthestandard• 10Mb,100Mb,1Gb,10Gbandnow
100Gb
• 1Mbpssustainedequals~320GB
• BursCngisimportant,knowyourlimits• >70%sustainedusageisdangerous
PropertyofNetworkRedux,LLC
Data Center / Bandwidth
![Page 5: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/5.jpg)
BursCngExample:Twi]erVoteReport
PropertyofNetworkRedux,LLC
![Page 6: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/6.jpg)
DataTransfer
• Core,DistribuCon,Access• BorderGatewayProtocol(BGP)• VirtualRouterRedundancy
Protocol(VRRP)• Bandwidthisacommodity• Redundancyhastohappenat
alllayers• QualityoverquanCty• Carrierneutraliskey• ethtool,traceroute,tcpdump
PropertyofNetworkRedux,LLC
![Page 7: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/7.jpg)
DataBackups
• Donotrelyonthehostfordisasterrecovery• SLA’sarecarefultoindemnifyyourprovider• Ifyouarestoringclientdata,youneedtobackitup
andindemnifyyourself
• RAIDisNOTabackupstrategy• Understandtheretrievalprocess• Verifytheintegrityofyourbackuparchives
PropertyofNetworkRedux,LLC
![Page 8: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/8.jpg)
TwoCommonApproaches
• Agentresidesonserver• Masterpullservers• Expensive• Proprietary• VeryReliable• Manycommercial
vendors
PropertyofNetworkRedux,LLC
Pull – Agent / Host Push – server to server
• Serverpushesdata• Rsync/rsnapshot• Inexpensive• Easytodeploy• Asreliableasyoudesignit• MorehomegrownsoluCons
![Page 9: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/9.jpg)
TheAgent/HostModel
• Commonlydeployedinhostedenvironments
• Worksatthechassislevel• Moreodenthannotakernelmodule
• CanprovideCDP(ConCnuousDataProtecCon)• EncrypCon,DiskVerificaCon• CDPfromR1Sodishiengthesweetspot
PropertyofNetworkRedux,LLC
![Page 10: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/10.jpg)
CommonIssues
• Don’tassumeyourproviderisbackingup
• Don’tassumethebackupdatahasbeenverified• DataisulCmatelythedevelopersresponsibility
• Becarefulwithprovidersnotwillingtobackupyourdata• Haveyourowndisasterrecoveryplan
PropertyofNetworkRedux,LLC
![Page 11: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/11.jpg)
Power
• UnbelievablycriCcal,mostcommonpointoffailureinafacility
• Powercreatesheat,andheatcauseshardwaretofail
• SystemAdministratorsarenotElectricians
PropertyofNetworkRedux,LLC
![Page 12: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/12.jpg)
KeyPointsonPower
• Redundantpowersuppliesneedtoroutethroughdiversepowerpaths
• AutomatedTransferSwitches(ATS)canbeasinglepointoffailure
PropertyofNetworkRedux,LLC
![Page 13: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/13.jpg)
Servers–ResourcesandMetrics• CPU,MemoryandDiskIO• DiskIOisthemostcommonly
overlookedandleastunderstoodbo]leneck
• WerarelyseeCPU’sasthebo]lenecksforapplicaConhosCng
• Memoryisaneasytounderstand,easytoinflate/deflatecommodity
• ThingsodenfindtheirwaybacktoslowdiskaccessCmes
PropertyofNetworkRedux,LLC
![Page 14: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/14.jpg)
NarrowinginonDiskI/O• Disksaretheslowestcomponent
• SATAandSASarewidelyinuse• RAID–Balancingperformanceandcost.
• Don’tconfusememoryshoriallswithdiskaccessproblems• Disksarethemostcommoncomponenttofail
• sarandiostatarevaluabletools• Profileyourenvironmenttobestgaugeyourrequirements
PropertyofNetworkRedux,LLC
![Page 15: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/15.jpg)
Profilingyourrequirements• SystemmetricsarecriCcal
• Eachservicelayerisitsowndiscussion
• Cachingwillsavetheday
• Logfilesareunderrated
• sarandvmstatarefantasCc
• ProfilingyourapplicaConrequirementswillensureefficientspendingforservices
PropertyofNetworkRedux,LLC
Sometimes performance tuning must be “out of the box.” Analysis on the microscopic level should regularly be retired to more macroscopic views. This multiresolutioned problem analysis can turn a question such as “How can I merge all these log files faster?” into “Why do I have all these log files to merge and is there a better way?” Or a question such as “How can I make this set of problematic database queries faster?” becomes “Why am I putting this information in a database?”
Theo Schlossnagle Scalable Internet Architectures
![Page 16: Bridging the Developer and the Datacenter](https://reader034.vdocuments.net/reader034/viewer/2022052619/55583a18d8b42acb078b4af4/html5/thumbnails/16.jpg)
networkredux.com