Cloudloundry on CpenSLack LlghLnlng 1alk aL SwlssCpenSLack user Croup Meeung 19.2.2013 ChrlsLof.Maru[zhaw.ch #lCCLab / ZPAW www.cloudcomp.ch School ofEngineeringInIT Institute of AppliedInformation TechnologyZurich Universityof Applied SciencesCuLllne Cloudloundry lnsLallauon opuons 8CSP 8CSP ComponenLs 8CSP 8ooLsLrap 19.02.13lCCLab - www.cloudcomp.ch2 Cloudloundry (very brlef) 19.02.13lCCLab - www.cloudcomp.ch3 lrameworks / 8unumes 19.02.13lCCLab - www.cloudcomp.ch4 Cloudloundry ArchlLecLure Source: n11 Communlcauons, cloudfoundry.org Cloudloundry ArchlLecLure Plghly redundanL (dlsLrlbuLed sLaLe, self-heallng, horlzonLally scalable) Scallng ln number of vMs from one ! Mlcro-Cloudloundry (no redundancy) over hundreds ! rlvaLe aaS Lo Lhousands ! ubllc aaS rovlder cloudfoundry.com, AcuveSLaLe, Applog, !oyenL, ...19.02.13lCCLab - www.cloudcomp.ch3 lnsLallauon Cpuons manual lnsLallauon posslble, buL really, really noL recommended dev_seLup (slmple chef based seLup) ouLdaLed, llkely Lo be deprecaLed soon Lhere ls an Cpscode verslon, sLaLus unknown 8osh 8ooLsLrapper (Mlcro-8CSP based) recommended for developers or small lnsLallauons 8CSP (roducuon Crade) recommended for medlum Lo large lnsLallauons 19.02.13lCCLab - www.cloudcomp.ch6 WhaL ls 8CSP 8osh CuLer Shell (don'L ask me where lL exacLly comes from) AuLomaLed lnsLallauon lnfrasLrucLure (llke Chef, uppeL, ...) speclallzed Lo run on Cloud Scale (Lhousands of vMs) on Lop of laaS lrameworks (CpenSLack, AWS, vMware,...) absLracLed uslng a Cloud rovlder lnLerface (Cl) Soware ueploymenL, Congurauon and updaLe Cpumlzed Lo mlnlmlze uownume SupporL for muluple vM roles 8elease ManagemenL wlLh verslonlng Acuve MonlLorlng and Alerung used Lo run cloudfoundry.com slnce launch 19.02.13lCCLab - www.cloudcomp.ch7 roducuon Crade Cloudloundry 19.02.13lCCLab - www.cloudcomp.ch8 Source: hup://de.slldeshare.neL/ramnlvas2/cloudfoundry-archlLecLure laaS neuLral by deslgn 19.02.13lCCLab - www.cloudcomp.ch9 8CSP Cloud rovlder lnLerface (Cl) by lsLon communlLy 8CSP ArchlLecLure 19.02.1310 slmple 8S server S3 ALmos (LMC) Source:hup://cloudfoundry.glLhub.com/docs/runnlng/deploylng-cf/componenLs/ 8CSP ComponenLs 19.02.13lCCLab - www.cloudcomp.ch11 8CSP Stemce|| vM lmage conLalnlng 8ase CS 8CSP AgenL Stemce||s Stemce|| vM lmage conLalnlng 8ase CS 8CSP AgenL Stemce|| vM lmage conLalnlng 8ase CS 8CSP AgenL Speclc for Lhe envlronmenL (e.g. laaS brand) ke|ease name verslon Iobs LlsL of lnsLrucuons Lo bulld, lnsLall and congure packages Soware ackages Congurauon 1emplaLes ScrlpLs Sohware ackages LxLernal/lnLernal uependencles ke|ease name verslon Iobs LlsL of lnsLrucuons Lo bulld, lnsLall and congure packages Soware ackages Congurauon 1emplaLes ScrlpLs Sohware ackages LxLernal/lnLernal uependencles ke|ease Descr|pnon name verslon Iobs LlsL of lnsLrucuons Lo bulld, lnsLall and congure packages Soware ackages Congurauon 1emplaLes ScrlpLs Sohware ackages LxLernal/lnLernal uependencles ke|eases lor Lhe publlc Cl 8elease descrlpuonsare provlded, buL can exLended Lolnclude addluonal servlces Dep|oyment Man|fest 8elease name & verslon SLemcells Lo use number of vMs for each !ob Dep|oyment Man|fest 8elease name & verslon SLemcells Lo use number of vMs for each !ob Dep|oyment Man|fest 8elease name & verslon SLemcells Lo use number of vMs for each !ob uescrlpuon of envlronmenL neLwork Servlce congurauons Man|fest Speclc Lo Lhe lnfrasLrucLure(e.g. dlerenL zones/areasllke developmenL, qa, sLress, sLaglng, producuon)Cl Congurauon Soware ackages SLemcell Congurauon Soware ackages SLemcell Congurauon Soware ackages SLemcell Lnv|ronments u8 & 8lobsLore 8unnlng vMs wlLh lnsLalled, congured packages & servlcesDep|oyments ln Lhe underlylng laaS LnvlronmenL 8unnlng vMs wlLh lnsLalled, congured packages & servlces8unnlng vMs wlLh lnsLalled, congured packages & servlcesLxample 8elease uenluon ---packages:- name: atmos_gateway verslon: 23 sha1: 9cb8fa4f742e3996fe407612ma3c930b37a0303 dependenc|es:- ruby - sq||te - name: backup_manager verslon: 28 sha1: cfe77af3aaab1b33d266670777231338338a837e dependencles:- sqllLe - ruby - name: cloud_conLroller verslon: 63 sha1: f2dcd178ee68207904023f1aa12279342432878c dependencles:- llbpq - mysqlcllenL - sqllLe - ruby - lnslghL_agenL ... [obs:- name: aLmos_gaLeway verslon: 9 sha1: 3b890af74233d7a3b6217a94f889f17a36c187ab - name: backup_manager verslon: 12 sha1: bd0edcc744c9831d07ed01ba23b83324d886361a - name: ccdb_posLgres verslon: 6 sha1: 6a421086337cd1e384b4d3306e647acdbe744e4e - name: cloud_conLroller verslon: 47 sha1: e40a473f8ae6a739ee2a3408b8d8234e327c30 - name: collecLor verslon: 3 sha1: 40bec23b3bd2d27ee821aeca0cd6493b28337139 ... 19.02.13lCCLab - www.cloudcomp.ch12 for publlc Cl see: hups://glLhub.com/cloudfoundry/cf-release/Lree/masLer/releases Lxample manlfesL for Mlcro-Cl --- deploymenL: mlcro release: name: mlcro verslon: 13 congurauon_hash: [} properues: mlcro: Lrue domaln: vcap.me env: neLworks: apps: local managemenL: local dea: max_memory: 2048 dea_nexL: memory_mb: 2048 dlsk_mb: 8192 num_lnsLances: 16 rouLer: cllenL_lnacuvlLy_umeouL: 600 app_lnacuvlLy_umeouL: 600 local_rouLe: 127.0.0.1 sLaLus: porL: 8080 user: password: .... cc: descrlpuon: "vMware's Mlcro Cloud Appllcauon lauorm" srv_apl_url: hup://apl.vcap.me password: Loken: allow_debug: Lrue allow_reglsLrauon: Lrue admlns: - admln[vcap.me admln_accounL_capaclLy: memory: 2048 app_urls: 32 servlces: 16 apps: 16 defaulL_accounL_capaclLy: memory: 2048 app_urls: 32 servlces: 16 apps: 16 new_sLager_percenL: 100 sLaglng_upload_user: sLaglng_upload_password: .... 19.02.13lCCLab - www.cloudcomp.ch13 hups://glLhub.com/cloudfoundry/cf-release/blob/masLer/mlcro/manlfesL.yml 8ooLsLrapplng Cl wlLh 8CSP 19.02.13lCCLab - www.cloudcomp.ch14 Mlcro8CSP (All of 8CSP ln1 vM) 1. lnsLall Mlcro8CSP use omclal new documenLauon: hup://cloudfoundry.glLhub.com/docs/runnlng/deploylng-cf/opensLack/ or slmpler 8CSP 8ooLsLrap hups://glLhub.com/SLarkAndWayne/bosh-booLsLrap # gem lnsLall bosh-booLsLrap # bosh-booLsLrap deploy --laLesL-sLemcell 8CSP (u8, 8lobsLore, ulrecLor + Worker nodes) 3.. vMs 2. lnsLall Mlcro8CSP Cloudloundry (Servlces + uLA vMs) 100-3000vMs 3. lnsLall Cloudloundry Zero Lo Cl ln a few hours # on your lapLop gem |nsta|| bosh-bootstrap bosh-bootstrap dep|oy # prompLs for AWS/CpenSLack credenuals # and some oLher elds LhaL you can # [usL press LnLer for. # SSP lnLo lncepuon vM bosh-bootstrap ssh g|t conhg --g|oba| user.ema|| "youQexamp|e.com" g|t conhg --g|oba| user.name "our Name" sudo gem |nsta|| bosh-c|oudfoundry export 1MDIk=]var]vcap]store]tmp bosh cf prepare system producnon # prompLs for a unS hosL for your Cloudloundry, such as mycompany.com # wlll generaLe a new l address # now seLup your unS for *.mycompany.com => new l address # Lhe re-run: bosh cf prepare system producnon # use speclal "cf deploy" Lo lnsLall vMC & creaLe lnlual vMC user bosh cf dep|oy # now we can grow our slngle vM deploymenL bosh cf change deas 100 bosh cf add serv|ce postgresq| bosh dep|oy 19.02.13lCCLab - www.cloudcomp.ch13 hups://glLhub.com/SLarkAndWayne/bosh-cloudfoundry Cuesuons We are hlrlng!!! lor more lnfos see:hup://www.cloudcomp.ch/2012/06/lcclab-open-posluons/ 19.02.13lCCLab - www.cloudcomp.ch16