exoscale at the cloudstack user group london - june 26th 2014

31
CloudStack European User Group London June 26th, 2014

Upload: antoine-coetsier

Post on 23-Aug-2014

116 views

Category:

Internet


10 download

DESCRIPTION

 

TRANSCRIPT

Page 1: exoscale at the CloudStack User Group London - June 26th 2014

CloudStack  European  User  Group  -­‐  London  June  26th,  2014  

Page 2: exoscale at the CloudStack User Group London - June 26th 2014

Short  Bio  

!  Antoine  Coetsier  

– CEO  of  exoscale  

– OperaEons  of  datacenters  and  websites  at  scale  

– 10+  years  in  service  provider  business  

Page 3: exoscale at the CloudStack User Group London - June 26th 2014

...  a  IaaS  provider  and  beyond  

!   Cloud  hos5ng  based  on  latest  technology    §  Flexible  server  and  storage  infrastructure  §  Trimmed  for  performance,  intuiEve  usability  and  tooling  

!   Market  place  for  value  added  applica5ons  §  One-­‐stop-­‐shop  to  reduce  infrastructure  complexity  for  developers  and  sysadmins  

exoscale  in  a  nutshell...  The  safe  home  for  your  cloud  applicaEons  

...  with  a  solid  background  

!   Trust  rela5onship  with  the  cloud  provider  §  Started  2011  within  VelEgroup  §  Access  to  know-­‐how,  resources  and  clients  

!   Swiss  company  §  Proximity  to  EMEA  clients  §  Swiss  data  privacy  standards  

3  

99.95%  Pla$orm  availabilty  

Page 4: exoscale at the CloudStack User Group London - June 26th 2014

exoscale:  a  VelEgroup  company  

All  over    Switzerland  

100%    ICT  needs  covered  

470+    ICT  professionals    

Cloud  Services  ICT  specialized  companies  ConsulEng  

Page 5: exoscale at the CloudStack User Group London - June 26th 2014

exoscale  offering  overview  A  one-­‐stop-­‐shop  for  developers/sysadmins  and  business  IT  

5  

Open  Cloud  

Open  Cloud  Compute   Open  Cloud  Storage  

Managed  Cloud  Sw

iss  

Supp

ort  Virtual  data  center  

Zones  &  Networking  

Market  place  /  add-­‐on  services  

!   Vendor  backed  !   TransiEon  product  for  business  IT  migraEng  to  the  cloud  –  Hybrid  Cloud  

!   One-­‐stop-­‐shop  for  SaaS  companies  !   Pure-­‐play  cloud  offering  (web-­‐based  purchase)  !  Worldwide  market  pricing  

Page 6: exoscale at the CloudStack User Group London - June 26th 2014

Datacenters  locaEon:  swiss  based  

!    Geneva  downtown  !    Tier  3+    class  !    Interna5onal  Carrier  hotel  !    ISO  9001  quality  management  and    ISO27001  secure  access  procedure  

!    Physical  hosEng  capabiliEes  

!    Geneva  surroundings  !    Tier  3+  class  !    ReplicaEon  site  or  acEve/acEve  !    ISO  9001  quality  management  and    ISO27001  secure  access  procedure  

!    Physical  hosEng  capabiliEes  

Datacenter  01   Datacenter  02  

Summer  2014:  new  zone  in  Zurich  area  

Page 7: exoscale at the CloudStack User Group London - June 26th 2014

Open  Cloud    -­‐  Compute  

Page 8: exoscale at the CloudStack User Group London - June 26th 2014

Open  Cloud  compute:  instances  for  Devs  and  Sysadmins  

!  Direct,  simple  to  use  cloud  instances  for  Devs  and  Sysadmins  

!  Open  – Open  source  based  – Standard  API      – MulE  OS:    

!  Ease  of  use  – Direct  console  – Integrated  support  

 

!  Performance  – KVM  – Persistent  storage  and  IP  – 10  GB  networking  

   

 !  Security  features  – Security  groups  – SSH  keypair  management  

Page 9: exoscale at the CloudStack User Group London - June 26th 2014

Open  Cloud  compute:  a  unique  portal  

!  One  comprehensive  portal  for  instance  management,  support,  documentaEon  and  billing  informaEon    

Page 10: exoscale at the CloudStack User Group London - June 26th 2014

Scalable  security  

Your tenant

Internet

public IPpublic IP

Security group A

public IPpublic IP

Security group B

Controlled Inbound and Outbound traffic

Page 11: exoscale at the CloudStack User Group London - June 26th 2014

Open  Cloud  compute:  key  Features

Topic   Open  cloud    compute  

Cloud  Control  System   Apache  CloudStack  

Hypervisor   KVM  

Storage   Local  SAS  Storage  

Admin  interface   Own  provisioning  interface  

Network   Security  Groups  /  Public  IPs  

Billing  and  pricing   Hourly  aggressive  pricing  Online  payment  

Page 12: exoscale at the CloudStack User Group London - June 26th 2014

Open  Cloud  Storage  

Open  Cloud  Storage  Unique  Swiss  object  storage  offering  currently  in  private  beta  

12  

!   Unique  object  storage  offering  in  Switzerland  

!   AWS  S3  compliant  

!   Each  object  is  stored  in  3  copies  

!   Focus  on  performance  

Object  Storage  background  

S3  API  

 unlimited  Buckets  

Objects  or  files  

!  Object  storage  unlike  file  storage  focuses  on  high  performance  and  unlimited  scalability  of  storage  

!  Open  Sourced  under  hfp://pithos.io    

Page 13: exoscale at the CloudStack User Group London - June 26th 2014

Open  Cloud    -­‐  Apps  

Page 14: exoscale at the CloudStack User Group London - June 26th 2014

Open  Cloud  apps  Rapid  applicaEon  integraEon  and  deployement  

14  

! PaaS*:  Plahorm  as  a  service  – Languages    – First  in  Switzerland  

!  Databases  and  cache  via  addons:  – SQL  – Memcache  – ....  

!  Commit  your  code  –   git  commit  –m  –c  ‘ready  for  prod’  

!  Push  your  applicaEon  to  exoscale  apps  –   exoapp  default/myapp  push  

!  Deploy  applicaEon  –   exoapp  default/myapp  deploy  

!  Rollback,  push  new  version,  a  branch  ...  – Without  losing  a  single  user  connecEon  

Standard   Typical  workflow  

From development to testing to production right from developer tools

Page 15: exoscale at the CloudStack User Group London - June 26th 2014

ApplicaEon  scaling  Containers  can  scale  horizontally  and  verEcally

15  

!  Advanced  features  

– Custom  domain  names  

– hfps  or  websockets  load  balancer  

– SSH  connecEon  

– Log  viewing  

– Buildpacks  support  

Page 16: exoscale at the CloudStack User Group London - June 26th 2014

Open  Cloud  Compute  

Open  Cloud  pricing  Flexible  and  clear  pricing  structure  

16  1)  Some  extreme  combinaEons  not  possible  2)  Memory  Hours  (128MB  container  for  one  hour)  

Type   RAM   CPU   Monthly  price  micro   512  MB   1   CHF  14.98  Eny   1’024  MB   1   CHF  26.46  small   2’048  MB   2   CHF  52.38  medium   4’096  MB   2   CHF  82.08  large   8’192  MB   4   CHF  164.16  extra  large   16’384  MB   4   CHF  282.42  huge   32’768  MB   8   CHF  552.96  

Size   Monthly  price  10  GB   CHF  1.44  50  GB   CHF  7.20  100  GB   CHF  14.40  200  GB   CHF  28.80  400  GB   CHF  57.60  

Detailed  Instance  Pricing1  

Detailed  Root  Disk  Pricing1   Windows  License  Pricing  

Monthly  price  CHF  18.72  

Open  Cloud  Storage  

Monthly  price:  CHF  0.10  /  GB    

Detailed  Object  Storage  Pricing  

Networking  

Detailed  Network  Pricing  

Type   Price  in   CHF  0.00  /  GB  out   CHF  0.0765  /  GB  (first  100  GB  free)  inter-­‐zone   CHF  0.00  /  GB  

Market  place  

Hourly  price  CHF  0.01  /  MeH  

Detailed  Added  Value  Pricing  

PaaS  

!   Easy  and  clear  pricing  structure  

!   All  services  are  charged  on  a  per  minute  rate  

!   Highly  compeEEve  prices  

Page 17: exoscale at the CloudStack User Group London - June 26th 2014

Cloud  Design  Decisions  

Page 18: exoscale at the CloudStack User Group London - June 26th 2014

Cloud  OperaEons  at  Scale  

 !  service    !  infrastructure    !  sonware    !  people    

!  Excellence  in  Datacenter  management  

!  Excellence  in  OrchestraEon  Sonware  Development  

Building  blocks   Success  factors  

Page 19: exoscale at the CloudStack User Group London - June 26th 2014

Service:  Simplicity  and  Scalability  

! Cloudstack  based  – Great  extensibility,  easy  to  plug  into  – Less  clufered  than  compeEEon  

!  Basic  networking  !  Local  storage  

!  KVM  hypervisor:  SmartOS  inspired  – Best  in  class  hypervisor.    – Diskless  and  netboot  approach.  – Avoids  resource  waste,  facilitates  upgrades.    

Page 20: exoscale at the CloudStack User Group London - June 26th 2014

Infrastructure  

!  ConfiguraEon  management    !  Visibility  

!  Build  factory  

!  Remote  execuEon    

!  new  machines  have  roles  !  role  defines  converged  configuraEon  as  sum  of  components    

!  each  component  has  an  expected  normal  state  and  reports  it    

!  no  local  intervenEon  needed    

Requirements   The  “Good  Ci5zen  Contract”  

Page 21: exoscale at the CloudStack User Group London - June 26th 2014

ConfiguraEon  management,  why  ?    

!    RepeEEve  tasks  are  boring  and  cost  Eme  

!  Adding  &  managing  more  and  more  

– Quickly  if  required  !  

!    Deploy  &  maintain  the  same  configuraEon  

everywhere  

!    Adjust  conEnuously  

 

!  bafle  tested  tool  !  simple  declaraEve  DSL  to  express  configuraEon  !  fits  our  component  approach  well  

“It  is  only  infrastructure,  it  does  not  change”  FALSE  

Puppet    

Over  3000  commits  !  

Page 22: exoscale at the CloudStack User Group London - June 26th 2014

Therefore  we  need  “good  ciEzens”  

!    A  machine  should:  AutomaEcally  deploy  itself  (Almost)  

Find  its  idenEty  setngs  (name,  networks,...)  

Install  the  necessary  packages  for  which  it  was  intended  

Register  itself  to  all  tools  

Live  along  its  peers  and  respect  regulaEons  

Report  to  city  hall  if  anything  goes  wrong  

Page 23: exoscale at the CloudStack User Group London - June 26th 2014

Visibility  vs  monitoring  

!    Monitoring  is  part  of  visibility  – TradiEonally:  service  up,  CPU,  RAM,  network  &  disk  I/O  

 !    Are  we  generaEng  business  value  ?  – Need  more  insight  into  applicaEon  behavior  (who  using  what,  ...)  

Page 24: exoscale at the CloudStack User Group London - June 26th 2014

Trends  

!    If  it  moves,  graph  it  

!    If  it  doesn't  move,  graph  it  in  case  it  starts  moving  

!    If  it  breaks  once,  monitor  it    !    QuesEon,  adapt  and  modify  thresholds  conEnuously  

Page 25: exoscale at the CloudStack User Group London - June 26th 2014

What  is  different  in  the  cloud  ?  

!    Distributed  systems  

!    Lots  of  moving  parts  

!    Scale  

!    Easy  tools  to  quickly  assess  producEon  status  required  

Page 26: exoscale at the CloudStack User Group London - June 26th 2014

Visibility  stack:  logs,  metrics,  alerts  

! Collectd:  light  metric  generator  

! Logstash:  Open  Source  Log  collector  

! ElasEcSearch:  distributed  indexing  

! Kibana:  log  search  and  query  

!  Riemann:  event  streaming  

 

Page 27: exoscale at the CloudStack User Group London - June 26th 2014

BUILD  FACTORY    

!  over  60  build  jobs  

!  Ees  into  our  code  hosEng  plahorm  

!  handled  by  jenkins    

!  generates  valid  and  signed  Debian  repositories  

!  ensures  fast  upgrades  

!  simplifies  configuraEon  management    

con5nuous  integra5on      

package  repositories    

Page 28: exoscale at the CloudStack User Group London - June 26th 2014

Looking back

28  

! Cloudstack  is  a  solid  foundaEon  for  a  IAAS  plahorm  – Beware  of  complex  features  – The  virtual  router  is  not  opEmum  – Concurrency  issues  can  arise  at  scale  

!  There's  a  bit  more  to  it  than  just  installing  cloudstack    – Customer  management    – Real-­‐Eme  metering  and  billing    – Integrated  console  – A  few  other  things  ...  

!  Building  a  sustainable  and  scalable  plahorm  on  top  of  cloudstack  is  possible    

Page 29: exoscale at the CloudStack User Group London - June 26th 2014

And  now?  

Page 30: exoscale at the CloudStack User Group London - June 26th 2014

My  recommendaEons  

!  Be  ready  !  1.  Test  even  if  you  do  not  have  a  business  case    2. Make  a  proof  of  concept  3. Rent  a  tenant    

 PROACTIVE  

 REACTIVE  

 

Page 31: exoscale at the CloudStack User Group London - June 26th 2014

Thank  you  for  your  afenEon  

!    Contact  us  +41  58  668  56  00  [email protected]        

 

!    Follow  us  @exoscale    

exoscale  code      

Head  Office  Lausanne  Avenue  de  Provence  4  CH  -­‐  1007  Lausanne  

Opera5ons:  Geneva  Rue  du  Pré  de  la  Fontaine  19  CH  -­‐  1217  Meyrin  

Bern  Office  Talstrasse  3    CH  -­‐  3053  Münchenbuchsee  

Zurich  Office  Glaf  Tower    CH  -­‐  8301  Glafzentrum