exoscale at the cloudstack user group london - june 26th 2014
DESCRIPTION
TRANSCRIPT
CloudStack European User Group -‐ London June 26th, 2014
Short Bio
! Antoine Coetsier
– CEO of exoscale
– OperaEons of datacenters and websites at scale
– 10+ years in service provider business
... a IaaS provider and beyond
! Cloud hos5ng based on latest technology § Flexible server and storage infrastructure § Trimmed for performance, intuiEve usability and tooling
! Market place for value added applica5ons § One-‐stop-‐shop to reduce infrastructure complexity for developers and sysadmins
exoscale in a nutshell... The safe home for your cloud applicaEons
... with a solid background
! Trust rela5onship with the cloud provider § Started 2011 within VelEgroup § Access to know-‐how, resources and clients
! Swiss company § Proximity to EMEA clients § Swiss data privacy standards
3
99.95% Pla$orm availabilty
exoscale: a VelEgroup company
All over Switzerland
100% ICT needs covered
470+ ICT professionals
Cloud Services ICT specialized companies ConsulEng
exoscale offering overview A one-‐stop-‐shop for developers/sysadmins and business IT
5
Open Cloud
Open Cloud Compute Open Cloud Storage
Managed Cloud Sw
iss
Supp
ort Virtual data center
Zones & Networking
Market place / add-‐on services
! Vendor backed ! TransiEon product for business IT migraEng to the cloud – Hybrid Cloud
! One-‐stop-‐shop for SaaS companies ! Pure-‐play cloud offering (web-‐based purchase) ! Worldwide market pricing
Datacenters locaEon: swiss based
! Geneva downtown ! Tier 3+ class ! Interna5onal Carrier hotel ! ISO 9001 quality management and ISO27001 secure access procedure
! Physical hosEng capabiliEes
! Geneva surroundings ! Tier 3+ class ! ReplicaEon site or acEve/acEve ! ISO 9001 quality management and ISO27001 secure access procedure
! Physical hosEng capabiliEes
Datacenter 01 Datacenter 02
Summer 2014: new zone in Zurich area
Open Cloud -‐ Compute
Open Cloud compute: instances for Devs and Sysadmins
! Direct, simple to use cloud instances for Devs and Sysadmins
! Open – Open source based – Standard API – MulE OS:
! Ease of use – Direct console – Integrated support
! Performance – KVM – Persistent storage and IP – 10 GB networking
! Security features – Security groups – SSH keypair management
Open Cloud compute: a unique portal
! One comprehensive portal for instance management, support, documentaEon and billing informaEon
Scalable security
Your tenant
Internet
public IPpublic IP
Security group A
public IPpublic IP
Security group B
Controlled Inbound and Outbound traffic
Open Cloud compute: key Features
Topic Open cloud compute
Cloud Control System Apache CloudStack
Hypervisor KVM
Storage Local SAS Storage
Admin interface Own provisioning interface
Network Security Groups / Public IPs
Billing and pricing Hourly aggressive pricing Online payment
Open Cloud Storage
Open Cloud Storage Unique Swiss object storage offering currently in private beta
12
! Unique object storage offering in Switzerland
! AWS S3 compliant
! Each object is stored in 3 copies
! Focus on performance
Object Storage background
S3 API
unlimited Buckets
Objects or files
! Object storage unlike file storage focuses on high performance and unlimited scalability of storage
! Open Sourced under hfp://pithos.io
Open Cloud -‐ Apps
Open Cloud apps Rapid applicaEon integraEon and deployement
14
! PaaS*: Plahorm as a service – Languages – First in Switzerland
! Databases and cache via addons: – SQL – Memcache – ....
! Commit your code – git commit –m –c ‘ready for prod’
! Push your applicaEon to exoscale apps – exoapp default/myapp push
! Deploy applicaEon – exoapp default/myapp deploy
! Rollback, push new version, a branch ... – Without losing a single user connecEon
Standard Typical workflow
From development to testing to production right from developer tools
ApplicaEon scaling Containers can scale horizontally and verEcally
15
! Advanced features
– Custom domain names
– hfps or websockets load balancer
– SSH connecEon
– Log viewing
– Buildpacks support
Open Cloud Compute
Open Cloud pricing Flexible and clear pricing structure
16 1) Some extreme combinaEons not possible 2) Memory Hours (128MB container for one hour)
Type RAM CPU Monthly price micro 512 MB 1 CHF 14.98 Eny 1’024 MB 1 CHF 26.46 small 2’048 MB 2 CHF 52.38 medium 4’096 MB 2 CHF 82.08 large 8’192 MB 4 CHF 164.16 extra large 16’384 MB 4 CHF 282.42 huge 32’768 MB 8 CHF 552.96
Size Monthly price 10 GB CHF 1.44 50 GB CHF 7.20 100 GB CHF 14.40 200 GB CHF 28.80 400 GB CHF 57.60
Detailed Instance Pricing1
Detailed Root Disk Pricing1 Windows License Pricing
Monthly price CHF 18.72
Open Cloud Storage
Monthly price: CHF 0.10 / GB
Detailed Object Storage Pricing
Networking
Detailed Network Pricing
Type Price in CHF 0.00 / GB out CHF 0.0765 / GB (first 100 GB free) inter-‐zone CHF 0.00 / GB
Market place
Hourly price CHF 0.01 / MeH
Detailed Added Value Pricing
PaaS
! Easy and clear pricing structure
! All services are charged on a per minute rate
! Highly compeEEve prices
Cloud Design Decisions
Cloud OperaEons at Scale
! service ! infrastructure ! sonware ! people
! Excellence in Datacenter management
! Excellence in OrchestraEon Sonware Development
Building blocks Success factors
Service: Simplicity and Scalability
! Cloudstack based – Great extensibility, easy to plug into – Less clufered than compeEEon
! Basic networking ! Local storage
! KVM hypervisor: SmartOS inspired – Best in class hypervisor. – Diskless and netboot approach. – Avoids resource waste, facilitates upgrades.
Infrastructure
! ConfiguraEon management ! Visibility
! Build factory
! Remote execuEon
! new machines have roles ! role defines converged configuraEon as sum of components
! each component has an expected normal state and reports it
! no local intervenEon needed
Requirements The “Good Ci5zen Contract”
ConfiguraEon management, why ?
! RepeEEve tasks are boring and cost Eme
! Adding & managing more and more
– Quickly if required !
! Deploy & maintain the same configuraEon
everywhere
! Adjust conEnuously
! bafle tested tool ! simple declaraEve DSL to express configuraEon ! fits our component approach well
“It is only infrastructure, it does not change” FALSE
Puppet
Over 3000 commits !
Therefore we need “good ciEzens”
! A machine should: AutomaEcally deploy itself (Almost)
Find its idenEty setngs (name, networks,...)
Install the necessary packages for which it was intended
Register itself to all tools
Live along its peers and respect regulaEons
Report to city hall if anything goes wrong
Visibility vs monitoring
! Monitoring is part of visibility – TradiEonally: service up, CPU, RAM, network & disk I/O
! Are we generaEng business value ? – Need more insight into applicaEon behavior (who using what, ...)
Trends
! If it moves, graph it
! If it doesn't move, graph it in case it starts moving
! If it breaks once, monitor it ! QuesEon, adapt and modify thresholds conEnuously
What is different in the cloud ?
! Distributed systems
! Lots of moving parts
! Scale
! Easy tools to quickly assess producEon status required
Visibility stack: logs, metrics, alerts
! Collectd: light metric generator
! Logstash: Open Source Log collector
! ElasEcSearch: distributed indexing
! Kibana: log search and query
! Riemann: event streaming
BUILD FACTORY
! over 60 build jobs
! Ees into our code hosEng plahorm
! handled by jenkins
! generates valid and signed Debian repositories
! ensures fast upgrades
! simplifies configuraEon management
con5nuous integra5on
package repositories
Looking back
28
! Cloudstack is a solid foundaEon for a IAAS plahorm – Beware of complex features – The virtual router is not opEmum – Concurrency issues can arise at scale
! There's a bit more to it than just installing cloudstack – Customer management – Real-‐Eme metering and billing – Integrated console – A few other things ...
! Building a sustainable and scalable plahorm on top of cloudstack is possible
And now?
My recommendaEons
! Be ready ! 1. Test even if you do not have a business case 2. Make a proof of concept 3. Rent a tenant
PROACTIVE
REACTIVE
Thank you for your afenEon
! Contact us +41 58 668 56 00 [email protected]
! Follow us @exoscale
exoscale code
Head Office Lausanne Avenue de Provence 4 CH -‐ 1007 Lausanne
Opera5ons: Geneva Rue du Pré de la Fontaine 19 CH -‐ 1217 Meyrin
Bern Office Talstrasse 3 CH -‐ 3053 Münchenbuchsee
Zurich Office Glaf Tower CH -‐ 8301 Glafzentrum