enovance make your cloud
TRANSCRIPT
Make Your Cloud
September 21, 20111
Raphaël Ferreira - CoFounder
@ enovance
2
3
Cloud Services Managed ServicesBest User Experience OpenSource
Dedicated Platforms
Cloud Platforms
Make Your Cloud
Private CloudSingle Servers
Cloud ServersCloud StorageAppStore
Hybrid
24x7x365 Managed
Advanced Services
ProActive RunPerformance Run
Multi-Cloud MngtInfrastructures Design
High Performance
High Availability
Web OptimizationAcceleration
ClustersMulti-homing
Content Caching
Open Source
Open Cloud
Labs
Web orientedInfrastructures
Cloud MngtAutomationNoSQL
http://testerprogram.enovance.com www.enovance.com
4
Cloud ?IaaS
PaaS SaaS
Cloud BurstHybrid Cloud
Public Cloud
Private Cloud
Don’t care - we talk about Services
5
Cloud is about : On-Demand Self ServiceBroad Network AccessRessource PoolingRapid ElasticityMeasured Service
6
Destination ?Cloud !
«If you don’t know where you’re going, any road will get you there.»
Lewis Caroll
«Companies that took a disciplined approach to adopting cloud computing reduced costs by an
average of 18% and data center power consumption by 16%.
Companies that adopted cloud computing haphazardly increased IT costs by 2-3%.»
Aberdeen Group
Hybrid
7
Define your objectivesWorking on real uses cases !
eCommerceInformation system
Big DataDev/Test
Scalable websiteGaming
Legacy apps
Public Private
Rented servicesMulti-tenancySelf-service...
AutomationDedicated securityCustom design...
8
Cloud is about businessStop thinking about technology
How can 10 days to 5 minuteschange how you innovate ?
What happens when you can get 10 servers to test a new idea and your total costs is 500€ ?
If you don’t have to wait, will you get more done ?
Agility enables new Opportunities
How can 10 days to 5 minutes change how you innovate?
What happens when you can What happens when you can get 10 servers to test a new idea and your total costs is $500?
If you don’t have to wait, will you get more done?
Page 10
9
Cost basis of infrastructure Cloud
Exercise: What is the cost basis of infrastructure cloud hardware?
Building a business case :• Need margin for : technical operations, HR, administration costs• You can sell a 10 GB RAM virtual machine for 40-cents an hour (288 € / month)• You can buy 40 GB RAM machines• The practical life of the machines is 5 years
How much can you spend on hardware/software to build the infrastructure to give a reasonable margin 70% to the rest of the business?
➡ 288€ / month x 4 VM per server x 60 months x 30% = 20 736 € for machine, software and tenancy costs (rack, power, cooling....)
10
But most of the cloud effort is hidden
Financials Policies
Cloud Management VM Automation, Physical Provisioning, APIs, Self-service portal, Monitoring...
ITIL / ITSM Service Catalog, Configuration management, Service level management
Network Engineering Vlan planning, Capacity planning, Manageability
Storage Backup & Archive, Disaster recovery, Access control, Policy management
Support Services Help Desk operations, Diagnostic tools
CapEx vs OpEx, Shared services, Entry/Exit, IT Chargeback, ROI
11
You need to be competitive
You need to be agile
You need to build an Open Source Cloud
12
Why Open Source ?
• Typically user-driven solutions to real problems• Larger user base, users helping users • Lower barrier to participation• Aggressive release cycles can stay current with the state-of-the-art• Try before you “buy”, no brochureware, no “PowerPoint software• Open data, Open standards, Open APIs
13
Financial ApproachRemember : our business case
• You want to sell a 10 Gb ram virtual machine for 40-cent an hour (288 € / month)
• You target a margin of 70% for the rest of the costs (operations, HR, dev, administration...)
• For five years your budget per machine is 20 736 € for machine, software and tenancy costs
• Annual budget per server = 4147 €• Price of the machine = 6000 € / 5 = 1200 €• Rack / Network= 1500 €• Rest 1447 € for all the software & cloud stack
14
The 3 Steps
15
Forget what you know about IT admin
Not same services as traditional DC / HostingNetworking different
Storage differentDesign for Failure
Reliance on Configuration Management1 admin for hundreds physical machines vs. 1 admin for thousands of VMs
16
Step 1 : Build a ressource pool with virtualization and management
Applications Provision
Databases
Virtualization
OS
Hardware
Configure
Patch
Troubleshoot
Deploy
Unified Automation
ScriptsSchedule
TemplatesManual
17
Step 2 : Automate accross domains2. automate across domains – typical scenario
DATABASE
OPERATIONS
SERVICE MANAGER
BUSINESS MANAGER CUSTOMER
APPLICATIONS
SECURITY
IT
REQUIRED FORMS
NEW SERVICE REQUEST
REQUEST FOR SUPPORT
REQUEST FOR IT RESOURCES
PROVISION APPLICATIONS
SERVICE DELIVERED
REQUEST FULFILLED AND APPROVED
USER ID CREATED
ROLES ESTABLISHED ACCESS APPROVAL
REQUEST FOR ACCESS
11
10
2
1
3
4
7
8 6
5
9
Typical Scenario
18
Step 2 : Automate accross domains
Automated Scenario
2. automate across domains – automated scenario
BUSINESS MANAGER
CUSTOMER
19
Step 3 : Integrate Service Management
service management – self-service
Specify OS & Applications
Reserve Systems
Select Resources
Cost
Time to value
Requirements
Deprovision
Place Order /Reserve
AutomaticallyConfigure
Optimallyutiliizedassets
Specify OS & Applications Select Ressources Reserve System
20
How to Start ?The Tools
21
Openstack part of the solutionEcosystem
Billing Portal
Authentification
Datacenter
Hardware
Installer
Network
Front-End
Ops
22
Openstack Compute
Build your cloud with commodity hardware
Multiple hypervisors supportProvides APIs & Portal
Several network configurations
OpenStack Compute: Commodity Hardware
Monday, April 11, 2011
- Image: Keith in the KT Data Center- There are other drop-in solutions for infrastructure clouds from Cisco/EMC/VMWare. This is not one of them. - It's designed around off-the-shelf, lower-price point components- We're using Arista for our networking layer.- Nasa uses off-the-shelf AoE hardware for storage.- I imagine that we'll use Nexenta for iSCSI blocks (when that's available)- Compute nodes direct from a Taiwanese manufacturer -- not Dell/IBM/HP
23
Cloud Storage
• VM-Backing Storage
• Block Storage
• Object Storage
Cloud Storage
Monday, April 11, 2011
- Image: Hitachi 2TB desktop drive we use in our Object Storage Cluster
VM Backing StorageBlock Storage
Object Storage
24
VM Backing Storage
• 'laying-down' OS Image• A place for the running VM• Local Disk vs SAN• Ephemeral vs persistent
25
OpenStack Object Storage
Data Storage
API
Open Stack Object Storage
Monday, April 11, 2011
Just to baseline. Swift is the project name for the OpenStack Object Storage.
It’s a storage service that is accessed via an API. Via the api you can create containers and PUT objects (data) into them. ***That’s about it.It’s not a blocks.It’s not a filesystem.
Needs an ecosystem
26
OpenStack Object Storage
5 Object Stores5 Object Stores
5 Object Stores
4 Proxy Servers
5 Object Stores5 Object Stores
216 To Utiles75 000 €
Newish Xeon48 Go of ram
36 x 2 To Sata - No Raid
Newish Xeon24 Go of ram
10 Gbps Ethernet
27
OpenStack Object Storage
7kW
Monday, April 11, 2011
The Data CenterOne of the 1st things to note is power density -or- space requirements of the system- mechanical things tend to draw a lot of power. - In our configuration, to utilize a full-rack in a data center, we had to live in a “high-density” neighborhood of the data center. - Our configuration runs with 10 4u object stores ran 7kw a rack - That’s 370 drives per rack.- Careful when powering up whole racks- Plan accordingly
- The other option for us was to “go wide” and run 1/2 racks, where we would use more space.
Aggregation Aggregation
Access
Access
Switch Switch
Access
Access
1GbE1GbE
10GbE10GbE
Networking
Monday, April 11, 2011
The NetworkingWe took a 2-tier approach.It starts out with a pair of redundant aggregation switches. A single switch would be a single point of failure.
All requests go through the “Access Layer” that connect directly to the aggregation switches at 10GbE.- The access layer contains proxy servers, authentication, load balancers, etc.
Each rack has a single switch that is connected via 10GbE to the aggregation layer.- We went with single as we plan on being able to handle single rack failures.
And it tapers down to 1GbE to an individual object store from the top-of-rack switches.
28
ToolChain (n) :
Con!guration
Patching and Provisioning
Monitoring
A set of tools where the output of one tool becomes the input of
another tool
29
Provisioning Tools
Configuration Management
Monitoring Tools
Automation / Orchestration
Chef, PXE, Crowbar
Cfengine, Chef, Puppet
Nagios, Zabbix, Zenoss (automate agent instal)
Capistrano, RunDeck, MCollective (replace rather than repair)
30
Example of ToolChain
Launch BootStrap Image
Provisioning (Cobbler, Spacewalk)
Con!guration (Puppet, Chef )
Start/Stop Services (RunDeck,
Capistrano)
Monitor (Nagios, Zenoss)
31
Services Catalog & Apps
Building Apps
Publish Apps
Maintain Apps
VM Tee-Shirts
Storage Types
Bandwith
SaaS
Infrastructures ressources PaaS ressources End-Users ressources
Service Portal - AppStore - Cloud Library
32
What about billing ?
Define your criteria :Ram hours
Storage usageRequest
Collect and store metrics
Raphaël FerreiraT./ +33 1 49 70 99 72M./ [email protected]
http://www.enovance.comhttp://testerprogram.enovance.comhttp://twitter.com/enovance
33
Q & R