virtualization and cloud computing with elastic server on demand

105
Virtualization with Elastic Server On Demand Yan Pritzker [email protected] http://elasticserver.com

Upload: yan-pritzker

Post on 22-Nov-2014

13.721 views

Category:

Technology


0 download

DESCRIPTION

Elastic Server On Demand: deploying using virtualization on the desktop, in the datacenter, and in the clouds

TRANSCRIPT

Page 1: Virtualization and Cloud Computing with Elastic Server On Demand

Virtualization withElastic Server On Demand

Yan [email protected]

http://elasticserver.com

Page 2: Virtualization and Cloud Computing with Elastic Server On Demand
Page 3: Virtualization and Cloud Computing with Elastic Server On Demand

• What is Virtualization

Page 4: Virtualization and Cloud Computing with Elastic Server On Demand

• What is Virtualization

• Why should I care?

Page 5: Virtualization and Cloud Computing with Elastic Server On Demand

• What is Virtualization

• Why should I care?

• How can I get started?

Page 6: Virtualization and Cloud Computing with Elastic Server On Demand

Virtualization

Page 7: Virtualization and Cloud Computing with Elastic Server On Demand

Virtualization

• Run multiple virtual computers on one physical box.

Page 8: Virtualization and Cloud Computing with Elastic Server On Demand

Virtualization

• Run multiple virtual computers on one physical box.

• Desktop

Page 9: Virtualization and Cloud Computing with Elastic Server On Demand

Virtualization

• Run multiple virtual computers on one physical box.

• Desktop

• Server

Page 10: Virtualization and Cloud Computing with Elastic Server On Demand

Virtualization

• Run multiple virtual computers on one physical box.

• Desktop

• Server

• Data Center

Page 11: Virtualization and Cloud Computing with Elastic Server On Demand

Virtualization

• Run multiple virtual computers on one physical box.

• Desktop

• Server

• Data Center

• Cloud

Page 12: Virtualization and Cloud Computing with Elastic Server On Demand

Lots of ways to do it

• Xen

• VMWare

• Parallels

• Amazon AMI

• Microsoft Hyper-V

• Clouds on the horizon

Page 13: Virtualization and Cloud Computing with Elastic Server On Demand

Desktop

Page 14: Virtualization and Cloud Computing with Elastic Server On Demand
Page 15: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Page 16: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?Developers

Page 17: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Develop on a VM to avoid fubaring your environment.

Developers

Page 18: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Develop on a VM to avoid fubaring your environment.

Get new developers started quickly.

Developers

Page 19: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Develop on a VM to avoid fubaring your environment.

Get new developers started quickly.

Multi env. testing.

Developers

Page 20: Virtualization and Cloud Computing with Elastic Server On Demand

We're able to save time and money by having 'standard' VMs for windows dev, rails dev, build machine, windows QA, etc. [...] It was really great when the customer handed over two VMs at the beginning of the project, and we were able to just load up those VMs and start our development.

John McCaffreyPathfinder (pathf.com)

Page 21: Virtualization and Cloud Computing with Elastic Server On Demand

Server

Page 22: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Page 23: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?Software Vendors

Page 24: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Everyone knows how to run a Rails server right?

Software Vendors

Page 25: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Everyone knows how to run a Rails server right?

Absolutely NOT.

Software Vendors

Page 26: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Everyone knows how to run a Rails server right?

Absolutely NOT.

Ship it virtualized!

Software Vendors

Page 27: Virtualization and Cloud Computing with Elastic Server On Demand

Data Center

Page 28: Virtualization and Cloud Computing with Elastic Server On Demand

Server Virtualization

Page 29: Virtualization and Cloud Computing with Elastic Server On Demand

Server Virtualization

Page 30: Virtualization and Cloud Computing with Elastic Server On Demand

Server Virtualization

Page 31: Virtualization and Cloud Computing with Elastic Server On Demand

Server Virtualization

Page 32: Virtualization and Cloud Computing with Elastic Server On Demand

You quickly forget about the virtualization except when you need it. When you need to migrate to new hardware or increase RAM on a moment's notice. Iʼll never [again] install a Linux instance that doesn't start with Xen.

Tom Mornini, EngineYard

We provide you a product that is free from traditional hosting constraints. An object that becomes larger or smaller as needed, is duplicated at will and free to move around.

Matt Tanase, SliceHost

Page 33: Virtualization and Cloud Computing with Elastic Server On Demand

VMWare has over 20,000 enterprise customers

90% are in production

Page 34: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Page 35: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?Your Data Center

Page 36: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Save $$$ through increased utilization.

Your Data Center

Page 37: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Save $$$ through increased utilization.

Decrease IT overhead through encapsulation.

Your Data Center

Page 38: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Save $$$ through increased utilization.

Decrease IT overhead through encapsulation.

Migrate slices and manage resources.

Your Data Center

Page 39: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Save $$$ through increased utilization.

Decrease IT overhead through encapsulation.

Migrate slices and manage resources.

Your Data Center

Page 40: Virtualization and Cloud Computing with Elastic Server On Demand

Clouds

Page 42: Virtualization and Cloud Computing with Elastic Server On Demand

Google

AppEngine

Slice

Host Engine

Yard

Mosso

FlexiScale

Joyent

Amazon

EC2

http://www.flickr.com/photos/psd

Page 45: Virtualization and Cloud Computing with Elastic Server On Demand

Cloud Approaches

Page 46: Virtualization and Cloud Computing with Elastic Server On Demand

• EngineYard - Managed Rails stack

Cloud Approaches

Page 47: Virtualization and Cloud Computing with Elastic Server On Demand

• EngineYard - Managed Rails stack

• SliceHost - Choice of base OS images

Cloud Approaches

Page 48: Virtualization and Cloud Computing with Elastic Server On Demand

• EngineYard - Managed Rails stack

• SliceHost - Choice of base OS images

• Google AppEngine - Python stack (for now)

Cloud Approaches

Page 49: Virtualization and Cloud Computing with Elastic Server On Demand

• EngineYard - Managed Rails stack

• SliceHost - Choice of base OS images

• Google AppEngine - Python stack (for now)

• Amazon EC2 - self-service roll your own

Cloud Approaches

Page 50: Virtualization and Cloud Computing with Elastic Server On Demand

• EngineYard - Managed Rails stack

• SliceHost - Choice of base OS images

• Google AppEngine - Python stack (for now)

• Amazon EC2 - self-service roll your own

• Private enterprise clouds...

Cloud Approaches

Page 51: Virtualization and Cloud Computing with Elastic Server On Demand
Page 52: Virtualization and Cloud Computing with Elastic Server On Demand

Animoto scales 50 slices to 3,500 over 3 days with Amazon EC2

Page 53: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Page 54: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?Everyone

Page 55: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Your boss is risk averse.

Everyone

Page 56: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Your boss is risk averse.

Your IT doesn’t know what Mongrel is.

Everyone

Page 57: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Your boss is risk averse.

Your IT doesn’t know what Mongrel is.

No money for hardware.

Everyone

Page 58: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Your boss is risk averse.

Your IT doesn’t know what Mongrel is.

No money for hardware.

Cloudbursting.

Everyone

Page 59: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Your boss is risk averse.

Your IT doesn’t know what Mongrel is.

No money for hardware.

Cloudbursting.

Virtual test labs.

Everyone

Page 60: Virtualization and Cloud Computing with Elastic Server On Demand

Who Can Benefit?

Your boss is risk averse.

Your IT doesn’t know what Mongrel is.

No money for hardware.

Cloudbursting.

Virtual test labs.

Run it in the cloud!

Everyone

Page 61: Virtualization and Cloud Computing with Elastic Server On Demand

Sweet! But...

Page 62: Virtualization and Cloud Computing with Elastic Server On Demand

Making EC2 Imagesdd if=/dev/zero of=ubuntu.fs count=1024 bs=1M

mke2fs -F -j ubuntu.fs sudo mount -o loop ubuntu.fs /mnt sudo debootstrap dapper /mnt sudo cp /etc/apt/sources.list /mnt/etc/apt/sources.list sudo chroot /mnt

now in the image:

passwd aptitude update aptitude upgrade aptitude install openssh-server aptitude install [more packages ... ]cat > /etc/network/interfaces

auto lo iface lo inet loopback [hit ctrl^D]

auto eth0 iface eth0 inet dhcp

sudo umount /mnt ec2-bundle-image -i ubuntu.fs -k [MYKEYFILE] -u [MYUSERID] ec2-upload-bundle -b my-ubuntu -m image.manifest -a [MYKEY] -s [MYSECRET] ec2-register my-ubuntu/image.manifest

Page 63: Virtualization and Cloud Computing with Elastic Server On Demand

Making EC2 Imagesdd if=/dev/zero of=ubuntu.fs count=1024 bs=1M

mke2fs -F -j ubuntu.fs sudo mount -o loop ubuntu.fs /mnt sudo debootstrap dapper /mnt sudo cp /etc/apt/sources.list /mnt/etc/apt/sources.list sudo chroot /mnt

now in the image:

passwd aptitude update aptitude upgrade aptitude install openssh-server aptitude install [more packages ... ]cat > /etc/network/interfaces

auto lo iface lo inet loopback [hit ctrl^D]

auto eth0 iface eth0 inet dhcp

sudo umount /mnt ec2-bundle-image -i ubuntu.fs -k [MYKEYFILE] -u [MYUSERID] ec2-upload-bundle -b my-ubuntu -m image.manifest -a [MYKEY] -s [MYSECRET] ec2-register my-ubuntu/image.manifest

This is Hard,Annoying,and not

Easily Reproducible

Page 64: Virtualization and Cloud Computing with Elastic Server On Demand
Page 65: Virtualization and Cloud Computing with Elastic Server On Demand

A Job Opening?

Page 66: Virtualization and Cloud Computing with Elastic Server On Demand
Page 67: Virtualization and Cloud Computing with Elastic Server On Demand

Making VMs Today

Page 68: Virtualization and Cloud Computing with Elastic Server On Demand

Making VMs Today

• Create new VM, install new OS or start with a base image

Page 69: Virtualization and Cloud Computing with Elastic Server On Demand

Making VMs Today

• Create new VM, install new OS or start with a base image

• Tweak, tweak, tweak, snapshot

Page 70: Virtualization and Cloud Computing with Elastic Server On Demand

Making VMs Today

• Create new VM, install new OS or start with a base image

• Tweak, tweak, tweak, snapshot

• Hopefully write down what you did and where it’s running

Page 71: Virtualization and Cloud Computing with Elastic Server On Demand
Page 72: Virtualization and Cloud Computing with Elastic Server On Demand

What We Need

Page 73: Virtualization and Cloud Computing with Elastic Server On Demand

What We Need

• Quick and reproducible VM provisioning

Page 74: Virtualization and Cloud Computing with Elastic Server On Demand

What We Need

• Quick and reproducible VM provisioning

• Tracking contents and patches

Page 75: Virtualization and Cloud Computing with Elastic Server On Demand

What We Need

• Quick and reproducible VM provisioning

• Tracking contents and patches

• Freedom of choice in hosting/cloud

Page 76: Virtualization and Cloud Computing with Elastic Server On Demand

What We Need

• Quick and reproducible VM provisioning

• Tracking contents and patches

• Freedom of choice in hosting/cloud

• Testing locally, deploying globally

Page 77: Virtualization and Cloud Computing with Elastic Server On Demand

What We Need

• Quick and reproducible VM provisioning

• Tracking contents and patches

• Freedom of choice in hosting/cloud

• Testing locally, deploying globally

• Manage running instances

Page 78: Virtualization and Cloud Computing with Elastic Server On Demand

Elastic Server On Demand

http://elasticserver.com

Page 79: Virtualization and Cloud Computing with Elastic Server On Demand

Elastic Server On Demand

Page 80: Virtualization and Cloud Computing with Elastic Server On Demand

Elastic Server On Demand

• Virtualization manufacturing plant

Page 81: Virtualization and Cloud Computing with Elastic Server On Demand

Elastic Server On Demand

• Virtualization manufacturing plant

• Component repositories

Page 82: Virtualization and Cloud Computing with Elastic Server On Demand

Elastic Server On Demand

• Virtualization manufacturing plant

• Component repositories

• Agnostic about OS, virtualization, app stack

Page 83: Virtualization and Cloud Computing with Elastic Server On Demand

Elastic Server On Demand

• Virtualization manufacturing plant

• Component repositories

• Agnostic about OS, virtualization, app stack

• Track server assemblies and instances

Page 84: Virtualization and Cloud Computing with Elastic Server On Demand

Elastic Server On Demand

• Virtualization manufacturing plant

• Component repositories

• Agnostic about OS, virtualization, app stack

• Track server assemblies and instances

• Provisioning portals

Page 85: Virtualization and Cloud Computing with Elastic Server On Demand

Elastic Server On Demand

• Virtualization manufacturing plant

• Component repositories

• Agnostic about OS, virtualization, app stack

• Track server assemblies and instances

• Provisioning portals

• Management console and API

Page 86: Virtualization and Cloud Computing with Elastic Server On Demand
Page 88: Virtualization and Cloud Computing with Elastic Server On Demand
Page 89: Virtualization and Cloud Computing with Elastic Server On Demand
Page 90: Virtualization and Cloud Computing with Elastic Server On Demand
Page 91: Virtualization and Cloud Computing with Elastic Server On Demand
Page 92: Virtualization and Cloud Computing with Elastic Server On Demand

Dev Tools

• VMWare Fusion/Player

• MacFUSE + MacFusion

• Elastic Server Capistrano Script http://es.cohesiveft.com/whitelabel/rails2/images/deploy.rb

Page 93: Virtualization and Cloud Computing with Elastic Server On Demand
Page 94: Virtualization and Cloud Computing with Elastic Server On Demand

Adding Custom Components

Page 95: Virtualization and Cloud Computing with Elastic Server On Demand
Page 96: Virtualization and Cloud Computing with Elastic Server On Demand
Page 97: Virtualization and Cloud Computing with Elastic Server On Demand

Into The Clouds

Page 98: Virtualization and Cloud Computing with Elastic Server On Demand
Page 99: Virtualization and Cloud Computing with Elastic Server On Demand
Page 100: Virtualization and Cloud Computing with Elastic Server On Demand

Summary

Page 101: Virtualization and Cloud Computing with Elastic Server On Demand

Summary

• Save money in IT operations by consolidating resources

Page 102: Virtualization and Cloud Computing with Elastic Server On Demand

Summary

• Save money in IT operations by consolidating resources

• Increase dev agility through self-provisioning, reducing friction with ops

Page 103: Virtualization and Cloud Computing with Elastic Server On Demand

Summary

• Save money in IT operations by consolidating resources

• Increase dev agility through self-provisioning, reducing friction with ops

• Use cloud resources to supplement internal resources for traffic spikes (cloudbursting) and virtual test labs

Page 104: Virtualization and Cloud Computing with Elastic Server On Demand

elasticserver.com

Page 105: Virtualization and Cloud Computing with Elastic Server On Demand

Usage Data